Distribution Free Tests for Model Selection Based on Maximum Mean Discrepancy with Estimated Parameters
Authors
Research Topics
Paper Information
-
Journal:
Journal of Machine Learning Research -
Added to Tracker:
Jul 15, 2025
Abstract
There exist several testing procedures based on the maximum mean discrepancy (MMD) to address the challenge of model specification. However, these testing procedures ignore the presence of estimated parameters in the case of composite null hypotheses. In this paper, we first illustrate the effect of parameter estimation in model specification tests based on the MMD. Second, we propose simple model specification and model selection tests in the case of models with estimated parameters. All our tests are asymptotically standard normal under the null, even when the true underlying distribution belongs to the competing parametric families. A simulation study and a real data analysis illustrate the performance of our tests in terms of power and level.
Author Details
Florian Brück
AuthorJean-David Fermanian
AuthorAleksey Min
AuthorResearch Topics & Keywords
Statistical Learning
Research AreaCitation Information
APA Format
Florian Brück
,
Jean-David Fermanian
&
Aleksey Min
.
Distribution Free Tests for Model Selection Based on Maximum Mean Discrepancy with Estimated Parameters.
Journal of Machine Learning Research
.
BibTeX Format
@article{JMLR:v26:23-1199,
author = {Florian Br{{\"u}}ck and Jean-David Fermanian and Aleksey Min},
title = {Distribution Free Tests for Model Selection Based on Maximum Mean Discrepancy with Estimated Parameters},
journal = {Journal of Machine Learning Research},
year = {2025},
volume = {26},
number = {100},
pages = {1--52},
url = {http://jmlr.org/papers/v26/23-1199.html}
}