JMLR

Distribution Free Tests for Model Selection Based on Maximum Mean Discrepancy with Estimated Parameters

Authors
Florian Brück Jean-David Fermanian Aleksey Min
Research Topics
Statistical Learning
Paper Information
  • Journal:
    Journal of Machine Learning Research
  • Added to Tracker:
    Jul 15, 2025
Abstract

There exist several testing procedures based on the maximum mean discrepancy (MMD) to address the challenge of model specification. However, these testing procedures ignore the presence of estimated parameters in the case of composite null hypotheses. In this paper, we first illustrate the effect of parameter estimation in model specification tests based on the MMD. Second, we propose simple model specification and model selection tests in the case of models with estimated parameters. All our tests are asymptotically standard normal under the null, even when the true underlying distribution belongs to the competing parametric families. A simulation study and a real data analysis illustrate the performance of our tests in terms of power and level.

Author Details
Florian Brück
Author
Jean-David Fermanian
Author
Aleksey Min
Author
Research Topics & Keywords
Statistical Learning
Research Area
Citation Information
APA Format
Florian Brück , Jean-David Fermanian & Aleksey Min . Distribution Free Tests for Model Selection Based on Maximum Mean Discrepancy with Estimated Parameters. Journal of Machine Learning Research .
BibTeX Format
@article{JMLR:v26:23-1199,
  author  = {Florian Br{{\"u}}ck and Jean-David Fermanian and Aleksey Min},
  title   = {Distribution Free Tests for Model Selection Based on Maximum Mean Discrepancy with Estimated Parameters},
  journal = {Journal of Machine Learning Research},
  year    = {2025},
  volume  = {26},
  number  = {100},
  pages   = {1--52},
  url     = {http://jmlr.org/papers/v26/23-1199.html}
}
Related Papers