JMLR

Error bounds for particle gradient descent, and extensions of the log-Sobolev and Talagrand inequalities

Authors
Rocco Caprio Juan Kuntz Samuel Power Adam M. Johansen
Paper Information
  • Journal:
    Journal of Machine Learning Research
  • Added to Tracker:
    Jul 15, 2025
Abstract

We derive non-asymptotic error bounds for particle gradient descent (PGD, Kuntz et al. (2023)), a recently introduced algorithm for maximum likelihood estimation of large latent variable models obtained by discretizing a gradient flow of the free energy. We begin by showing that the flow converges exponentially fast to the free energy's minimizers for models satisfying a condition that generalizes both the log-Sobolev and the Polyak--Łojasiewicz inequalities (LSI and PŁI, respectively). We achieve this by extending a result well-known in the optimal transport literature (that the LSI implies the Talagrand inequality) and its counterpart in the optimization literature (that the PŁI implies the so-called quadratic growth condition), and applying the extension to our new setting. We also generalize the Bakry--Émery Theorem and show that the LSI/PŁI extension holds for models with strongly concave log-likelihoods. For such models, we further control PGD's discretization error and obtain the non-asymptotic error bounds. While we are motivated by the study of PGD, we believe that the inequalities and results we extend may be of independent interest.

Author Details
Rocco Caprio
Author
Juan Kuntz
Author
Samuel Power
Author
Adam M. Johansen
Author
Citation Information
APA Format
Rocco Caprio , Juan Kuntz , Samuel Power & Adam M. Johansen . Error bounds for particle gradient descent, and extensions of the log-Sobolev and Talagrand inequalities. Journal of Machine Learning Research .
BibTeX Format
@article{JMLR:v26:24-0437,
  author  = {Rocco Caprio and Juan Kuntz and Samuel Power and Adam M. Johansen},
  title   = {Error bounds for particle gradient descent, and extensions of the log-Sobolev and Talagrand inequalities},
  journal = {Journal of Machine Learning Research},
  year    = {2025},
  volume  = {26},
  number  = {103},
  pages   = {1--38},
  url     = {http://jmlr.org/papers/v26/24-0437.html}
}
Related Papers