JMLR

Affine Rank Minimization via Asymptotic Log-Det Iteratively Reweighted Least Squares

Authors
Sebastian Krämer
Paper Information
  • Journal:
    Journal of Machine Learning Research
  • Added to Tracker:
    Jul 15, 2025
Abstract

The affine rank minimization problem is a well-known approach to matrix recovery. While there are various surrogates to this NP-hard problem, we prove that the asymptotic minimization of log-det objective functions indeed always reveals the desired, lowest-rank matrices---whereas such may or may not recover a sought-after ground truth. Concerning commonly applied methods such as iteratively reweighted least squares, one thus remains with two difficult to distinguish concerns: how problematic are local minima inherent to the approach truly; and opposingly, how influential instead is the numerical realization. We first show that comparable solution statements do not hold true for Schatten-$p$ functions, including the nuclear norm, and discuss the role of divergent minimizers. Subsequently, we outline corresponding implications for general optimization approaches as well as the more specific IRLS-$0$ algorithm, emphasizing through examples that the transition of the involved smoothing parameter to zero is frequently a more substantial issue than non-convexity. Lastly, we analyze several presented aspects empirically in a series of numerical experiments. In particular, allowing for instance sufficiently many iterations, one may even observe a phase transition for generic recoverability at the absolute theoretical minimum.

Author Details
Sebastian Krämer
Author
Citation Information
APA Format
Sebastian Krämer . Affine Rank Minimization via Asymptotic Log-Det Iteratively Reweighted Least Squares. Journal of Machine Learning Research .
BibTeX Format
@article{JMLR:v26:23-0943,
  author  = {Sebastian Kr{{\"a}}mer},
  title   = {Affine Rank Minimization via Asymptotic Log-Det Iteratively Reweighted Least Squares},
  journal = {Journal of Machine Learning Research},
  year    = {2025},
  volume  = {26},
  number  = {92},
  pages   = {1--44},
  url     = {http://jmlr.org/papers/v26/23-0943.html}
}
Related Papers