JMLR

DCatalyst: A Unified Accelerated Framework for Decentralized Optimization

Authors
Gesualdo Scutari TIanyu Cao Xiaokai Chen
Research Topics
Computational Statistics
Paper Information
  • Journal:
    Journal of Machine Learning Research
  • Added to Tracker:
    Mar 03, 2026
Abstract

We study decentralized optimization over a network of agents, modeled as an undirected graph and operating without a central server. The objective is to minimize a composite function $f+r$, where $f$ is a (strongly) convex function representing the average of the agents' losses, and $r$ is a convex, extended-value function (regularizer). We introduce DCatalyst, a unified black-box framework that injects Nesterov-type acceleration into decentralized optimization algorithms. At its core, DCatalyst is an inexact, momentum-accelerated proximal scheme (outer loop) that seamlessly wraps around a given decentralized method (inner loop). We show that DCatalyst attains optimal (up to logarithmic factors) communication and computational complexity across a broad family of decentralized algorithms and problem instances. In particular, it delivers accelerated rates for problem classes that previously lacked accelerated decentralized methods, thereby broadening the effectiveness of decentralized methods. On the technical side, our framework introduces inexact estimating sequences--an extension of Nesterov's classical estimating sequences, tailored to decentralized, composite optimization. This construction systematically accommodates consensus errors and inexact solutions of local subproblems, addressing challenges that existing estimating-sequence-based analyses cannot handle while retaining a black-box, plug-and-play character.

Author Details
Gesualdo Scutari
Author
TIanyu Cao
Author
Xiaokai Chen
Author
Research Topics & Keywords
Computational Statistics
Research Area
Citation Information
APA Format
Gesualdo Scutari , TIanyu Cao & Xiaokai Chen . DCatalyst: A Unified Accelerated Framework for Decentralized Optimization. Journal of Machine Learning Research .
BibTeX Format
@article{paper967,
  title = { DCatalyst: A Unified Accelerated Framework for Decentralized Optimization },
  author = { Gesualdo Scutari and TIanyu Cao and Xiaokai Chen },
  journal = { Journal of Machine Learning Research },
  url = { https://www.jmlr.org/papers/v27/25-0185.html }
}