DCatalyst: A Unified Accelerated Framework for Decentralized Optimization
Authors
Research Topics
Paper Information
-
Journal:
Journal of Machine Learning Research -
Added to Tracker:
Mar 03, 2026
Abstract
We study decentralized optimization over a network of agents, modeled as an undirected graph and operating without a central server. The objective is to minimize a composite function $f+r$, where $f$ is a (strongly) convex function representing the average of the agents' losses, and $r$ is a convex, extended-value function (regularizer). We introduce DCatalyst, a unified black-box framework that injects Nesterov-type acceleration into decentralized optimization algorithms. At its core, DCatalyst is an inexact, momentum-accelerated proximal scheme (outer loop) that seamlessly wraps around a given decentralized method (inner loop). We show that DCatalyst attains optimal (up to logarithmic factors) communication and computational complexity across a broad family of decentralized algorithms and problem instances. In particular, it delivers accelerated rates for problem classes that previously lacked accelerated decentralized methods, thereby broadening the effectiveness of decentralized methods. On the technical side, our framework introduces inexact estimating sequences--an extension of Nesterov's classical estimating sequences, tailored to decentralized, composite optimization. This construction systematically accommodates consensus errors and inexact solutions of local subproblems, addressing challenges that existing estimating-sequence-based analyses cannot handle while retaining a black-box, plug-and-play character.
Author Details
Gesualdo Scutari
AuthorTIanyu Cao
AuthorXiaokai Chen
AuthorResearch Topics & Keywords
Computational Statistics
Research AreaCitation Information
APA Format
Gesualdo Scutari
,
TIanyu Cao
&
Xiaokai Chen
.
DCatalyst: A Unified Accelerated Framework for Decentralized Optimization.
Journal of Machine Learning Research
.
BibTeX Format
@article{paper967,
title = { DCatalyst: A Unified Accelerated Framework for Decentralized Optimization },
author = {
Gesualdo Scutari
and TIanyu Cao
and Xiaokai Chen
},
journal = { Journal of Machine Learning Research },
url = { https://www.jmlr.org/papers/v27/25-0185.html }
}