JMLR

Efficient Modeling of Surrogates to Improve Multi-source High-dimensional Integrative Regression

Authors
Tianxi Cai Zijian Guo Yue Liu Molei Liu
Research Topics
Machine Learning High-Dimensional Statistics
Paper Information
  • Journal:
    Journal of Machine Learning Research
  • Added to Tracker:
    Sep 08, 2026
Abstract

Surrogate variables play an important role in various fields due to the scarcity or absence of gold-standard labels. We develop a novel approach named SASH for Surrogate-Assisted and data-Shielding High-dimensional integrative regression. It is a semi-supervised approach that efficiently leverages sizable unlabeled samples with error-prone surrogate outcomes from multiple local sites to improve model estimation using the small gold-labeled sample. To facilitate stable and efficient knowledge extraction from the surrogates, our method first obtains a preliminary supervised estimator, and then uses it to assist in training a regularized single-index model (SIM) for the surrogates. Interestingly, through a chain of convex and properly penalized sparse regressions that approximate the SIM loss using bias correction, our method avoids the problem of local minima in the SIM, and fully eliminates the impact of the preliminary estimator's excessive error. In addition, it protects individual-level information through the aggregation of summary statistics from local sites, leveraging a similar idea of bias-corrected approximation. Through simulation studies, we demonstrate that our method outperforms existing approaches. Finally, we apply our method to develop a genetic risk model for type 2 diabetes using large-scale data sets from UK and Mass General Brigham biobanks, where only a small fraction of subjects in one site are labeled through manual chart review.

Author Details
Tianxi Cai
Author
Zijian Guo
Author
Yue Liu
Author
Molei Liu
Author
Research Topics & Keywords
Machine Learning
Research Area
High-Dimensional Statistics
Research Area
Citation Information
APA Format
Tianxi Cai , Zijian Guo , Yue Liu & Molei Liu . Efficient Modeling of Surrogates to Improve Multi-source High-dimensional Integrative Regression. Journal of Machine Learning Research .
BibTeX Format
@article{paper1640,
  title = { Efficient Modeling of Surrogates to Improve Multi-source High-dimensional Integrative Regression },
  author = { Tianxi Cai and Zijian Guo and Yue Liu and Molei Liu },
  journal = { Journal of Machine Learning Research },
  url = { https://www.jmlr.org/papers/v27/23-1235.html }
}