JMLR

Statistical Inference for High-dimensional Partially Linear Models via Debiased Rank Lasso

Authors
Runze Li Songshan Yang Delin Zhao
Research Topics
High-Dimensional Statistics
Paper Information
  • Journal:
    Journal of Machine Learning Research
  • Added to Tracker:
    Sep 08, 2026
Abstract

This paper aims to develop tuning-free and robust regularized methods for partially linear models based on partial residual methods. In order to preserve the near-oracle rate of rank Lasso, we construct a new estimator via a data-splitting procedure and name the resulting estimator as data-splitting (DS) rank Lasso, which is based on partial prediction residuals. Thus, the proposed estimation procedure is distinguished from the traditional partial residual based methods, which are based on the model-fitting residuals. We show that the DS rank Lasso enjoys several appealing features including tuning-free property and robust property to heavy-tailed random errors, and possesses near-oracle rate. We further propose statistical inference procedures for individual coefficients using the debiased Lasso techniques. The resulting estimator is termed the debiased DS rank Lasso estimator. This paper reveals an interesting theoretical finding: the DS rank Lasso estimate achieves near-oracle rate and the proposed debiased DS rank Lasso estimator does not suffer asymptotic efficiency loss due to the use of data-splitting. We further establish a simultaneous inference procedure based on multiplier bootstrap. We conduct Monte Carlo studies to assess finite sample performance of the proposed procedures, and illustrate the proposed methodology via an empirical analysis of a real-world data set.

Author Details
Runze Li
Author
Songshan Yang
Author
Delin Zhao
Author
Research Topics & Keywords
High-Dimensional Statistics
Research Area
Citation Information
APA Format
Runze Li , Songshan Yang & Delin Zhao . Statistical Inference for High-dimensional Partially Linear Models via Debiased Rank Lasso. Journal of Machine Learning Research .
BibTeX Format
@article{paper1617,
  title = { Statistical Inference for High-dimensional Partially Linear Models via Debiased Rank Lasso },
  author = { Runze Li and Songshan Yang and Delin Zhao },
  journal = { Journal of Machine Learning Research },
  url = { https://www.jmlr.org/papers/v27/25-0591.html }
}