JMLR

Decorrelated Local Linear Estimator: Inference for Non-linear Effects in High-dimensional Additive Models

Authors
Zijian Guo Wei Yuan Cunhui Zhang
Research Topics
High-Dimensional Statistics
Paper Information
  • Journal:
    Journal of Machine Learning Research
  • Added to Tracker:
    Mar 03, 2026
Abstract

Additive models play an essential role in studying non-linear relationships. Despite many recent advances in estimation, there is a lack of methods and theories for inference in high-dimensional additive models, including confidence interval construction and hypothesis testing. Motivated by inference for non-linear treatment effects, we consider the high-dimensional additive model and make inferences for the function derivative. We propose a novel decorrelated local linear estimator and establish its asymptotic normality. The main novelty is the construction of the decorrelation weights, which is instrumental in reducing the error inherited from estimating the nuisance functions in the high-dimensional additive model. We construct the confidence interval for the function derivative and conduct the related hypothesis testing. We demonstrate our proposed method over large-scale simulation studies and apply it to identify non-linear effects in the motif regression problem. Our proposed method is implemented in the R package DLL available from CRAN.

Author Details
Zijian Guo
Author
Wei Yuan
Author
Cunhui Zhang
Author
Research Topics & Keywords
High-Dimensional Statistics
Research Area
Citation Information
APA Format
Zijian Guo , Wei Yuan & Cunhui Zhang . Decorrelated Local Linear Estimator: Inference for Non-linear Effects in High-dimensional Additive Models. Journal of Machine Learning Research .
BibTeX Format
@article{paper987,
  title = { Decorrelated Local Linear Estimator: Inference for Non-linear Effects in High-dimensional Additive Models },
  author = { Zijian Guo and Wei Yuan and Cunhui Zhang },
  journal = { Journal of Machine Learning Research },
  url = { https://www.jmlr.org/papers/v27/22-1436.html }
}