论文标题

带有大规模推理的平滑分位数回归

Smoothed Quantile Regression with Large-Scale Inference

论文作者

He, Xuming, Pan, Xiaoou, Tan, Kean Ming, Zhou, Wen-Xin

论文摘要

分位数回归是在探索异质效应时学习响应变量与多元预测变量之间关系的强大工具。在本文中,我们考虑了对“增加维度”制度中大规模数据的分位数回归的统计推断。我们对卷积型平滑方法进行了全面而深入的分析,该方法可以实现足够的计算和分数回归的推断。 This method, which we refer to as {\it{conquer}}, turns the non-differentiable quantile loss function into a twice-differentiable, convex and locally strongly convex surrogate, which admits a fast and scalable Barzilai-Borwein gradient-based algorithm to perform optimization, and multiplier bootstrap for statistical inference.从理论上讲,我们在估计和巴哈杜尔 - 基德线性化误差上建立了明确的非质子性界限,从中我们表明,征服估计量的渐近正态性在回归量较弱的要求下,比常规分位数回归所需的回归数量较弱。此外,我们证明了乘数引导置信构建的有效性。我们的数值研究证实了征服估计量是对分位数回归的大规模推断的实际可靠方法。实施该方法的软件可在\ texttt {r}软件包\ texttt {conquer}中获得。

Quantile regression is a powerful tool for learning the relationship between a response variable and a multivariate predictor while exploring heterogeneous effects. In this paper, we consider statistical inference for quantile regression with large-scale data in the "increasing dimension" regime. We provide a comprehensive and in-depth analysis of a convolution-type smoothing approach that achieves adequate approximation to computation and inference for quantile regression. This method, which we refer to as {\it{conquer}}, turns the non-differentiable quantile loss function into a twice-differentiable, convex and locally strongly convex surrogate, which admits a fast and scalable Barzilai-Borwein gradient-based algorithm to perform optimization, and multiplier bootstrap for statistical inference. Theoretically, we establish explicit non-asymptotic bounds on both estimation and Bahadur-Kiefer linearization errors, from which we show that the asymptotic normality of the conquer estimator holds under a weaker requirement on the number of the regressors than needed for conventional quantile regression. Moreover, we prove the validity of multiplier bootstrap confidence constructions. Our numerical studies confirm the conquer estimator as a practical and reliable approach to large-scale inference for quantile regression. Software implementing the methodology is available in the \texttt{R} package \texttt{conquer}.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源