论文标题
对可变指数besov空间的回归问题深度学习的估计误差分析
Estimation error analysis of deep learning on the regression problem on the variable exponent Besov space
论文作者
论文摘要
深度学习在各个领域都取得了显着的成功,包括图像和语音识别。深度学习成功表现的因素之一是其高功能提取能力。在这项研究中,我们专注于深度学习的适应性。因此,我们处理可变指数BESOV空间,该空间的平滑度不同,具体取决于输入位置$ x $。换句话说,估计的难度在域内并不统一。我们分析了可变指数BESOV空间的一般近似误差以及深度学习的近似和估计误差。我们注意到,当目标函数的平滑度较小并且维度较大时,基于适应性的改进是显着的。此外,相对于估计误差的收敛速率显示了对线性估计器的优势。
Deep learning has achieved notable success in various fields, including image and speech recognition. One of the factors in the successful performance of deep learning is its high feature extraction ability. In this study, we focus on the adaptivity of deep learning; consequently, we treat the variable exponent Besov space, which has a different smoothness depending on the input location $x$. In other words, the difficulty of the estimation is not uniform within the domain. We analyze the general approximation error of the variable exponent Besov space and the approximation and estimation errors of deep learning. We note that the improvement based on adaptivity is remarkable when the region upon which the target function has less smoothness is small and the dimension is large. Moreover, the superiority to linear estimators is shown with respect to the convergence rate of the estimation error.