TY - JOUR
T1 - Growing-dimensional partially functional linear models
T2 - non-asymptotic optimal prediction error
AU - Zhang, Huiming
AU - Lei, Xiaoyu
N1 - Publisher Copyright:
© 2023 The Author(s). Published by IOP Publishing Ltd
PY - 2023/9/1
Y1 - 2023/9/1
N2 - Under the reproducing kernel Hilbert spaces (RKHS), we focus on the penalized least-squares of the partially functional linear models (PFLM), whose predictor contains both functional and traditional multivariate parts, and the multivariate part allows a divergent number of parameters. From the non-asymptotic point of view, we study the rate-optimal upper and lower bounds of the prediction error. An exact upper bound for the excess prediction risk is shown in a non-asymptotic form under a more general assumption known as the effective dimension to the model, by which we also show the prediction consistency when the number of multivariate covariates p slightly increases with the sample size n. Our new finding implies a trade-off between the number of non-functional predictors and the effective dimension of the kernel principal components to ensure prediction consistency in the increasing-dimensional setting. The analysis in our proof hinges on the spectral condition of the sandwich operator of the covariance operator and the reproducing kernel, and on sub-Gaussian and Berstein concentration inequalities for the random elements in Hilbert space. Finally, we derive the non-asymptotic minimax lower bound under the regularity assumption of the Kullback-Leibler divergence of the models.
AB - Under the reproducing kernel Hilbert spaces (RKHS), we focus on the penalized least-squares of the partially functional linear models (PFLM), whose predictor contains both functional and traditional multivariate parts, and the multivariate part allows a divergent number of parameters. From the non-asymptotic point of view, we study the rate-optimal upper and lower bounds of the prediction error. An exact upper bound for the excess prediction risk is shown in a non-asymptotic form under a more general assumption known as the effective dimension to the model, by which we also show the prediction consistency when the number of multivariate covariates p slightly increases with the sample size n. Our new finding implies a trade-off between the number of non-functional predictors and the effective dimension of the kernel principal components to ensure prediction consistency in the increasing-dimensional setting. The analysis in our proof hinges on the spectral condition of the sandwich operator of the covariance operator and the reproducing kernel, and on sub-Gaussian and Berstein concentration inequalities for the random elements in Hilbert space. Finally, we derive the non-asymptotic minimax lower bound under the regularity assumption of the Kullback-Leibler divergence of the models.
KW - diverging number of covariates
KW - minimax rate
KW - non-asymptotic bound
KW - partially functional linear models
KW - reproducing kernel Hilbert space
KW - sub-Gaussian and Berstein concentration inequalities in Hilbert space
UR - https://www.scopus.com/pages/publications/85167866305
U2 - 10.1088/1402-4896/aceac0
DO - 10.1088/1402-4896/aceac0
M3 - 文章
AN - SCOPUS:85167866305
SN - 0031-8949
VL - 98
JO - Physica Scripta
JF - Physica Scripta
IS - 9
M1 - 095216
ER -