TY - GEN
T1 - Distributed Online Optimization via Kernel Reproduced Gradient Descent
AU - Lin, Yifu
AU - Li, Wenling
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - This paper focuses on a stochastic optimization problem in distributed online learning. To accelerate the op-timization in a distributed framework, a reproducing gradient method is proposed based on kernel learning. Considering the practicality of distributed settings, this method utilizes random Fourier features for gradient learning, which enables privacy protection as model parameters and gradients do not need to be transmitted over the network. Further, a distributed online reproduced gradient descent algorithm is proposed, and the convergence rate of the algorithm is provided. Numerical results show that our method outperforms the existing distributed stochastic gradient descent based on gradient tracking.
AB - This paper focuses on a stochastic optimization problem in distributed online learning. To accelerate the op-timization in a distributed framework, a reproducing gradient method is proposed based on kernel learning. Considering the practicality of distributed settings, this method utilizes random Fourier features for gradient learning, which enables privacy protection as model parameters and gradients do not need to be transmitted over the network. Further, a distributed online reproduced gradient descent algorithm is proposed, and the convergence rate of the algorithm is provided. Numerical results show that our method outperforms the existing distributed stochastic gradient descent based on gradient tracking.
KW - distributed online learning
KW - kernel learning
KW - privacy protection
KW - random Fourier features
UR - https://www.scopus.com/pages/publications/85182726177
U2 - 10.1109/CSIS-IAC60628.2023.10363902
DO - 10.1109/CSIS-IAC60628.2023.10363902
M3 - 会议稿件
AN - SCOPUS:85182726177
T3 - 2023 International Annual Conference on Complex Systems and Intelligent Science, CSIS-IAC 2023
SP - 358
EP - 362
BT - 2023 International Annual Conference on Complex Systems and Intelligent Science, CSIS-IAC 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2023 International Annual Conference on Complex Systems and Intelligent Science, CSIS-IAC 2023
Y2 - 20 October 2023 through 22 October 2023
ER -