TY - JOUR
T1 - Layer-wise domain correction for unsupervised domain adaptation
AU - Li, Shuang
AU - Song, Shi ji
AU - Wu, Cheng
N1 - Publisher Copyright:
© 2018, Zhejiang University and Springer-Verlag GmbH Germany, part of Springer Nature.
PY - 2018/1/1
Y1 - 2018/1/1
N2 - Deep neural networks have been successfully applied to numerous machine learning tasks because of their impressive feature abstraction capabilities. However, conventional deep networks assume that the training and test data are sampled from the same distribution, and this assumption is often violated in real-world scenarios. To address the domain shift or data bias problems, we introduce layer-wise domain correction (LDC), a new unsupervised domain adaptation algorithm which adapts an existing deep network through additive correction layers spaced throughout the network. Through the additive layers, the representations of source and target domains can be perfectly aligned. The corrections that are trained via maximum mean discrepancy, adapt to the target domain while increasing the representational capacity of the network. LDC requires no target labels, achieves state-of-the-art performance across several adaptation benchmarks, and requires significantly less training time than existing adaptation methods.
AB - Deep neural networks have been successfully applied to numerous machine learning tasks because of their impressive feature abstraction capabilities. However, conventional deep networks assume that the training and test data are sampled from the same distribution, and this assumption is often violated in real-world scenarios. To address the domain shift or data bias problems, we introduce layer-wise domain correction (LDC), a new unsupervised domain adaptation algorithm which adapts an existing deep network through additive correction layers spaced throughout the network. Through the additive layers, the representations of source and target domains can be perfectly aligned. The corrections that are trained via maximum mean discrepancy, adapt to the target domain while increasing the representational capacity of the network. LDC requires no target labels, achieves state-of-the-art performance across several adaptation benchmarks, and requires significantly less training time than existing adaptation methods.
KW - Deep learning
KW - Maximum mean discrepancy
KW - Residual network
KW - Unsupervised domain adaptation
UR - https://www.scopus.com/pages/publications/85044249989
U2 - 10.1631/FITEE.1700774
DO - 10.1631/FITEE.1700774
M3 - 文章
AN - SCOPUS:85044249989
SN - 2095-9184
VL - 19
SP - 91
EP - 103
JO - Frontiers of Information Technology and Electronic Engineering
JF - Frontiers of Information Technology and Electronic Engineering
IS - 1
ER -