TY - JOUR
T1 - Transformer-Based Water Quality Forecasting With Dual Patch and Trend Decomposition
AU - Lin, Yongze
AU - Qiao, Junfei
AU - Bi, Jing
AU - Yuan, Haitao
AU - Wang, Mengyuan
AU - Zhang, Jia
AU - Zhou, Meng Chu
N1 - Publisher Copyright:
© 2014 IEEE.
PY - 2025
Y1 - 2025
N2 - In many fields, time series prediction is gaining more and more attention, e.g., air pollution, geological hazards, and network traffic prediction. Water quality prediction uses historical data to predict future water quality. However, it is difficult to learn a representation map from a time series that captures the trends and fluctuations to effectively remove noise from the time series data and investigate complex nonlinear relationships. To solve these problems, this work proposes a time series prediction model, called DPSGT for short, which integrates Dual Patch Savitsky–Golay filtering and Transformer. First, DPSGT adopts the SG filtering to decompose the time series data and reduce the noise interference to improve long–term prediction capabilities. Second, to tackle the limitation of temporal representation capability, DPSGT adopts dual patches to ravel temporal series into local and global patches, which can tackle local semantic information and enlarge the receptive field. Third, it utilizes a transformer mechanism to address the nonlinear problem of the water quality time series and improve the accuracy of the prediction. Two real-world datasets are utilized to evaluate the proposed DPSGT, and experiments prove that DPSGT improves root mean-square error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and R2 by 6%, 5%, 8%, and 7%, respectively, compared with other benchmark models.
AB - In many fields, time series prediction is gaining more and more attention, e.g., air pollution, geological hazards, and network traffic prediction. Water quality prediction uses historical data to predict future water quality. However, it is difficult to learn a representation map from a time series that captures the trends and fluctuations to effectively remove noise from the time series data and investigate complex nonlinear relationships. To solve these problems, this work proposes a time series prediction model, called DPSGT for short, which integrates Dual Patch Savitsky–Golay filtering and Transformer. First, DPSGT adopts the SG filtering to decompose the time series data and reduce the noise interference to improve long–term prediction capabilities. Second, to tackle the limitation of temporal representation capability, DPSGT adopts dual patches to ravel temporal series into local and global patches, which can tackle local semantic information and enlarge the receptive field. Third, it utilizes a transformer mechanism to address the nonlinear problem of the water quality time series and improve the accuracy of the prediction. Two real-world datasets are utilized to evaluate the proposed DPSGT, and experiments prove that DPSGT improves root mean-square error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and R2 by 6%, 5%, 8%, and 7%, respectively, compared with other benchmark models.
KW - Savitsky-Golay (SG) filter
KW - self-supervised learning
KW - transformer
KW - trend decomposition
KW - water quality time series prediction
UR - https://www.scopus.com/pages/publications/105002585960
U2 - 10.1109/JIOT.2024.3514133
DO - 10.1109/JIOT.2024.3514133
M3 - 文章
AN - SCOPUS:105002585960
SN - 2327-4662
VL - 12
SP - 10987
EP - 10997
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
IS - 8
ER -