TY - JOUR
T1 - A time domain compound attention neural network for direction perception with vestibular model verification
AU - Liu, Yixin
AU - Zhang, Zhihao
AU - Wang, Lingling
AU - Fu, Li
AU - Liu, Xiaohong
N1 - Publisher Copyright:
© 2026 Elsevier Ltd. All rights are reserved, including those for text and data mining, AI training, and similar technologies.
PY - 2026/5/5
Y1 - 2026/5/5
N2 - Vestibular perception is essential for human spatial navigation, providing vital information about motion and orientation. However, existing vestibular research overlooks how the brain dynamically interprets self-motion. We present the Time Domain Compound Attention (TDCA) network, a model that decodes directional states from electroencephalography (EEG). TDCA employs multiscale temporal convolutions to capture both transient and sustained neural dynamics. A self-attention module highlights informative spatial-feature representations, while a temporal convolution module integrates them over time. Using a dataset of vestibular direction perception with synchronized EEG and inertial measurement unit (IMU) recordings from 20 participants performing five motion states (left, right, forward, backward, and stationary), TDCA achieved 93.97% accuracy under subject-independent tenfold cross-validation. Beyond its high decoding accuracy, TDCA’s temporal predictions exhibit strong alignment with an IMU-driven vestibular model, providing biophysically grounded, dual-path validation and supporting its physiological plausibility. These findings advance brain-inspired navigation research and demonstrate the feasibility of online brain-computer interfaces under natural vestibular stimulation.
AB - Vestibular perception is essential for human spatial navigation, providing vital information about motion and orientation. However, existing vestibular research overlooks how the brain dynamically interprets self-motion. We present the Time Domain Compound Attention (TDCA) network, a model that decodes directional states from electroencephalography (EEG). TDCA employs multiscale temporal convolutions to capture both transient and sustained neural dynamics. A self-attention module highlights informative spatial-feature representations, while a temporal convolution module integrates them over time. Using a dataset of vestibular direction perception with synchronized EEG and inertial measurement unit (IMU) recordings from 20 participants performing five motion states (left, right, forward, backward, and stationary), TDCA achieved 93.97% accuracy under subject-independent tenfold cross-validation. Beyond its high decoding accuracy, TDCA’s temporal predictions exhibit strong alignment with an IMU-driven vestibular model, providing biophysically grounded, dual-path validation and supporting its physiological plausibility. These findings advance brain-inspired navigation research and demonstrate the feasibility of online brain-computer interfaces under natural vestibular stimulation.
KW - Attention-based
KW - Electroencephalographic (EEG)
KW - Mathematical model
KW - Multi-timescale
KW - Vestibular
UR - https://www.scopus.com/pages/publications/105029674419
U2 - 10.1016/j.eswa.2026.131186
DO - 10.1016/j.eswa.2026.131186
M3 - 文章
AN - SCOPUS:105029674419
SN - 0957-4174
VL - 309
JO - Expert Systems with Applications
JF - Expert Systems with Applications
M1 - 131186
ER -