TY - JOUR
T1 - Visual Sensor-Based Trajectory Multimodality Prediction via Anchor-Free Query Attention Network
AU - Wang, Ruiping
AU - Cheng, Jun
AU - Yu, Junzhi
N1 - Publisher Copyright:
© 1963-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - As a core component of intelligent surveillance and autonomous driving systems, visual sensor-based trajectory multimodality prediction can significantly improve their perception and decision-making capabilities. Numerous existing trajectory prediction methods are dedicated to enhance prediction performance. However, they still fail to effectively model the complex spatiotemporal interactions among pedestrians and trajectory multimodality. To address the above challenges, this article presents one new trajectory multimodality prediction method via anchor-free query-based attention network, which can more effectively capture spatiotemporal interactions and model trajectory multimodality. First, the initial trajectory proposal module employs target-centered query-based attention to capture complex spatiotemporal interactions and generate multiple trajectory proposals corresponding to the multiple modes of the future trajectory, which allows the model to use different interaction information when decoding trajectory points at different time steps. Second, the novel trajectory refinement module utilizes the learnable trajectory proposals to construct proposal-level interaction mechanisms to refine future trajectories. Experimental results conducted on ETH and UCY datasets demonstrate that the proposed model can provide the state-of-the-art prediction performance.
AB - As a core component of intelligent surveillance and autonomous driving systems, visual sensor-based trajectory multimodality prediction can significantly improve their perception and decision-making capabilities. Numerous existing trajectory prediction methods are dedicated to enhance prediction performance. However, they still fail to effectively model the complex spatiotemporal interactions among pedestrians and trajectory multimodality. To address the above challenges, this article presents one new trajectory multimodality prediction method via anchor-free query-based attention network, which can more effectively capture spatiotemporal interactions and model trajectory multimodality. First, the initial trajectory proposal module employs target-centered query-based attention to capture complex spatiotemporal interactions and generate multiple trajectory proposals corresponding to the multiple modes of the future trajectory, which allows the model to use different interaction information when decoding trajectory points at different time steps. Second, the novel trajectory refinement module utilizes the learnable trajectory proposals to construct proposal-level interaction mechanisms to refine future trajectories. Experimental results conducted on ETH and UCY datasets demonstrate that the proposed model can provide the state-of-the-art prediction performance.
KW - Autonomous driving systems
KW - query-based attention
KW - spatiotemporal interactions
KW - trajectory multimodality
UR - https://www.scopus.com/pages/publications/85210182524
U2 - 10.1109/TIM.2024.3502817
DO - 10.1109/TIM.2024.3502817
M3 - 文章
AN - SCOPUS:85210182524
SN - 0018-9456
VL - 74
JO - IEEE Transactions on Instrumentation and Measurement
JF - IEEE Transactions on Instrumentation and Measurement
M1 - 2506106
ER -