TY - JOUR
T1 - A Multi-Graph Cross-Attention-Based Region-Aware Feature Fusion Network Using Multi-Template for Brain Disorder Diagnosis
AU - Ma, Yulan
AU - Cui, Weigang
AU - Liu, Jingyu
AU - Guo, Yuzhu
AU - Chen, Huiling
AU - Li, Yang
N1 - Publisher Copyright:
© 1982-2012 IEEE.
PY - 2024/3/1
Y1 - 2024/3/1
N2 - Functional connectivity (FC) networks based on resting-state functional magnetic imaging (rs-fMRI) are reliable and sensitive for brain disorder diagnosis. However, most existing methods are limited by using a single template, which may be insufficient to reveal complex brain connectivities. Furthermore, these methods usually neglect the complementary information between static and dynamic brain networks, and the functional divergence among different brain regions, leading to suboptimal diagnosis performance. To address these limitations, we propose a novel multi-graph cross-Attention based region-Aware feature fusion network (MGCA-RAFFNet) by using multi-Template for brain disorder diagnosis. Specifically, we first employ multi-Template to parcellate the brain space into different regions of interest (ROIs). Then, a multi-graph cross-Attention network (MGCAN), including static and dynamic graph convolutions, is developed to explore the deep features contained in multi-Template data, which can effectively analyze complex interaction patterns of brain networks for each template, and further adopt a dual-view cross-Attention (DVCA) to acquire complementary information. Finally, to efficiently fuse multiple static-dynamic features, we design a region-Aware feature fusion network (RAFFNet), which is beneficial to improve the feature discrimination by considering the underlying relations among static-dynamic features in different brain regions. Our proposed method is evaluated on both public ADNI-2 and ABIDE-I datasets for diagnosing mild cognitive impairment (MCI) and autism spectrum disorder (ASD). Extensive experiments demonstrate that the proposed method outperforms the state-of-The-Art methods. Our source code is available at https://github.com/mylbuaa/MGCA-RAFFNet.
AB - Functional connectivity (FC) networks based on resting-state functional magnetic imaging (rs-fMRI) are reliable and sensitive for brain disorder diagnosis. However, most existing methods are limited by using a single template, which may be insufficient to reveal complex brain connectivities. Furthermore, these methods usually neglect the complementary information between static and dynamic brain networks, and the functional divergence among different brain regions, leading to suboptimal diagnosis performance. To address these limitations, we propose a novel multi-graph cross-Attention based region-Aware feature fusion network (MGCA-RAFFNet) by using multi-Template for brain disorder diagnosis. Specifically, we first employ multi-Template to parcellate the brain space into different regions of interest (ROIs). Then, a multi-graph cross-Attention network (MGCAN), including static and dynamic graph convolutions, is developed to explore the deep features contained in multi-Template data, which can effectively analyze complex interaction patterns of brain networks for each template, and further adopt a dual-view cross-Attention (DVCA) to acquire complementary information. Finally, to efficiently fuse multiple static-dynamic features, we design a region-Aware feature fusion network (RAFFNet), which is beneficial to improve the feature discrimination by considering the underlying relations among static-dynamic features in different brain regions. Our proposed method is evaluated on both public ADNI-2 and ABIDE-I datasets for diagnosing mild cognitive impairment (MCI) and autism spectrum disorder (ASD). Extensive experiments demonstrate that the proposed method outperforms the state-of-The-Art methods. Our source code is available at https://github.com/mylbuaa/MGCA-RAFFNet.
KW - Mild cognitive impairment (MCI)
KW - autism spectrum disorder (ASD)
KW - deep learning
KW - feature fusion
KW - multi-Template
KW - multi-graph cross-Attention
UR - https://www.scopus.com/pages/publications/85176381441
U2 - 10.1109/TMI.2023.3327283
DO - 10.1109/TMI.2023.3327283
M3 - 文章
C2 - 37874702
AN - SCOPUS:85176381441
SN - 0278-0062
VL - 43
SP - 1045
EP - 1059
JO - IEEE Transactions on Medical Imaging
JF - IEEE Transactions on Medical Imaging
IS - 3
ER -