TY - JOUR
T1 - Correlation Graph Convolutional Network for Pedestrian Attribute Recognition
AU - Fan, Haonan
AU - Hu, Hai Miao
AU - Liu, Shuailing
AU - Lu, Weiqing
AU - Pu, Shiliang
N1 - Publisher Copyright:
© 2020 IEEE.
PY - 2022
Y1 - 2022
N2 - The pedestrian attribute recognition aims at generating the structured description of pedestrian, which plays an important role in surveillance. However, it is difficult to achieve accurate recognition results due to diverse illumination, partial body occlusion and limited resolutions. Therefore, this paper proposes a comprehensive relationship framework for comprehensively describing and utilizing relations among attributes, describing different type of relations in the same dimension, and implementing complex transfers of relations in a GCN manner. This framework is named Correlation Graph Convolutional Network (CGCN). Based on the proposed framework, the feature vectors are built to associate attributes with image features and generate different relation matrices through self-attention among different feature vectors, describing different attribute relations. Then, we conduct multi-layer transfer of attribute relations by means of graph convolution, realizing complex utilization of attribute relations. In addition, the relations among attributes are fully exploited and two types of relations, namely the explicit and implicit relations, are proposed to be integrate into the proposed comprehensive relationship framework. The experimental results on RAP and PETA demonstrate that the recognition performance of the proposed CGCN can obviously outperform the state-of-the-arts, and moreover, the CGCN can achieve a better synergy with different relations.
AB - The pedestrian attribute recognition aims at generating the structured description of pedestrian, which plays an important role in surveillance. However, it is difficult to achieve accurate recognition results due to diverse illumination, partial body occlusion and limited resolutions. Therefore, this paper proposes a comprehensive relationship framework for comprehensively describing and utilizing relations among attributes, describing different type of relations in the same dimension, and implementing complex transfers of relations in a GCN manner. This framework is named Correlation Graph Convolutional Network (CGCN). Based on the proposed framework, the feature vectors are built to associate attributes with image features and generate different relation matrices through self-attention among different feature vectors, describing different attribute relations. Then, we conduct multi-layer transfer of attribute relations by means of graph convolution, realizing complex utilization of attribute relations. In addition, the relations among attributes are fully exploited and two types of relations, namely the explicit and implicit relations, are proposed to be integrate into the proposed comprehensive relationship framework. The experimental results on RAP and PETA demonstrate that the recognition performance of the proposed CGCN can obviously outperform the state-of-the-arts, and moreover, the CGCN can achieve a better synergy with different relations.
KW - Comprehensive relationship Framework
KW - Correlation Graph Convolutional Network
KW - Hierarchical Relation
KW - Inter Relation
KW - Pedestrian Attribute Recognition
KW - Spatial Relation
UR - https://www.scopus.com/pages/publications/85098786557
U2 - 10.1109/TMM.2020.3045286
DO - 10.1109/TMM.2020.3045286
M3 - 文章
AN - SCOPUS:85098786557
SN - 1520-9210
VL - 24
SP - 49
EP - 60
JO - IEEE Transactions on Multimedia
JF - IEEE Transactions on Multimedia
ER -