TY - JOUR
T1 - Occluded Multi-Human Target Segmentation in Dynamic Indoor Scenes Based on Thermopile Array Sensor
AU - Yang, Mengni
AU - Yang, Bo
AU - Shi, Haoxiang
N1 - Publisher Copyright:
© 2001-2012 IEEE.
PY - 2024/4/1
Y1 - 2024/4/1
N2 - Low-resolution thermopile infrared array sensor (TPAS) has gained increasing attention for real-time perception and monitoring of indoor human targets. Most recent researches focus on single individual just because of its low resolution of TPAS. In addition, there are many dynamically changing heat sources besides human targets in indoor environments. The dynamic background removal and occluded human instances' distinction encounter significant challenges in low resolution based on TPAS. To address the interference of dynamic heat sources in multiperson indoor scenarios, this article proposes an algorithm called adaptive Gaussian background removal algorithm applying a priori map for multi-human (AGBR-PMM). In addition, to enhance the subsequent human behavior recognition performance, it is necessary to segment occluded human targets after removing indoor heat source interference and extracting all human targets. PANet is used to segment different human regions, particularly the areas with occluded individuals. A combination of these two methods in low-resolution scenes achieves a good segmentation of occluded human instances while eliminating interferences from dynamic indoor scenes. It outperforms AGBR-PMM and PANet alone in terms of accuracy, precision, and F1-score of 97%, 92%, and 94%, respectively. This lays the foundation for subsequent human behavior recognition using low-resolution TPAS.
AB - Low-resolution thermopile infrared array sensor (TPAS) has gained increasing attention for real-time perception and monitoring of indoor human targets. Most recent researches focus on single individual just because of its low resolution of TPAS. In addition, there are many dynamically changing heat sources besides human targets in indoor environments. The dynamic background removal and occluded human instances' distinction encounter significant challenges in low resolution based on TPAS. To address the interference of dynamic heat sources in multiperson indoor scenarios, this article proposes an algorithm called adaptive Gaussian background removal algorithm applying a priori map for multi-human (AGBR-PMM). In addition, to enhance the subsequent human behavior recognition performance, it is necessary to segment occluded human targets after removing indoor heat source interference and extracting all human targets. PANet is used to segment different human regions, particularly the areas with occluded individuals. A combination of these two methods in low-resolution scenes achieves a good segmentation of occluded human instances while eliminating interferences from dynamic indoor scenes. It outperforms AGBR-PMM and PANet alone in terms of accuracy, precision, and F1-score of 97%, 92%, and 94%, respectively. This lays the foundation for subsequent human behavior recognition using low-resolution TPAS.
KW - Dynamic indoor scene
KW - multiple humans
KW - occlusion segmentation
KW - thermopile infrared array sensor (TPAS)
UR - https://www.scopus.com/pages/publications/85187008391
U2 - 10.1109/JSEN.2024.3368412
DO - 10.1109/JSEN.2024.3368412
M3 - 文章
AN - SCOPUS:85187008391
SN - 1530-437X
VL - 24
SP - 9462
EP - 9471
JO - IEEE Sensors Journal
JF - IEEE Sensors Journal
IS - 7
ER -