TY - JOUR
T1 - Accelerating temporal action proposal generation via high performance computing
AU - Wang, Tian
AU - Lei, Shiye
AU - Jiang, Youyou
AU - Chang, Choi
AU - Snoussi, Hichem
AU - Shan, Guangcun
AU - Fu, Yao
N1 - Publisher Copyright:
© 2022, Higher Education Press.
PY - 2022/8
Y1 - 2022/8
N2 - Temporal action proposal generation aims to output the starting and ending times of each potential action for long videos and often suffers from high computation cost. To address the issue, we propose a new temporal convolution network called Multipath Temporal ConvNet (MTCN). In our work, one novel high performance ring parallel architecture based is further introduced into temporal action proposal generation in order to respond to the requirements of large memory occupation and a large number of videos. Remarkably, the total data transmission is reduced by adding a connection between multiple-computing load in the newly developed architecture. Compared to the traditional Parameter Server architecture, our parallel architecture has higher efficiency on temporal action detection tasks with multiple GPUs. We conduct experiments on ActivityNet-1.3 and THUMOS14, where our method outperforms-other state-of-art temporal action detection methods with high recall and high temporal precision. In addition, a time metric is further proposed here to evaluate the speed performancein the distributed training process.
AB - Temporal action proposal generation aims to output the starting and ending times of each potential action for long videos and often suffers from high computation cost. To address the issue, we propose a new temporal convolution network called Multipath Temporal ConvNet (MTCN). In our work, one novel high performance ring parallel architecture based is further introduced into temporal action proposal generation in order to respond to the requirements of large memory occupation and a large number of videos. Remarkably, the total data transmission is reduced by adding a connection between multiple-computing load in the newly developed architecture. Compared to the traditional Parameter Server architecture, our parallel architecture has higher efficiency on temporal action detection tasks with multiple GPUs. We conduct experiments on ActivityNet-1.3 and THUMOS14, where our method outperforms-other state-of-art temporal action detection methods with high recall and high temporal precision. In addition, a time metric is further proposed here to evaluate the speed performancein the distributed training process.
KW - deep learning
KW - temporal action proposal eneration
KW - temporal convolution
UR - https://www.scopus.com/pages/publications/85119530494
U2 - 10.1007/s11704-021-0173-7
DO - 10.1007/s11704-021-0173-7
M3 - 文章
AN - SCOPUS:85119530494
SN - 2095-2228
VL - 16
JO - Frontiers of Computer Science
JF - Frontiers of Computer Science
IS - 4
M1 - 164317
ER -