TY - GEN
T1 - Paragraph level multi-perspective context modeling for question generation
AU - Bai, Jun
AU - Rong, Wenge
AU - Xia, Feiyu
AU - Wang, Yanmeng
AU - Ouyang, Yuanxin
AU - Xiong, Zhang
N1 - Publisher Copyright:
© 2021 IEEE
PY - 2021
Y1 - 2021
N2 - Proper understanding of paragraph is essential for question generation task since the semantic interaction is complicated among sentences. How to integrate long text paragraph information into question generation is still a challenge. In this research, we proposed a multi-perspective paragraph context modeling mechanism, which firstly encodes the contextualized representation of input paragraph, and then utilize multi-head self-attention and Rezero network to further enhance paragraph-level feature extraction and context modeling. Finally, attention-based decoder with copy mechanism generates question according to encoded hidden states. Experimental study on widely used SQuAD dataset has shown the proposed method's potential.
AB - Proper understanding of paragraph is essential for question generation task since the semantic interaction is complicated among sentences. How to integrate long text paragraph information into question generation is still a challenge. In this research, we proposed a multi-perspective paragraph context modeling mechanism, which firstly encodes the contextualized representation of input paragraph, and then utilize multi-head self-attention and Rezero network to further enhance paragraph-level feature extraction and context modeling. Finally, attention-based decoder with copy mechanism generates question according to encoded hidden states. Experimental study on widely used SQuAD dataset has shown the proposed method's potential.
KW - Context modeling
KW - Neural question generation
KW - Paragraph level feature
UR - https://www.scopus.com/pages/publications/85115045462
U2 - 10.1109/ICASSP39728.2021.9414933
DO - 10.1109/ICASSP39728.2021.9414933
M3 - 会议稿件
AN - SCOPUS:85115045462
T3 - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
SP - 7418
EP - 7422
BT - 2021 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2021 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2021 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2021
Y2 - 6 June 2021 through 11 June 2021
ER -