TY - JOUR
T1 - A tag based joint extraction model for Chinese medical text
AU - Liu, Xing Yu
AU - Liu, Yu
AU - Wu, Hang Yu
AU - Guan, Qing Quan
N1 - Publisher Copyright:
© 2021
PY - 2021/8
Y1 - 2021/8
N2 - Information extraction in medical field is an important method to structure medical knowledge and discover new knowledge. Traditional methods handle this task in a pipelined manner regarding the entity recognition and relation extraction as two sub-tasks, which, however, neglects the relevance between the two of them. In recent years, the research on the joint extraction model has achieved encouraging results in the general field, yet scholarship focusing on the joint extraction model applied to medical field is insufficient. In this paper, we construct a joint extraction model based on tagging scheme for Chinese medical texts. Firstly, we design a series of pretreatment procedures for Chinese medical data to obtain effective Chinese word sequence. Then, we propose the BIOH12D1D2 tagging scheme to convert the joint extraction task into a tagging problem and to solve the overlapping entity problem. After that, we use the encoder-decoder model to obtain the tag prediction sequence. And in decoding layer, the Bert pre-training model is adopted to extract token features to enhance the feature representation ability of our model. Lastly, the joint extraction model gains a F1 value by 0.7 on CHIP-2020, which increases by 0.364 compared with the baseline.
AB - Information extraction in medical field is an important method to structure medical knowledge and discover new knowledge. Traditional methods handle this task in a pipelined manner regarding the entity recognition and relation extraction as two sub-tasks, which, however, neglects the relevance between the two of them. In recent years, the research on the joint extraction model has achieved encouraging results in the general field, yet scholarship focusing on the joint extraction model applied to medical field is insufficient. In this paper, we construct a joint extraction model based on tagging scheme for Chinese medical texts. Firstly, we design a series of pretreatment procedures for Chinese medical data to obtain effective Chinese word sequence. Then, we propose the BIOH12D1D2 tagging scheme to convert the joint extraction task into a tagging problem and to solve the overlapping entity problem. After that, we use the encoder-decoder model to obtain the tag prediction sequence. And in decoding layer, the Bert pre-training model is adopted to extract token features to enhance the feature representation ability of our model. Lastly, the joint extraction model gains a F1 value by 0.7 on CHIP-2020, which increases by 0.364 compared with the baseline.
KW - Bert
KW - Chinese medical text
KW - Entity and relation extraction
KW - Joint extraction model
KW - Tagging scheme
UR - https://www.scopus.com/pages/publications/85106381493
U2 - 10.1016/j.compbiolchem.2021.107508
DO - 10.1016/j.compbiolchem.2021.107508
M3 - 文章
C2 - 34029829
AN - SCOPUS:85106381493
SN - 1476-9271
VL - 93
JO - Computational Biology and Chemistry
JF - Computational Biology and Chemistry
M1 - 107508
ER -