跳到主要导航 跳到搜索 跳到主要内容

Research on Data Mining Methods in the Field of Quality Problem Analysis Based on BERT Model

  • Beihang University

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

In the current quality problem analysis work, there are problems such as large amount of data with scattered distribution, isolated data and difficult machine understanding. Most of the current data mining work in the field is based on deep learning models, which is difficult to be integrated into the characteristics of the data in the field. Also, there are still some deficiencies in its accuracy rate and training speed. Therefore, this paper carries out the research of data mining methods in the field of quality problem analysis and incorporates the characteristics of data in the field on the basis of the existing model construction research. Focusing on the named entity recognition task and the relationship extraction task, the data are preprocessed by sequence annotation method to form the data sets of the two tasks. For the first task, a BERT-based recognition method is adopted, where the input is processed by word-level segmentation and the meaning features are learned. For the second task, a method also based on the BERT model is used. The models trained by the two tasks are used to achieve data mining work in the field of quality problem analysis. Comparative analysis by examples shows that the training results based on BERT model are better than those based on LSTM model in both tasks.

源语言英语
主期刊名Data Mining and Big Data - 8th International Conference, DMBD 2023, Proceedings
编辑Ying Tan, Yuhui Shi
出版商Springer Science and Business Media Deutschland GmbH
111-123
页数13
ISBN(印刷版)9789819708369
DOI
出版状态已出版 - 2024
活动8th International Conference on Data Mining and Big Data, DMBD 2023 - Sanya, 中国
期限: 9 12月 202312 12月 2023

出版系列

姓名Communications in Computer and Information Science
2017 CCIS
ISSN(印刷版)1865-0929
ISSN(电子版)1865-0937

会议

会议8th International Conference on Data Mining and Big Data, DMBD 2023
国家/地区中国
Sanya
时期9/12/2312/12/23

指纹

探究 'Research on Data Mining Methods in the Field of Quality Problem Analysis Based on BERT Model' 的科研主题。它们共同构成独一无二的指纹。

引用此