TY - GEN
T1 - Construction of GUI Elements Recognition Model for AI Testing based on Deep Learning
AU - Zhang, Congran
AU - Shi, Tao
AU - Ai, Jun
AU - Tian, Wei
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Nowadays, GUI testing ensures the quality of GUI software. GUI automated testing by recording coordinates and handles has the disadvantages of poor reusability and low portability, which reduces the quality of GUI software testing. Therefore, GUI testing needs a more efficient testing to meet the rapid development of GUI software. AI can make testing more efficient. But the precondition of GUI software testing is to identify the GUI elements. In this context, the present paper studies the intelligent recognition of GUI elements based on deep learning, develops uniform markup rules for GUI elements and creates datasets to train the GUI element recognition model. According to the selected object detection network, the GUI element recognition model is trained, and the results are analyzed and discussed. The results of this project not only provide technical support for GUI intelligent testing, but also provide research objects and data for intelligent system reliability.
AB - Nowadays, GUI testing ensures the quality of GUI software. GUI automated testing by recording coordinates and handles has the disadvantages of poor reusability and low portability, which reduces the quality of GUI software testing. Therefore, GUI testing needs a more efficient testing to meet the rapid development of GUI software. AI can make testing more efficient. But the precondition of GUI software testing is to identify the GUI elements. In this context, the present paper studies the intelligent recognition of GUI elements based on deep learning, develops uniform markup rules for GUI elements and creates datasets to train the GUI element recognition model. According to the selected object detection network, the GUI element recognition model is trained, and the results are analyzed and discussed. The results of this project not only provide technical support for GUI intelligent testing, but also provide research objects and data for intelligent system reliability.
KW - GUI test
KW - YOLOv3
KW - deep learning
KW - object detection
UR - https://www.scopus.com/pages/publications/85123474767
U2 - 10.1109/DSA52907.2021.00075
DO - 10.1109/DSA52907.2021.00075
M3 - 会议稿件
AN - SCOPUS:85123474767
T3 - Proceedings - 2021 8th International Conference on Dependable Systems and Their Applications, DSA 2021
SP - 508
EP - 515
BT - Proceedings - 2021 8th International Conference on Dependable Systems and Their Applications, DSA 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 8th International Conference on Dependable Systems and Their Applications, DSA 2021
Y2 - 11 September 2021 through 12 September 2021
ER -