TY - GEN
T1 - Human-in-the-Loop Intelligent Testing for Safety-Critical Software
AU - Xue, Wenyao
AU - Wang, Yichen
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - AI-driven intelligent testing has advanced rapidly, enabling automated test-case generation, defect prediction, and risk assessment. However, the absence of explicit integration of human factors into the testing process often leads to the neglect of testers' cognitive attributes and domain expertise, thereby amplifying cognitive biases and exacerbating safety risks. This paper proposes a three-layer Human-in-the-Loop Intelligent Testing (HITL-IT) framework that systematically incorporates human factors into AI-based testing for safety-critical software. The framework consists of a human-factor modeling layer, an AI testing core, and an interactive feedback loop, collectively forming a closed-cycle mechanism of 'suggestion-challenge-refinement-relearning.' In the context of AI test-case generation, this framework is designed to substantially improve both the quality and efficiency of generated cases. Preliminary applications show promising potential for this approach. By embedding explicit human-factor models and closed-loop feedback into the testing workflow, HITL-IT provides a novel and practical paradigm for building more trustworthy, resilient, and safety-critical AI testing systems.
AB - AI-driven intelligent testing has advanced rapidly, enabling automated test-case generation, defect prediction, and risk assessment. However, the absence of explicit integration of human factors into the testing process often leads to the neglect of testers' cognitive attributes and domain expertise, thereby amplifying cognitive biases and exacerbating safety risks. This paper proposes a three-layer Human-in-the-Loop Intelligent Testing (HITL-IT) framework that systematically incorporates human factors into AI-based testing for safety-critical software. The framework consists of a human-factor modeling layer, an AI testing core, and an interactive feedback loop, collectively forming a closed-cycle mechanism of 'suggestion-challenge-refinement-relearning.' In the context of AI test-case generation, this framework is designed to substantially improve both the quality and efficiency of generated cases. Preliminary applications show promising potential for this approach. By embedding explicit human-factor models and closed-loop feedback into the testing workflow, HITL-IT provides a novel and practical paradigm for building more trustworthy, resilient, and safety-critical AI testing systems.
KW - cognitive bias
KW - human factors
KW - human-in-the-loop
KW - intelligent testing
KW - safety-critical software
KW - software reliability
UR - https://www.scopus.com/pages/publications/105030540552
U2 - 10.1109/ISSREW67781.2025.00068
DO - 10.1109/ISSREW67781.2025.00068
M3 - 会议稿件
AN - SCOPUS:105030540552
T3 - Proceedings - 2025 IEEE 36th International Symposium on Software Reliability Engineering Workshops, ISSREW 2025
SP - 171
EP - 172
BT - Proceedings - 2025 IEEE 36th International Symposium on Software Reliability Engineering Workshops, ISSREW 2025
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 36th IEEE International Symposium on Software Reliability Engineering Workshops, ISSREW 2025
Y2 - 21 October 2025 through 24 October 2025
ER -