TY - GEN
T1 - A framework of automatic testing of image processing applications
AU - Jameel, Tahir
AU - Mengxiang, Lin
AU - Chao, Liu
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2016/3/9
Y1 - 2016/3/9
N2 - Image processing applications are playing indispensable role in the modern life. These applications are required to be reliable due to their significance and human dependence. However, testing of these applications is very challenging due to complex nature of images also carrying visual semantics. Currently, the testing of these applications is performed manually, carried out by selecting some standard test images to exercise the implementation under test and their output images are evaluated by a human oracle. Manual selection, execution and evaluation of images have some limitations such as, a tedious job, selection of appropriate test images, unavailability of a domain expert, different expert levels of the evaluators, limited number of test cases, coverage evaluation etc. The increasing complexity of image processing applications and limitations of manual testing has elicited the requirement of automatic testing of image processing applications. In this paper, we have proposed a fully automatic framework to test image processing applications which includes generation of test images, execution of generated test cases and correctness evaluation of output images. In our previous work, we proposed a novel image generation technique based on symbolic evaluation of program under test and also proposed two schemes to address test oracle problem, using metamorphic testing and support vector machines. The proposed framework integrates test image generation, tests execution, effectiveness measurement of test cases, stopping criteria and output evaluation. We demonstrated our approach by experiments and the preliminary results show that the proposed framework is useful to eliminate tedious manual work and enables more effective testing with automatic input generation and output evaluation.
AB - Image processing applications are playing indispensable role in the modern life. These applications are required to be reliable due to their significance and human dependence. However, testing of these applications is very challenging due to complex nature of images also carrying visual semantics. Currently, the testing of these applications is performed manually, carried out by selecting some standard test images to exercise the implementation under test and their output images are evaluated by a human oracle. Manual selection, execution and evaluation of images have some limitations such as, a tedious job, selection of appropriate test images, unavailability of a domain expert, different expert levels of the evaluators, limited number of test cases, coverage evaluation etc. The increasing complexity of image processing applications and limitations of manual testing has elicited the requirement of automatic testing of image processing applications. In this paper, we have proposed a fully automatic framework to test image processing applications which includes generation of test images, execution of generated test cases and correctness evaluation of output images. In our previous work, we proposed a novel image generation technique based on symbolic evaluation of program under test and also proposed two schemes to address test oracle problem, using metamorphic testing and support vector machines. The proposed framework integrates test image generation, tests execution, effectiveness measurement of test cases, stopping criteria and output evaluation. We demonstrated our approach by experiments and the preliminary results show that the proposed framework is useful to eliminate tedious manual work and enables more effective testing with automatic input generation and output evaluation.
KW - Automatic Testing
KW - Metamorphic Testing
KW - Symbolic Execution
KW - Test Image Generation
KW - Test Oracles
UR - https://www.scopus.com/pages/publications/84978153458
U2 - 10.1109/IBCAST.2016.7429896
DO - 10.1109/IBCAST.2016.7429896
M3 - 会议稿件
AN - SCOPUS:84978153458
T3 - Proceedings of 2016 13th International Bhurban Conference on Applied Sciences and Technology, IBCAST 2016
SP - 312
EP - 317
BT - Proceedings of 2016 13th International Bhurban Conference on Applied Sciences and Technology, IBCAST 2016
A2 - Zafar-uz-Zaman, Muhammad
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 13th International Bhurban Conference on Applied Sciences and Technology, IBCAST 2016
Y2 - 12 January 2016 through 16 January 2016
ER -