An element perception and state recognition method oriented to complex assembled product

Quality inspection during assembly process has an important impact on the performance and service life of the final product. Automated inspection solutions based on machine vision and artificial intelligence greatly improve the efficiency of inspection. However, the current mainstream large-scene inspection solutions, such as mobile vision platforms, are difficult to apply widely due to cost issues. Therefore, portable vision inspection solutions have gradually gained attention. However, the bottleneck technologies that limit this solution are full-element perception and occlusion judgment under free viewing angle, robust object matching method. To address the above problems, This paper proposes a free-viewpoint-based element perception and state recognition scheme. An improved structure estimation model is adopted to establish a bridge between virtual and actual mapping under the support of small-sample data, and all elements are located and occlusion analyzed by a 3D model-constrained view evolution algorithm. In addition, a hierarchy matching and optimization method is established to complete visual analysis. Experimental results show that this scheme performs well in structure estimation, element localization, occlusion judgment, state recognition, and work efficiency, demonstrating high application value.