Real-time floating 3D display interaction system based on gesture recognition by leap motion

A real-time floating 3D display interaction system is proposed, which can realize independent interaction of multiple floating 3D images. The proposed system consists of the display and interaction modules. In the display module, 3D images are reconstructed through integral imaging 3D display screen and then floats into the air through the dihedral corner reflector array. In the interaction module, Leap Motion captures positions of hand joints, extracts the gesture information and judges the motive of the users. After checking interaction channels, positions of multiple 3D objects are changed individually, and the 3D film source is rendered, which forms a human-computer interaction closed loop and realizes the real-time floating 3D display interaction. The experimental results demonstrate that the system can reach 30 frame/s under the resolution of 3 840×2 160. The real-time individual interaction of multiple objects can be achieved in the proposed system, and the interaction freedom is increased.