Face image illumination transfer through eye-relit 3D basis

Face illumination transfer from a single image is still a challenging problem. Most current methods fail when the reference face and the target face differ obviously in pose or facial geometry. In this paper, we propose a face illumination transfer method based on eye-relit 3D basis to conquer this problem. We extract the environment map from one eye of the reference image, preventing the illumination misestimation caused by the reference's pose and facial geometry. By relighting our 3D basis with the map, our transfer result preserves the illumination of the reference image, and the pose and geometry of the target image. Experiments demonstrate our method's good performance in above-mentioned challenging cases.