Enhanced real-time head pose estimation system for mobile device

Abstract

This article proposes a real-time Head Pose Estimation (HPE) technique designed to be used in mobile devices. The method enables the interaction between the user and mobile devices using the device's inbuilt camera. The proposed technique is composed of different computer vision methods, which were optimized to operate in a restricted environment. The method has three Degrees of Freedom (DOF), roll, yaw and pitch. The HPE is obtained using these movements. Experiments were conducted using 363 videos of 27 different people taken in varied scenarios with changes in illumination and background. The results demonstrate the robustness and efficiency of the proposed method.