Real-time 3D video avatar in mixed reality: An implementation for immersive telecommunication

Abstract

This article presents an implementation of a real-time dynamic 3D avatar from multiview cameras for immersive telecommunication. Immersive telecommunication is a new challenging field that enables a user to share a virtual space with remote participants, providing users with a sense of telepresence and interaction. The main objective is to offer rich communication modalities, as similar as those used in face-to-face meetings, like gestures, gaze awareness, realistic images, and correct sound direction. As a result, the user can be immersed and has natural interaction with remote participants. This would overcome the limitations of conventional video-based telecommunication as well as the VR-based collaborative virtual environment approaches.