Generate Novel Identities and Controlling Pose and Expression TL;DR: In virtual and augmented reality applications, artists need geometrical control over head pose and facial expressions. In this work — VariTex — we combine explicit 3D geometry with deep image sampling networks in UV space. This allows synthesizing entirely novel identities…

Introduction: Markerless human motion capture is one of the fundamental problems in computer vision. While much impressive progress has been made recently in 2D/3D pose estimation of a single person, these methods can’t be directly extended and applied in a situation when multiple people are interacting with each other closely. Imagine…

AR and VR is a promising computing platform for entertainment, communication, medicine, remote presence and more. An important component of an immersive AR/VR experience is a method to accurately reconstruct the full body pose of the user. While pose estimation from consumer cameras has progressed impressively over recent years, the…

Neural implicit surface representation is a recently emerging representation of 3D shapes. They represent the occupancy or SDF field of the 3D shape with multi-layer perceptrons (MLP). These MLPs take a 3D coordinate as input and outputs the corresponding occupancy or SDF value. …