Showcase of Holoported Characters (CVPR 2024): Real-time 3D Avatar of Christian Theobalt

VINECS: Video-based Neural Character Skinning. In CVPR, 2024

ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering. In CVPR, 2024

ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesis. In CVPR, 2024.

Egocentric Whole Body Motion Capture with FisheyeViT and Diffusion Based Motion Refinement.

3D Human Pose Perception from Egocentric Stereo Videos, In CVPR, 2024

EventEgo3D 3D Human Motion Capture from Egocentric Event Streams. In CVPR, 2024

Holoported Characters: Real-time Free-viewpoint Rendering of Humans from Sparse RGB Cameras.

ROAM: Robust and Object-aware Motion Generation using Neural Pose Descriptors, 3DV, 2024

SceNeRFlow: Time-Consistent Reconstruction of General Dynamic Scenes, 3DV, 2024

Our Neural Rendering technology applied to The Matrix 4 movie data.

Decaf: Monocular Deformation Capture for Face and Hand Interactions. In SIGGRAPH ASIA, 2023.

NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstruction. In ICCV, 2023.

LiveHand: Real-time and Photorealistic Neural Hand Rendering. In ICCV, 2023.

AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars. In SIGGRAPH ASIA 2023.

HDHumans: A Hybrid Approach for High-fidelity Digital Humans, In SCA, 2023

EgoLocate, In SIGGRAPH 2023.

Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold. SIGGRAPH 2023

General Neural Gauge Fields. In ICLR, 2023

IMoS Intent Driven Full Body Motion Synthesis for Human Object Interactions. In EUROGRAPHICS, 2023.

Scene Aware 3D Multi Human Motion Capture from a Single Camera. In EUROGRAPHICS, 2023

EventNeRF: Neural Radiance Fields from a Single Colour Event Camera. In CVPR, 2023.

MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesis. In CVPR, 2023

Scene-aware Egocentric 3D Human Pose Estimation. In CVPR, 2023.

Estimating Egocentric 3D Human Pose in the Wild with External Weak Supervision. In CVPR, 2022.

φ-SfT: Shape-from-Template with a Physics-Based Deformation Model. In CVPR, 2022.

Advances in Neural Rendering - EUROGRAPHICS 2022 STAR Report

EventHands: Real-Time Neural 3D Hand Pose Estimation from an Event Stream. In ICCV, 2021

Gravity-Aware Monocular 3D Human-Object Reconstruction. In ICCV, 2021

High-Fidelity Neural Human Motion Transfer from Monocular Video. In CVPR, 2021