Prototype
Capture real-world people, objects, and backgrounds and replace them with virtual characters, objects, and scenes.
Tech: Using DeepMotion to capture human motion, SPIGA to capture facial expressions, AprilTag for object tracking, shooting on LED screen walls, using Unreal Remote and ArUco for virtual camera registration, Meta Human Creator for modeling virtual humans, and Live Link for replacing captured motion and facial expressions.

facial expression capture
© VPX

facial expression capture
© VPX

camera calibration
© VPX

camera calibration
© VPX

facial expression drive
© VPX

human pose
© VPX

human skeleton binding
© VPX

human posture drive
© VPX

human body pose binding
© VPX

LED background cutout
© VPX

human motion drive
© VPX

human motion drive
© VPX

face mesh
© VPX

head model
© VPX

head model
© VPX

body model
© VPX

Video
© VPX

Face Control
© VPX
Action-Driven
© VPX

Demo
© VPX