Codec Avatars
Codec Avatars is a technology for metric telepresence that enables immersive social presence indistinguishable from reality.
What are Codec Avatars?
Codec Avatars allow people in different places to interact using eye contact, subtle shifts in expression, posture and gesture. This fully embodied interaction enables natural and expressive remote communication.
Why open source?
The Codec Avatars lab at Meta Reality Labs Research has been building the future of connection with lifelike avatars since 2015, and has shared many of its results and methods with the research community.
Through this site, Meta Reality Labs Research provides the research community with datasets and baseline reference implementations for Codec Avatars, supporting the advancement of metric telepresence research. Using the code and models we share, researchers are empowered to investigate open challenges in metric telepresence including:
- Generalization of universal priors to new identities
- Online encoder adaptation
- Improving quality for clothing and hair
Research
Goliath-4 dataset
First complete captures of full bodies, hands and faces.
Other OSS publications and releases