Joined Meta (Facebook) in 2018 as a return intern, worked on the following projects:
VR Face Tracking
- Worked on the early prototype of the face tracking technology for Quest Pro.
Avatar Autogen
- Autogen is a technology which automatically generates a recommended avatar for users based on a selfie they uploaded.
- Designed and implemented the model facial attribute prediction and avatar asset matching.
- The project was launched in 07/2021 in FBIOS apps.
- Filed the patent US11217036: Avatar Fidelity and Personalization.
AR Expression Tracking, Tech Lead
- This technology supports several AR effects in FB Messenger and Instagram.
- Filed the patent US11113859: System and Method for Rendering Three Dimensional Face Model Based on Audio Stream and Image Data.
- Further improved the tracking accuracy by switching to the deep expression model.
- The new model that supports the AR Avatar Chat in Messenger currently is in public test stage.