Summary
Overview
Work History
Education
Skills
Selected Publications
Languages
Timeline
Generic

Shu Liang

Redwood City,CA

Summary

Face Tracking, Face Reconstruction, Avatars, 3D

Overview

6
6
years of professional experience

Work History

Engineering Manager

Meta
Burlingame, CA
09.2024 - Current

Transferred to an EM role. Working on Codec Avatar related projects.

Research Scientist

Meta
Burlingame, CA
07.2018 - 09.2024

Joined Meta (Facebook) in 2018 as a return intern, worked on the following projects:

VR Face Tracking

  • Worked on the early prototype of the face tracking technology for Quest Pro.

Avatar Autogen

  • Autogen is a technology which automatically generates a recommended avatar for users based on a selfie they uploaded.
  • Designed and implemented the model facial attribute prediction and avatar asset matching.
  • The project was launched in 07/2021 in FBIOS apps.
  • Filed the patent US11217036: Avatar Fidelity and Personalization.

AR Expression Tracking, Tech Lead

  • This technology supports several AR effects in FB Messenger and Instagram.
  • Filed the patent US11113859: System and Method for Rendering Three Dimensional Face Model Based on Audio Stream and Image Data.
  • Further improved the tracking accuracy by switching to the deep expression model.
  • The new model that supports the AR Avatar Chat in Messenger currently is in public test stage.

Education

Ph.D. - Computer Science And Engineering

University of Washington
Seattle
06.2018

Bachelor of Science - Electronic Engineering

Tsinghua University
Beijing, China
06.2013

Skills

  • Programming: Python, C/C, Matlab
  • Frameworks/tools: Pytorch, OpenGL, Unreal

Selected Publications

  • S. Liang, X. Huang, X. Meng, K. Chen, L. G. Shapiro, I. Kemelmacher-Shlizerman: Video to fully automatic 3d hair model. ACM Transactions on Graphics (TOG) 37 (6), 1-14.
  • S. Liang, L. G. Shapiro, I. Kemelmacher-Shlizerman: Head Reconstruction from Internet Photos. The 14th European Conference on Computer Vision, Oct, 2016.
  • E. Mercan, I. Atmosukarto, J. Wu, Shu Liang, L.G. Shapiro: Crainofacial Image Analysis, Comprehensive Health Monitoring and Personalized Feedback using Multimedia Data, A. Briassouli and J. Benois-Pineau (Ed.), Springer International, 2015.
  • Shu Liang, Ira Kemelmacher-Shlizerman, Linda G. Shapiro: 3D Face Hallucination from a Single Depth Frame, International Conference on 3D Vision, December, 2014. (Oral Presentation)
  • Shu Liang, Jia Wu, Seth M. Weinberg, Linda G. Shapiro: Improved Detection of Landmarks on 3D Human Face Data, IEEE Engineering in Medicine and Biology Society Annual Conference, July, 2013. (Oral Presentation)

Languages

English
Full Professional
Chinese (Mandarin)
Native/ Bilingual

Timeline

Engineering Manager

Meta
09.2024 - Current

Research Scientist

Meta
07.2018 - 09.2024

Ph.D. - Computer Science And Engineering

University of Washington

Bachelor of Science - Electronic Engineering

Tsinghua University
Shu Liang