Nguyen T.T. Nguyen

I build photorealistic, animatable digital humans and put them where people can interact with them: on screens, on holographic displays, and on a patient-simulator robot used to train medical and elderly-care staff.

I’m a postdoctoral researcher at the Advanced Intelligent Space Lab, Ritsumeikan University, where I also completed my Ph.D. (2026) as a MEXT scholar. My current work is multi-view 3D Gaussian Splatting: a pipeline that goes from pose-free sparse-view capture to real-time rendering of 4D head avatars. Earlier, I worked on generative facial behavior, teaching avatars how to listen, react, and express pain.

Before research, I spent two years as a backend/AI engineer at VNG Corporation, building ad systems that served millions of requests per second. That background still shapes how I work: I validate methods early on real, noisy data, and I care about whether a model fits the hardware and latency budget it will actually run on.

research at a glance

One pipeline, from capturing a real face to giving it a body.

1. 01 · capture

   Pose-free sparse-view 4D capture

   Calibration-free multi-view reconstruction of animatable 3DGS head avatars. Coarse feed-forward poses are refined with pycolmap and supervise a deformable cross-view point-map network.

   UR '26

   3DGSpycolmapmulti-view geometryPyTorch

2. 02 · track

   Temporally stable 3DMM tracking

   Monocular and multi-view stereo face trackers with learnable camera parameters. They turn in-the-wild video into 3DMM animation datasets with low latency.

   SII '24

   3DMMOpenCVC++

3. 03 · behave

   Generative facial behavior

   Avatars that listen and react to speech and vision. Methods include sparse keyframe motion tokens, FSQ facial tokenizers, and diffusion models that express pain.

   TCSS '25 IROS '25 ★ FG '24 ★ ISR survey

   TransformersdiffusionVQ / FSQ

4. 04 · embody

   Real-time rendering & embodiment

   Custom CUDA kernels speed up 3DGS rendering on a consumer GPU. Avatars stream to Looking Glass holographic displays and drive a robotic shoulder-arm for range-of-motion training in VR.

   ICEIC

   CUDAOpenGLLooking Glass SDKROS 2Unity