AI researcher · currently at Amazon AGI

Reconstructing the world we live in.Reimagining it.Reasoning about it.Understanding it.

Ten years ago I started reconstructing the world — its physical shapes and attributes. Along the way I began reimagining it — taking the measured world as material for creativity. Now I teach machines to reason about it — and measure how far they can go. I do science — to understand the world we live in.

Portrait of Jiaye Wu

About

I’m an Applied Scientist at Amazon AGI, where I work on post-training vision-language models: visual-token compression, synthetic data generation, and LLM evaluation.

I earned my Ph.D. in Computer Science from the University of Maryland, advised by David Jacobs. My research spans reconstruction of shape and physical attributes, and generative models for images, 3D shapes, and video. During my Ph.D., I was an Applied Scientist intern at Amazon Web Services, working on video vision-language models. I was also fortunate to collaborate with Roni Sengupta on inverse rendering.

As an undergraduate at Washington University in St. Louis, I worked with Yasutaka Furukawa on floorplan reconstruction.

Education

Ph.D., Computer Science — University of Maryland, 2019–2025

B.S., Computer Science — Washington University in St. Louis, 2015–2019

Experience.

2025—Now

Amazon AGI

Applied Scientist

  • Developing visual-token compression for a vision-language model, reducing latency by approximately 20% with negligible quality loss.
  • Built failure-guided synthetic data generation that reduced errors on a critical evaluation by 22% relative.
  • Building an evaluation framework for multimodal LLMs, enabling comprehensive evaluation of their capabilities, including parsing, json schema extraction, question answering, and instruction following.
2024

Amazon Web Services

Applied Scientist Intern

  • Developed semantic temporal segmentation for a video vision-language model, decomposing long videos into coherent events and reducing hallucinations.

01

GLOW: Global Illumination-Aware Inverse Rendering of Indoor Scenes Captured with Dynamic Co-Located Light & Camera

Recovering geometry, materials, and lighting of indoor scenes under pronounced global illumination, captured with a moving, co-located light and camera.

  • Inverse rendering
  • 3D vision
  • Lighting

Jiaye Wu, Saeed Hadadan, Geng Lin, Peihan Tu, Matthias Zwicker, David Jacobs, and Roni Sengupta

CVPR ’26
02

Over++: Generative Video Compositing for Layer Interaction Effects

Inserting new content into videos with realistic environmental effects, from shadows to splashes, controllable by artists through text prompts and masks.

  • Generative models
  • Video
  • Compositing

Luchao Qi, Jiaye Wu, Jun Myeong Choi, Cary Phillips, Roni Sengupta, and Dan B. Goldman

arXiv ’25
03

The Aging Multiverse: Generating Condition-Aware Facial Aging Tree via Training-Free Diffusion

Generating branching facial aging trees conditioned on lifestyle factors from a single photo via training-free diffusion.

Bang Gong*, Luchao Qi*, Jiaye Wu, Zhicheng Fu, Chunbo Song, John Nicholson, and Roni Sengupta

SIGGRAPH Asia ’25
04

MyTimeMachine: Personalized Facial Age Transformation

Personalizing facial age transformation by adapting a global aging prior to an individual from a small personal photo collection.

Luchao Qi, Jiaye Wu, Bang Gong, Annie N. Wang, David W. Jacobs, and Roni Sengupta

SIGGRAPH / TOG ’25
05

My3DGen: A Scalable Personalized 3D Generative Model

Generating a personalized 3D face model of an individual from as few as 50 selfies.

Luchao Qi, Jiaye Wu, Annie N. Wang, Shengze Wang, and Roni Sengupta

WACV ’25
06

GaNI: Global and Near Field Illumination Aware Neural Inverse Rendering

Recovering geometry, materials, and lighting of indoor scenes under pronounced global illumination, captured with a moving, co-located light and camera.

Jiaye Wu, Saeed Hadadan, Geng Lin, Matthias Zwicker, David Jacobs, and Roni Sengupta

arXiv ’24
07

Measured Albedo in the Wild: Filling the Gap in Intrinsics Evaluation

A physically measured benchmark that closes a long-standing evaluation gap in intrinsic image decomposition.

  • Data
  • Materials
  • Evaluation

Jiaye Wu, Sanjoy Chowdhury, Hariharmano Shanmugaraja, David Jacobs, and Soumyadip Sengupta

ICCP ’23
08

Shape and Material Capture at Home

Estimating object geometry and reflectance from just a few images captured at home with a camera and flashlight.

Daniel Lichy, Jiaye Wu, Soumyadip Sengupta, and David Jacobs

CVPR ’21
09

Floor-SP: Inverse CAD for Floorplans by Sequential Room-wise Shortest Path

Reconstructing CAD floorplans from RGBD scans room by room via sequential shortest-path optimization.

Jiacheng Chen, Chen Liu, Jiaye Wu, and Yasutaka Furukawa

ICCV ’19
10

Neural Procedural Reconstruction for Residential Buildings

3D reconstruction of residential buildings from aerial LiDAR scans by guiding procedural shape-grammar generation with neural networks.

Huayi Zeng, Jiaye Wu, and Yasutaka Furukawa

ECCV ’18
11

FloorNet: A Unified Framework for Floorplan Reconstruction from 3D Scans

A unified deep framework for vector-graphics floorplan reconstruction from raw 3D scans, recovering room structures and their semantics.

  • 3D reconstruction
  • Floorplans
  • Deep learning

Jiaye Wu*, Chen Liu*, and Yasutaka Furukawa

ECCV ’18
12

A NUMA-Aware Provably-Efficient Task-Parallel Platform Based on the Work-First Principle

Building a NUMA-aware task-parallel runtime that provably retains classic work-stealing guarantees while mitigating work inflation.

Justin Deters, Jiaye Wu, Yifan Xu, and I-Ting Angelina Lee

IISWC ’18

Active in the
research community.

Peer review

50 manuscript reviews across computer vision, graphics, and AI venues.

CVPR (2023–26) · ICCV (2023, 2025) · ECCV (2024, 2026) · WACV (2023, 2025–26) · AAAI (2025) · SIGGRAPH Asia (2024–25) · Eurographics (2026)

Journals: ACM TOG (2025) · IEEE TIP (2023, 2025) · CVIU (2024)

Mentoring & collaboration

  • Luchao Qi (2023–present) — personalized generative models and generative video; four joint publications including ACM TOG (2025) and SIGGRAPH Asia (2025).
  • Haiyang Ying (2025–present) — ongoing generative CAD project.
  • Amazon/AWS Applied Scientist interns (Summer 2026) — Mark Xiao, Liancheng Fang, and Zike Wu.

Get in touch

Let's teach machinesto see & to reason.

I’m always glad to connect about post-training multimodal models, physical intelligence, and creative AI.

jiayewuw@gmail.com