NTU LogoPVG Logo
All research projects

NRF Fellowship, National Research Foundation

From Pixels to Physics: Integrating Physical Properties in Natural World Creation

National Research Foundation

The grant was awarded on 12/02/2025 (S$ 3,078,720.00), and started on 01/09/2025 and will end on 30/08/2030.

Objectives

The aim of From Pixels to Physics is to create a realistic natural world adhering to physical principles, rather than dealing with only the realistic pixels as in traditional image, video, and 3D synthesis. Physics-based natural world creation is challenging because it requires a holistic interpretation of scenes and objects within it, including but not limited to appearance, geometry, motion, materials, collision, occlusion, gravity, interaction, mass, force and sound.

To achieve the objectives of From Pixels to Physics, the project focuses on the following key objectives:

  • Spatial AI: To develop systems that reconstruct and decompose the complete 3D and 4D scene from a single image or video.
  • Physical AI: Incorporating physical properties into the 3D and 4D scene reconstruction, decomposition and simulation.

    • Selected Results

    ArticraftAgentic system for scalable generation of articulated 3D assets

    Syn4DA large-scale synthetic multiview 4D dataset with dense annotations.

    NOVA3RAmodal 3D reconstruction of visible and occluded regions from sparse views

    Instruct ParticulateFeed-forward articulated structure inference for physically interactive 3D objects

    Publications

    2026