Two papers accepted at NeurIPS'24
Papers accepted: MVSplat360 and Physical Understanding
Papers accepted: MVSplat360 and Physical Understanding
Papers accepted: MVSplat, DragApart and ClusteringSDF
Papers accepted: Free3D, Amodal in the wild, and OneMoreStep
The Marie Skłodowska-Curie Actions (MSCA) are among Europe's most competitive and prestigious research and innovation fellowships
National Research Foundation, PI
The grant was awarded on 12/02/2025 (S$ 3,078,720.00), and started on 01/09/2025 and will end on 30/08/2030.
The aim of PhysWorld is to create a realistic natural world adhering to physical principles, rather than dealing with only the realistic pixels as in traditional image, video, and 3D synthesis. Physics-based natural world creation is challenging because it requires a holistic interpretation of scenes and objects within it, including but not limited to appearance, geometry, materials, occlusion, motion, gravity, interaction, mass and sound.
Sony Research Award Program, Co-PI, with Andrea Vedaldi
The grant was awarded on 30/03/2025 (), and started on 01/07/2025 and will end on 30/06/2026.
The aim of Vista4D is to obtain photorealistic 4D reconstructions of dynamic scenes from a single monocular video. To achieve this, Vista4D will develop a feed-forward neural network that, given as input a single monocular video, will output directly its 4D reconstruction
MSCA Postdoctoral Fellowship (UKRI Horizon Europe), PI, with Andrea Vedaldi
The grant was awarded on 13/02/2024 (£ 206,085.62), and started on 01/06/2024 and will end on 01/06/2026.
The aim of SYN3D is to enable the effortless creation of novel view synthesis and 3D reconstruction from limited views (from 0 to 5) in a feed-forward manner. In general, such a few input views do not contain sufficient information for compressive 3D synthesis. However, our scientific hypothesis is that 3D synthesis from limited views is still possible by learning, from billion images, the capability of hallucinating unobserved parts of 3D objects/scenes, thus obtaining plausible if not faithful reconstructions.