From the source
Apple researchers propose Luce, a 3D representation that unifies geometry and physically based rendering (PBR) materials within a voxelized multimodal Gaussian cloud.
- A rectified-flow transformer generates this representation from a single image, and the latent decodes into relightable PBR Gaussians and an optional textured mesh.
- On the Toys4K benchmark, Luce achieves state-of-the-art single-image-to-3D generation, improving FID by 28% over the strongest baseline.