# Apple — Split-and-Scale Latent 3D Representations

- Company: Apple (apple.com)
- Announced: 2026-11-16
- Category: research-paper
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://machinelearning.apple.com/research/split-scale-latent-3d
- Record: https://forck.live/items/37653-split-and-scale-latent-3d-representations
- Subject: Machine Learning Research

Apple researchers propose split-and-scale, a method that expands the latent capacity of 3D shape representations at inference time while keeping training cost tractable. Latent 3D representations encode 3D scenes compactly and support generative models, but the paper says they struggle to capture fine details of complex objects because their latents are capacity-limited. Scaling that capacity during training is computationally expensive and often infeasible under memory limits, and simply adding more latents at inference does not use the added capacity well. The method treats 3D scenes as continuous functions of 3D coordinates, so a single pretrained tokenizer can be applied at inference to arbitrarily small sub-regions, giving the same latent capacity to a smaller spatial extent. The authors ran extensive ablations on the trade-offs between compute, memory, latent capacity and reconstruction quality, and report that their inference-time scaling reaches quality competitive with much larger models that exceed single-GPU memory limits. They also trained an autoregressive 3D generator on the representation, which they say performs competitively with state-of-the-art baselines.

## Evidence

Verbatim from https://machinelearning.apple.com/research/split-scale-latent-3d:

> Authors Dorian Chan, Muhammed Kocabas, Xiaoming Zhao, Oncel Tuzel, Jen-Hao Rick Chang
> 
> Latent 3D representations have significantly expanded the capabilities of modern shape modeling, enabling compact encoding of 3D scenes and supporting powerful 3D generative models. Despite this progress, current representations struggle to capture the fine details of complex objects, fundamentally limited by the capacity of their latents. However, scaling latent capacity at training time is computationally expensive and often infeasible under memory limits, and naively increasing the number of latents at inference fails to make effective use of the added capacity. In this paper, we address both challenges with split-and-scale, a method that effectively expands latent capacity at inference while keeping training cost tractable. Our key observation is that by representing 3D scenes as continuous functions of 3D coordinates, a single pretrained tokenizer can be applied at inference to arbitrarily small sub-regions of a scene, allocating the same latent capacity to a smaller spatial extent and thus capturing far higher detail.

---

Record: https://forck.live/items/37653-split-and-scale-latent-3d-representations
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
