From the source
Apple researchers propose Trajectory-Shaped Discrete Flow Matching (TS-DFM), a method that improves few-step discrete flow matching by using a lightweight energy compass to guide token selection during training.
- On a 170M-parameter language model, the 8-step student achieves 32% lower perplexity than the 1,024-step teacher while being 128× faster.