From the source
Meta released the weights for Muse Spark Open, an 816B-parameter open-weight omnimodal MoE model co-trained with Muse Code for coding agent workflows.
The model has a 1M token context window, uses a compressed MoE block and hybrid global/local attention to reduce inter-GPU traffic and KV cache memory.
It is available on Baseten Model APIs and Dedicated Inference served in NVFP4.




