From the source
Meta released Muse Spark Open, an open-weight multimodal mixture-of-experts model with approximately 816 billion total parameters and around 42 billion active per token.
The model accepts text, images, audio, and video as input, generates text, and is optimized for agentic coding tasks such as reading codebases, writing and debugging code, and calling tools.
It has a context window of up to one million tokens and uses a mixture-of-experts architecture with 256 experts, selecting 8 per token.
