Granite 4.2 LLMs: How They're Built

IBM announced the Granite 4.2 family of reasoning LLMs in three sizes (3B, 8B, 30B), pre-trained from scratch on about 15T tokens, with a context window extended to 512K tokens, supervised fine-tuning on reasoning and agentic data, and released under the Apache 2.0 license.

From the source
Granite 4.2 is our first family of dense, decoder-only reasoning LLMs, released in three sizes: 3B, 8B, and 30B . Each model is pre-trained from scratch on roughly 15T tokens with a five-phase strategy that extends the context window to 512K tokens, supervised fine-tuned on chain-of-thought, reasoning, and agentic-trajectory data, then post-trained with a multi-stage reinforcement learning pipeline .
huggingface.co

Visit source ↗huggingface.co