# NVIDIA — Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline

- Company: NVIDIA (nvidia.com)
- Announced: 2026-10-16T01:44:47+00:00
- Category: open-weight-release
- Coverage: not counted
- Announcement: yes
- Group: models
- Source: https://huggingface.co/blog/nvidia/scaling-indic-pretraining
- Record: https://forck.live/items/23239-scaling-indic-pretraining-2-8-trillion-tokens-and-an-open-data-generation
- Open weights: yes
- Models affected: Nemotron-pretraining-Indic-v1

NVIDIA and IIT Madras' AI4Bharat lab introduced Nemotron-pretraining-Indic-v1, a corpus of approximately 2.8 trillion tokens across 22 Indian languages, alongside an open, GPU-accelerated data generation pipeline. The corpus includes native-script data for all 22 languages and romanized text for twelve, covering 34 language-script configurations, and is built from curated English source documents via translation, quality assessment, and repair. The pipeline and data are released openly so developers can reproduce or adapt the workflow for their own needs.

## Evidence

Verbatim from https://huggingface.co/blog/nvidia/scaling-indic-pretraining:

> We're excited to introduce Nemotron-pretraining-Indic-v1 approximately 2.8 trillion tokens across 22 Indian languages , releasing soon alongside the open, GPU-accelerated data generation pipeline used to create it.

---

Record: https://forck.live/items/23239-scaling-indic-pretraining-2-8-trillion-tokens-and-an-open-data-generation
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md