Cohere· CommandResearch paper

The Culture Funnel: You can’t align what isn’t in the data

Cohere's analysis of LLM training data reveals a 'culture funnel' where cultural diversity narrows from pretraining to post-training, as post-training datasets focus more on technical tasks and lose cultural signals. The study suggests that scaling multilingual capabilities alone is insufficient for cultural representation, and that training data must be intentionally curated to include broader cultural content.

From the source

we found a consistent pattern: cultural diversity narrows as data moves from pretraining into post-training. We call this phenomenon the culture funnel.

cohere.com

Announced

19 Aug 2026 00:00 UTC

Detected

21 Aug 2026 08:16 UTC (+2d after)