The Culture Funnel: You can’t align what isn’t in the data

Cohere's analysis of LLM training data reveals a 'culture funnel' where cultural diversity narrows from pretraining to post-training, as post-training datasets focus more on technical tasks and lose cultural signals.

The study suggests that scaling multilingual capabilities alone is insufficient for cultural representation, and that training data must be intentionally curated to include broader cultural content.