ATLAS: Practical scaling laws for multilingual models
Research paper
Google Research introduces ATLAS, new scaling laws for multilingual language models, based on 774 training runs across 10M-8B parameter models and data spanning 400+ languages, providing guidance on optimal model size, data volume, and language mixtures.