From the source
Hugging Face is using the fastText language identification model to automatically detect and add language metadata to datasets on the Hub that lack it, improving discoverability.
Huggy Lingo: Using Machine Learning to Improve Language Metadata on the Hugging Face Hub
Research paper
From the source
I'm excited to share some early experiments which seek to use machine learning to improve the metadata for datasets hosted on the Hugging Face Hub.
huggingface.co
