Lead story
Models & availability
Latest
Lead story
Models & availability
Latest
Hugging Face is migrating the Hub's storage backend from Git LFS to Xet, a new storage system that scales with AI workloads. The migration uses a Git LFS Bridge for backward compatibility and background content migrations. Over 500,000 repositories holding 20 PB have moved, and more than 1 million users are now using Xet. The team fixed scaling issues after testing with bartowski's repos.
From the source
In January of this year, Hugging Face's Xet Team deployed a new storage backend, and shortly after shifted ~6% of Hub downloads through the infrastructure. ... Today, more than 1 million people on the Hub are using Xet. In May, it became the default on the Hub for new users and organizations.
huggingface.co