Lead story
Models & availability
Latest
Lead story
Models & availability
Latest
Hugging Face's Xet Team migrated the first Model and Dataset repositories from LFS to Xet storage, using content-defined chunking to improve upload/download efficiency. The migration shifted ~6% of the Hub's download traffic onto Xet infrastructure, and the post details the technical components and post-migration challenges.
From the source
Over the past few weeks, Hugging Face’s Xet Team took a major step forward by migrating the first Model and Dataset repositories off LFS and to Xet storage.
huggingface.co