From the source
The Xet team at Hugging Face is researching and experimenting with techniques to improve Parquet file deduplication on the Hugging Face Hub, including content-defined row groups and relative offsets.
From the source
The Xet team at Hugging Face is working on improving the efficiency of the Hub's storage architecture to make it easier and quicker for users to store and update data and models.
huggingface.co
