From the source
Key changes include a modular design, removal of Flax/TensorFlow support in favor of PyTorch, simplification of tokenization (removing Fast/Slow tokenizers), and new tooling for model conversion.
Transformers v5: Simple model definitions powering the AI ecosystem
Hugging Face releases Transformers v5, focusing on simplicity, training, inference, and production.
Story of the weekDeveloper tool
From the source
Today, as we launch v5, Transformers is installed more than 3 million times each day via pip - up from 20,000/day in v4 🤯. Altogether, it has now surpassed 1.2 billion installs!
huggingface.co
