Hugging Face Transformers and Ray Tune have integrated to provide a simple yet powerful hyperparameter tuning solution, allowing users to easily access state-of-the-art tuning algorithms like HyperBand, Bayesian Optimization, and Population-Based Training within the Transformers framework.
From the source
In the Transformers 3.1 release, Hugging Face Transformers and Ray Tune teamed up to provide a simple yet powerful integration.
