Hugging Face· PlatformStory of the weekDeveloper tool

Transformers backend integration in SGLang

SGLang now supports Hugging Face Transformers as a backend, allowing any Transformers-compatible model to run with high-performance inference out of the box, with automatic fallback when a model is not natively supported.

From the source

SGLang now supports Hugging Face transformers as a backend, letting you run any transformers-compatible model with high-performance inference out of the box.

huggingface.co