From the source
NVIDIA NIM now supports deploying a broad range of LLMs from
Hugging Face using a single Docker container that automatically selects and optimizes an inference backend (TensorRT-LLM, vLLM, or SGLang).
From the source
NIM now provides a single docker container for deploying a broad range of LLMs supported by leading inference frameworks from NVIDIA and the community including NVIDIA TensorRT-LLM, vLLM and SGLang.
huggingface.co
