Introducing the Hugging Face LLM Inference Container for Amazon SageMaker
Hugging Face releases a new LLM Inference Container for Amazon SageMaker, a purpose-built inference container to deploy open-source LLMs in a managed environment, powered by Text Generation Inference (TGI).