# Hugging Face — Deploy LLMs with Hugging Face Inference Endpoints

- Company: Hugging Face (huggingface.co)
- Announced: 2023-07-04
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://huggingface.co/blog/inference-endpoints-llm
- Record: https://forck.live/items/2030-deploy-llms-with-hugging-face-inference-endpoints
- Subject: Platform

To deploy open-source LLMs (e.g., Falcon 40B) using Hugging Face Inference Endpoints, including steps for deployment, testing, and streaming responses.

## Evidence

Verbatim from https://huggingface.co/blog/inference-endpoints-llm:

> In this blog post, we will show you how to deploy open-source LLMs to Hugging Face Inference Endpoints, our managed SaaS solution that makes it easy to deploy models.

---

Record: https://forck.live/items/2030-deploy-llms-with-hugging-face-inference-endpoints
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md