# Hugging Face — Very Large Language Models and How to Evaluate Them

- Company: Hugging Face (huggingface.co)
- Announced: 2022-10-03
- Category: developer-tool-release
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://huggingface.co/blog/zero-shot-eval-on-the-hub
- Record: https://forck.live/items/2148-very-large-language-models-and-how-to-evaluate-them
- Subject: Platform
- Pricing: We’ve upgraded the AutoTrain infrastructure for this project so that large models can be evaluated for free 🤯!

Hugging Face announces that zero-shot evaluation is now available for any causal language model on the Hub via the Evaluation on the Hub tool, powered by upgraded AutoTrain infrastructure that allows free evaluation of large models.

## Evidence

Verbatim from https://huggingface.co/blog/zero-shot-eval-on-the-hub:

> Now, any causal language model on the Hub can be evaluated in a zero-shot fashion.

---

Record: https://forck.live/items/2148-very-large-language-models-and-how-to-evaluate-them
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md