# Hugging Face — Introducing the Chatbot Guardrails Arena

- Company: Hugging Face (huggingface.co)
- Announced: 2024-03-21T00:00:00+00:00
- Subject: Platform
- Models affected: gpt3.5-turbo-l106, Gemini-Pro, Llama-2-70b-chat-hf, Mixtral-8x7B-Instruct-v0.1
- Source: https://huggingface.co/blog/arena-lighthouz
- Record: https://forck.live/items/1921-introducing-the-chatbot-guardrails-arena

Hugging Face and Lighthouz AI launch the Chatbot Guardrails Arena, a platform to stress-test LLMs and privacy guardrails by having users try to trick chatbots into revealing sensitive financial information. The arena features 12 guardrailed LLMs, including closed-source and open-source models, and will compile votes into a public leaderboard based on the Elo rating system.

## Evidence

Verbatim from https://huggingface.co/blog/arena-lighthouz:

> Lighthouz AI is therefore launching the Chatbot Guardrails Arena in collaboration with Hugging Face, to stress test LLMs and privacy guardrails in leaking sensitive data.

---

Record: https://forck.live/items/1921-introducing-the-chatbot-guardrails-arena
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md