# OpenAI — Extracting Concepts from GPT-4

- Company: OpenAI (openai.com)
- Announced: 2024-06-06T00:00:00+00:00
- Category: research-paper
- Subject: GPT / ChatGPT / API
- Models affected: GPT-4
- Source: https://openai.com/index/extracting-concepts-from-gpt-4
- Record: https://forck.live/items/751-extracting-concepts-from-gpt-4

OpenAI announces a new technique for scaling sparse autoencoders to identify 16 million patterns in GPT-4's computations.

## Evidence

Verbatim from https://openai.com/index/extracting-concepts-from-gpt-4:

> Using new techniques for scaling sparse autoencoders, we automatically identified 16 million patterns in GPT-4's computations.

---

Record: https://forck.live/items/751-extracting-concepts-from-gpt-4
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md