OpenAI· GPT / ChatGPT / APIResearch paper

Extracting Concepts from GPT-4

OpenAI announces a new technique for scaling sparse autoencoders to identify 16 million patterns in GPT-4's computations.

From the source

Using new techniques for scaling sparse autoencoders, we automatically identified 16 million patterns in GPT-4's computations.

openai.com

Announced

06 Jun 2024 00:00 UTC

Detected

03 Aug 2026 21:11 UTC (+788d after)