OpenAI· GPT / ChatGPT / APIInfrastructure

Jalapeño’s first results show industry-leading speed and efficiency in AI inference

OpenAI announced Jalapeño, a custom inference chip that offers faster, more power-efficient inference with higher throughput and lower latency for modern models.

From the source

Jalapeño is a custom inference chip from OpenAI that delivers faster, more power-efficient AI inference, with higher throughput and lower latency for modern models.

openai.com

Also covered byThe Register,