From the source
OpenAI announced Jalapeño, a custom inference chip that offers faster, more power-efficient inference with higher throughput and lower latency for modern models.
Jalapeño’s first results show industry-leading speed and efficiency in AI inference
Infrastructure
From the source
Jalapeño is a custom inference chip from OpenAI that delivers faster, more power-efficient AI inference, with higher throughput and lower latency for modern models.
openai.com