OpenAI and Broadcom unveil Jalapeño, a data-center chip for scalable LLM inference
TL;DR
OpenAI and Broadcom introduced Jalapeño, a purpose-built ASIC designed from scratch for large-language-model inference in data centers, with early testing claiming substantially better performance per watt; development took nine months and is part of a broader effort to own more of the AI stack and reduce reliance on Nvidia, with deployments planned by year-end as the silicon race heats up.
- OpenAI and Broadcom announce chip designed for LLM inference at scale Ars Technica
- OpenAI and Broadcom unveil LLM-optimized inference chip OpenAI
- OpenAI unveils first chip as part of Broadcom deal in effort to 'build the full stack' CNBC
- OpenAI just announced its first custom chip to help ChatGPT run better CNN
- OpenAI tests homegrown AI chips Axios
Want the full story? Read the original reporting
Read on Ars Technica