Tag

Llm Inference

All articles tagged with #llm inference

OpenAI and Broadcom's Jalapeño: First Joint AI Chip for Faster LLM Inference
technology16 days ago

OpenAI and Broadcom's Jalapeño: First Joint AI Chip for Faster LLM Inference

OpenAI and Broadcom unveiled Jalapeño, their first jointly built AI accelerator designed for running OpenAI's large language models with notably better performance per watt; developed in nine months and slated for late-2026 data-center deployment, marking OpenAI's first foray into hardware manufacturing and signaling a multi-generation compute platform to speed and scale AI.