OpenAI unveils its first custom chip, Jalapeño, built by Broadcom
OpenAI unveils its first custom chip, built by Broadcom
OpenAI finally showed its own chip: Jalapeño, an inference processor designed and manufactured with Broadcom. OpenAI says its own models helped design it. Early testing shows much better performance-per-watt than current alternatives. The post doesn't give specific numbers, a production timeline, or which products will use it. I'd discount the hype for now—going from testing to mass deployment usually takes a long time, and it's unclear how much cost this saves versus sticking with NVIDIA.
Why it matters: OpenAI and Broadcom co-designed Jalapeño, an inference-only chip that OpenAI's own models helped design, with early tests showing better performance per watt.