The first GPU financiers are turning to inference chips in a $400M deal
Why the first GPU financiers are turning to inference chips in a $400 million deal
General Compute, an AI inference cloud startup, landed a $400M loan from Upper90, using inference-specific chips as collateral instead of training GPUs. The money will buy SambaNova silicon to build an inference-only neocloud. The bet: running open-source models on inference chips costs far less than using frontier LLMs. The post doesn't disclose the loan's interest rate or repayment terms.
Why it matters: General Compute, an AI inference cloud, pledged inference chips instead of training GPUs to borrow $400 million from Upper90 and buy SambaNova chips, betting open models can cut inference costs.