Three companies share their experience building LLM applications
What happened
On October 6, Computing Life reported on how Carrier, U.S. Bancorp and JLL build applications on large models. All three buy base models from outside vendors and put their engineering into the application and infrastructure layers above the model. The report draws out four lessons: design the architecture so the model can be swapped, set up internal billing and per-task cost attribution, route tasks by user experience and response-time limits, and fold failure rates and stop conditions into project management. The cases come from a roundtable sponsored and edited by Lambda. The article separates enterprise practice from vendor marketing, and notes that Carrier's token bill growing to 8x its previous level is a figure an executive reported about its own company.
Written by AI from the coverage · updated 2 hours ago
Coverage
Follow the reports to see the story from different sides.
- Computing Life · Share · Yage在大模型上构建应用：开利、合众银行和仲量联行的四条实践经验
开利、合众银行和仲量联行均采购外部基座模型，将工程投入集中在模型之上的应用与基础设施。三家公司的实践归纳为四条经验：按可替换模型设计架构、建立内部计费与任务成本归因、按用户体验和响应时限路由任务、将失败率与中止条件纳入项目管理。案例来自 Lambda 赞助并剪辑发布的圆桌讨论，文章区分了企业实践与供应商的商业包装，并提醒开利 token 账单增长至原来 8 倍属于高管自报数字。
Heat over time
Not enough continuous observations to draw a trend yet.