Skip to content

#评测/基准

1 today

May 1Friday

Synced · WeChat

Researchers Estimate GPT, Claude, and Gemini Parameter Counts Using API Calls

Bojie Li posted IKP on arXiv to estimate parameter counts of 188 LLMs from 27 vendors via black-box API calls. The dataset has 1,400 questions across 7 rarity tiers, fitted on 89 open models with R²=0.917. Debate centers on synthetic data, MoE effects, and a 90% interval of 0.3x to 3x.

Why it matters: Bojie Li estimated parameter counts for 188 models from 27 vendors via black-box API calls, fitting to R² 0.917 on 89 known open models first, and the community is split on the conclusions.

r/LocalLLaMA

32x AMD MI50 32GB runs Kimi K2.6 at 9.7 t/s TG and 264 t/s PP

Reddit user ai-infos ran Kimi K2.6 int4 on 32 AMD MI50 32GB GPUs, reaching 9.7 tok/s TG on 136 output tokens. PP hit 263 tok/s on 14,564 input tokens using vllm-gfx906-mobydick across two 16-GPU nodes over 10G Ethernet. Power was about 640W idle and 4,800W peak inference; PCIe bandwidth and the vLLM distributed stack are the real bottlenecks.

Why it matters: A concrete cost-per-token datapoint for anyone weighing used AMD MI50s against new accelerators for self-hosted inference.

r/LocalLLaMA

Follow-up: Qwen3.6-27B on 1× RTX 3090 reaches ~218K context and stable tool calls

A Reddit user ran Qwen3.6-27B on one RTX 3090, reporting ~218K context at 50/66 TPS. After fixing Genesis PN12 patch anchor drift, ~25K-token tool outputs stopped OOMing; 198K plus vision reached 51/68 TPS. Single-prompt single-GPU runs still hit a second memory cliff near 50–60K.

Why it matters: A single 24GB RTX 3090 running Qwen3.6-27B at roughly 218K context and 50 to 66 tokens per second, with tool-call memory overflow fixed.

r/LocalLLaMA

Long-context coding on RTX 5080 16GB: Qwen3.6-35B-A3B holds 30 t/s at 128K

A Reddit user tested a local coding-agent setup on RTX 5080 16GB; the title says Qwen3.6-35B-A3B reaches 30 t/s at 128K. The post lists Ryzen 9700X, 96GB DDR5, Windows 11, and CUDA 12.9.1 as required. Qwen3.6-27B dense hit only 3.2 t/s at 128K, so the key path is KV quantization plus MoE offload.

Why it matters: A 16GB RTX 5080 runs a Qwen3.6-35B-A3B coding agent at 128K context and still holds 30 t/s, with no reported quality drop.

Apr 30Thursday

r/LocalLLaMA

Actual comparison between locally run Qwen-3.6-27B and proprietary models

The author compared 5 model setups on an autoresearch-loop task; only Qwen-3.6-27B via OpenRouter nearly solved it. The local q4_k_m run took about 8 hours and used 39k/45k tokens; full-quality Qwen used 4.4M tokens and cost $0.939. The useful signal is failure quality: both Qwen runs needed small fixes, while Gemma, Codex-Spark, and Claude Haiku 4.5 missed tests or key logic.

Why it matters: A researcher ran an automated research loop comparing a local quantized Qwen-3.6-27B against closed models; only the local one came close, at 39,000 tokens versus 4.4 million for full precision.

Synced · WeChat

Alec Radford tests Hassabis’s AGI challenge with a model trained on pre-1931 data

Alec Radford’s team trained 13B talkie on 260B English tokens dated before 1931. They tested surprise on nearly 5,000 historical events and used HumanEval for lower-contamination code evaluation. The key issue is time leakage: the 13B model still has vague post-WWII knowledge.

Why it matters: Alec Radford's team trained a 13B model on pre-1931 English text and tested its surprise at post-war events across nearly 5,000 historical events, a reference point for data contamination and eval design.

Hacker News front page

Show HN: A New Benchmark for Testing LLMs for Deterministic Outputs

Interfaze released Structured Output Benchmark, scoring schema pass rate, types, and value accuracy across text, image, and audio. Each record has a JSON Schema and human plus LLM-checked ground truth; GLM-4.7 ranks No. 2 overall. The key bug is field-level value error: GPT-5.4 ranks 3rd on text and 9th on images.

Why it matters: Interfaze released the SOB benchmark, testing structured output across 5,000 text items, 209 images and 115 audio clips, checking whether field values are correct rather than just whether the JSON parses.

Apr 29Wednesday

Xinzhiyuan · WeChat

Tsinghua AutoSOTA spends about $104K in a week to produce 105 SOTA results

Tsinghua's Fengli Xu team and Beijing Zhongguancun Academy released AutoSOTA, which ran unattended for one week, used about 22B tokens, and produced 105 SOTA results. The system uses eight agents for resource setup, environment fixes, scheduling, idea generation, and audits; each full run averaged 5 hours. The key check is its red-line audit: it forbids changing evaluation scripts and data splits, which decides reproducibility.

Why it matters: A Tsinghua team's eight-agent AutoSOTA system produced 105 SOTA results in a week, with evaluation scripts and data splits locked to keep results reproducible.

Xinzhiyuan · WeChat

MotuBrain Tops WorldArena and RoboTwin2.0 Rankings

Shengshu MotuBrain scored 63.77 EWM on WorldArena and 95.8/96.1 on RoboTwin2.0 Clean/Randomized. The post says it extends Motus with video-action modeling, Latent Action VAE, MoT, and UniDiffuser for cross-embodiment long tasks. Track reproducibility: it does not disclose training scale, submission details, or real-robot success rates.

Why it matters: Shengshu Technology's MotuBrain topped both WorldArena and RoboTwin2.0 at once, scoring 63.77 EWM on WorldArena and 95.8 and 96.1 on RoboTwin2.0's clean and randomized tests.

r/LocalLLaMA

Qwen3.6 27B on Dual RTX 5060 Ti 16GB with vLLM: ~60 tok/s, 204k Context Working

A user ran Qwen3.6 27B with vLLM on dual RTX 5060 Ti 16GB cards, reaching ~62–66 tok/s at 8K. The setup used 32GB VRAM, TP=2, fp8 KV cache, MTP 3 tokens, and a 204800 context window. The tight part is memory: after a 168k prefill, each GPU used ~15.65GiB with max_num_seqs=1.

Why it matters: A user ran Qwen3.6 27B on two RTX 5060 Ti 16GB cards with vLLM and measured 62–66 tok/s at 8K context, with the exact tensor-parallel, fp8 KV cache and MTP settings listed.

Apr 28Tuesday

Hacker News front page

Xiaomi releases MiMo-v2.5 weights with strong coding and agent benchmarks

Xiaomi released MiMo-v2.5 family weights; the title cites strong coding and agent benchmarks. The RSS body only lists URLs, 13 HN points and 2 comments; the post does not disclose size, license, or scores.

Why it matters: Xiaomi open-sourced MiMo-V2.5-Pro weights, with coding scores close to Claude Opus 4.6, and the summary also mentions passing 233 hidden tests in 4.3 hours on a Peking University compiler assignment.

The Verge · AI

Attack of the Killer Script Kiddies

The Verge discusses Claude Mythos and AI bug finding, citing DARPA AIxCC scans over 54 million code lines. Teams found most seeded flaws plus over a dozen unseeded bugs; the RSS snippet does not disclose Mythos benchmarks, pricing, or access terms.

Why it matters: In DARPA's AI cyber challenge, Anthropic's Claude security test build Mythos scanned 54 million lines of code and found a dozen real bugs beyond the planted ones.

r/LocalLLaMA

Local coding models have reached a threshold for real work

Antigma tested 27B–32B open-weight models; Qwen 3.6-27B scored 38.2% on Terminal-Bench 2.0. The run used 89 tasks and the default per-task timeout, while verified SOTA is about 80%. The key claim is deployment lag: offline coding is about 6–8 months behind hosted frontier models.

Why it matters: Antigma ran several 27B to 32B open models through one agent flow on 89 Terminal-Bench 2.0 tasks, and the best, Qwen 3.6-27B at 38.2%, trails cloud frontier models near 80% by six to eight months.

Hacker News front page

Talkie: a 13B vintage language model from 1930

Nick Levine, David Duvenaud, and Alec Radford released Talkie, a 13B vintage LM trained only on pre-1931 text. The post shows a 24/7 Claude Sonnet 4.6 chat feed and tests surprise on nearly 5,000 NYT historical event descriptions. The key angle is temporal cutoff training as a probe of prediction, bias, and knowledge limits.

Why it matters: Three researchers trained Talkie, a 13B model, on old books published before 1931, then had Claude talk to it for 24 hours straight to probe its knowledge boundaries and values.

Apr 27Monday

Hacker News front page

Show HN: OSS Agent Dirac topped TerminalBench on Gemini-3-flash-preview

Dirac-run released Dirac and says it topped TerminalBench using Gemini-3-flash-preview. The repo claims 50-80% lower API costs via Hash Anchored edits, parallel operations, and AST manipulation; the post does not disclose full scores.

Why it matters: Dirac topped TerminalBench on Gemini-3-flash-preview, claiming hash-anchor localization, parallel operations and direct syntax-tree edits cut API costs to 20 to 50 percent of peers.

Xinzhiyuan · WeChat

First Spatio-Temporal Time-Series Reasoning Framework for LLMs | ACL'26

Emory University, Microsoft, and partners introduced STReasoner for spatio-temporal time-series reasoning, with ST-Bench covering four task types. It uses Network SDE plus Multi-Agent data generation, then Align, SFT+CoT, and S-GRPO training. The article claims inference cost is 0.004× closed models, with code on GitHub.

Why it matters: Emory and Microsoft researchers propose the STReasoner framework with a matching ST-Bench covering forecasting, anomaly detection, causal analysis and QA, showing a transferable pipeline from data generation to reinforcement learning.

QbitAI · WeChat

Stanford-led LLM-as-a-Verifier claims SOTA on Terminal-Bench 2.0

Stanford, Berkeley and Nvidia introduced LLM-as-a-Verifier, claiming SOTA on Terminal-Bench 2.0 and SWE-Bench Verified. It selects trajectories via score-token granularity, repeated checks and criteria decomposition; ForgeCode accuracy reached 86.4%.

Why it matters: Stanford, Berkeley and NVIDIA proposed LLM-as-a-Verifier, which has a model check another model's solution path step by step, and it topped both Terminal-Bench 2.0 and SWE-Bench Verified.

Apr 26Sunday

Hacker News front page

Why SWE-bench Verified No Longer Measures Frontier Coding Capabilities

OpenAI stopped reporting SWE-bench Verified scores and recommends SWE-bench Pro instead. It audited 138 tasks that o3 failed inconsistently across 64 runs and found 59.4% had test or prompt flaws. The key issue is contamination: tested frontier models reproduced some gold patches or task details.

Why it matters: OpenAI audited 138 problems o3 repeatedly failed and found at least 59.4% had overly rigid test cases or vague descriptions, which explains why it retired the benchmark.

Apr 25Saturday

Hacker News front page

TIPSv2: Advancing Vision-Language Pretraining with Enhanced Patch-Text Alignment

Google DeepMind released TIPSv2 with 3 pretraining changes for CVPR 2026. iBOT++ applies self-distillation to masked and visible patches, adding 14.1 mIoU on ADE150; Head-only EMA cuts training parameters by 42%. The key signal is visible-token supervision, not a larger teacher model.

Why it matters: Google DeepMind's TIPSv2 adds self-distillation losses on both masked and visible patches, gaining 14.1 mIoU in zero-shot segmentation and cutting 42% of training parameters with Head-only EMA.

Apr 24Friday

Hacker News front page

Researchers Simulated a Delusional User to Test Chatbot Safety

Researchers at CUNY and King’s College London used one simulated user showing psychosis-spectrum delusions to test 5 LLMs across extended chats. The set included GPT-4o, GPT-5.2, Grok 4.1 Fast, Gemini 3 Pro, and Claude Opus 4.5; the article says Grok and Gemini reinforced delusions more often, while GPT-5.2 and Claude became more cautious over longer conversations. The key point is that multi-turn safety differences were measurable, not just single-prompt behavior.

Why it matters: Researchers at CUNY and King's College London ran long chats between a simulated delusional user and five major models, finding Grok and Gemini more likely to go along with and reinforce unreal beliefs.

TechCrunch · AI

DeepSeek previews new AI model that ‘closes the gap’ with frontier models

DeepSeek previewed two new models and said architectural changes make them more efficient and higher-performing than DeepSeek V3.2, while nearly closing the gap with leading models on reasoning benchmarks. The RSS snippet discloses only that there are two models and that they outperform V3.2; model names, parameter counts, benchmark scores, test sets, and release timing are not disclosed. The key question is reproducible evals, because “closes the gap” comes without numbers.

Why it matters: DeepSeek posted two V4 preview models on Hugging Face, claiming a leaner architecture than V3.2 and higher scores, with parameter counts and benchmark numbers not disclosed.

MIT Technology Review · AI

Health-care AI is here. We don’t know if it actually helps patients.

Jenna Wiens and Anna Goldenberg argue in Nature Medicine that health-care AI is widely deployed, but patient-outcome evidence is thin. A 2025 study found about 65% of US hospitals used AI predictive tools, and only two-thirds assessed accuracy. The key issue is post-deployment impact on clinical decisions.

Why it matters: Two researchers from the University of Michigan and the University of Toronto argue in Nature Medicine that hospitals are deploying AI tools fast without evaluating whether they improve patient outcomes.

Xinzhiyuan · WeChat

Google's Vision Banana aims to unify vision tasks with a single pixel-generation interface

Google DeepMind and collaborators including Kaiming He introduced Vision Banana, claiming one pixel-generation interface can cover detection, segmentation, generation, and editing. The RSS snippet gives two head-to-head numbers versus Nano Banana Pro: 53.5% human win rate on GenAI-Bench and 47.8% on ImgEdit; it says only a small amount of reversible-format task data was mixed in, while data scale and full benchmark tables are not disclosed in the post.

Why it matters: Google DeepMind and Kaiming He's team propose Vision Banana, using pixel generation as a single output to unify detection, segmentation, generation and editing instead of attaching a separate head per task.

X · @Yuchenj_UW

Finally, DeepSeek V4 is here!

DeepSeek announced DeepSeek V4 and says DeepSeek-V4-Pro uses an MIT license with 1.6T parameters and 49B active parameters. The snippet also claims DeepSeek-V4-Pro Max is close to Opus-4.6 Max and GPT-5.4 xHigh across benchmarks; the post does not disclose benchmark names, scores, release timing, or model weights. The key signal is the MIT license and 49B active scale, not the headline comparison.

Why it matters: DeepSeek open-sourced V4 Pro under MIT with 1.6 trillion total parameters and only 49 billion active at inference, setting a new reference for open-model deployment cost.

X · @op7418

DeepSeek V4 detailed official announcement is out

DeepSeek says V4 Pro has 1.6T total parameters with 49B active, while Flash has 284B total and 13B active; both were pretrained on 32T tokens. Web and app Expert mode map to Pro, and Fast mode maps to Flash. The post also says several benchmarks are on par with Opus 4.6, with stronger agent ability and world knowledge, plus a new attention mechanism that reduces compute and memory demand.

Why it matters: DeepSeek disclosed parameter counts and 32 trillion pretraining tokens for both V4 versions, and mapped the web and app Expert and Fast modes to Pro and Flash.

Hacker News front page

GPT-5.5: Mythos-Like Hacking, Open to All

XBOW says GPT-5.5 cut miss rate to 10% on its real-vulnerability benchmark, versus 40% for GPT-5 and 18% for Opus 4.6. It scored 97.5% on visual acuity and used about half the login iterations of the next-best model. The key point is black-box testing: GPT-5.5 without source beat GPT-5 with source.

Why it matters: Security firm XBOW tested GPT-5.5 against a real vulnerability set, and its black-box miss rate fell to 10%, below GPT-5 white-box at 40% and Opus 4.6 at 18%.

Apr 23Thursday

New York Times Chinese

AI so powerful it is called worse than a nuclear bomb: Mythos triggers cyber alarms

Anthropic said it is tightly restricting access to Mythos and named 11 US partners helping patch software flaws the model found. The company said it shared the model with 40+ critical-infrastructure groups, and only the UK has access outside the US; similar cyber-capable models may be released more broadly within 18 months. The real signal is geopolitical control over frontier cyber capability, not a normal model launch.

Why it matters: Anthropic limits its Mythos vulnerability-finding model to 11 US tech firms and 40-plus critical-infrastructure bodies, with the UK the only overseas access so far.

OpenAI News

GPT-5.5 Bio Bug Bounty

OpenAI launched the GPT-5.5 Bio Bug Bounty, offering up to $25,000 for universal jailbreaks that trigger bio safety risks. The RSS snippet confirms a red-teaming challenge; the post does not disclose eligibility, eval protocol, scope, or deadline.

Why it matters: OpenAI is paying up to $25,000 for a single prompt that clears five biosecurity questions at once.

Hacker News front page

Coding Models Are Doing Too Much

The author programmatically corrupts 400 BigCodeBench problems with single-point bugs to test whether coding models over-edit code during fixes. The post defines the minimal fix as exactly reversing the corruption and measures excess changes with token-level Python Levenshtein distance. The provided body does not disclose final results, model rankings, or training gains.

Why it matters: The author plants single-point bugs in 400 BigCodeBench tasks and uses token-level edit distance to measure how much models over-rewrite when fixing bugs, then tries to train them to make minimal edits.

Apr 22Wednesday

Hacker News front page

Show HN submissions tripled and are now mostly vibe-coded

Adrian Krebs scored 500 recent Show HN landing pages and says submissions have tripled, with 67% of pages triggering at least 2 AI design patterns. The method used Playwright plus an in-page script to check DOM and computed styles across 15 deterministic CSS/DOM signals; manual QA found about 5% to 10% false positives. The real signal is not model quality, but fast homogenization from AI default frontend templates.

Why it matters: Adrian Krebs scripted a scan of 500 Show HN landing pages and found 67% hit at least two AI design tells, giving a measured read on how alike AI-generated front ends have become.

Synced · WeChat

Transformer can be converted into Mamba: Apple uses cross-architecture distillation to make inference cost linear

Apple presents a two-stage cross-architecture distillation path that converts Pythia-1B Transformer into a 1B HedgeMamba, reaching 14.11 perplexity with 10B tokens, about 2.7% of the teacher data. The teacher scores 13.86 PPL, while direct Transformer-to-Mamba distillation jumps above 100; the method first aligns with Hedgehog linear attention, then maps into Mamba initialization and fine-tunes. The key point is the path, not one trick: long-context inference shifts from quadratic to linear cost, and the post says downstream results on ARC, PIQA, BoolQ, RACE, and LogiQA approach the teacher.

Why it matters: Apple distilled a trained Pythia-1B into a Mamba architecture in two steps, cutting inference compute from quadratic to linear and giving a reusable path from Transformer to linear attention.

Latent Space

OpenAI launches GPT-Image-2

OpenAI shipped GPT-Image-2 in ChatGPT, Codex, and the API. It has thinking and non-thinking variants, with stronger text, layout, editing, multilingual output, and QR codes. Arena ranks it first on 3 Image Arena boards, with 1512 Elo in text-to-image and a +242 lead.

Why it matters: OpenAI put GPT-Image-2 into ChatGPT, Codex and the API, with better text rendering, layout editing and multilingual output for slides, infographics and UI mockups.

Apr 21Tuesday

QbitAI · WeChat

Mystery model Elephant: 100B parameters reaches same-scale SOTA with high token efficiency

Ant Group's Inclusion AI team is identified as the maker of Elephant, a 100B-parameter model with 256K context and 32K output shown on OpenRouter. The post reports tests on bug fixing, summarizing a 3,000-word meeting note, and a light agent loop, plus AI BENCHY figures of about 2,500 output tokens, about 1 second average latency, and 9.6/10 consistency; the post does not disclose training details, pricing, or an official model card.

Why it matters: Ant Digital's Inclusion AI team put its 10-billion-parameter Elephant model on OpenRouter, and the piece tests it on bug fixes, a 3,000-word meeting summary and a light agent workflow.

Synced · WeChat

Monet: Enabling multimodal LLMs to reason in latent visual space

Monet trains Qwen2.5-VL-7B into Monet-7B to reason with continuous latent visual embeddings instead of external tools; the work is accepted by CVPR 2026 and releases paper, code, model, and a 125K SFT dataset. The method uses three-stage SFT plus VLPO reinforcement learning; the post reports 3% to 9.75% gains on in-distribution tasks and 2.31% on out-of-distribution abstract visual reasoning versus the base model. The key detail is the VLPO mechanism and dataset construction; the post does not disclose one unified table of absolute headline scores.

Why it matters: Monet adapted Qwen2.5-VL-7B to do abstract reasoning in a continuous visual latent space, training in two stages of supervised fine-tuning and VLPO reinforcement learning, gaining 3% to 9.75% on in-distribution tasks.

Synced · WeChat

Anonymous world model MotuBrain tops WorldArena and RoboTwin2.0

MotuBrain ranked first on both WorldArena and RoboTwin2.0, with a 63.77 EWM Score on WorldArena and 95.8/96.1 in RoboTwin Clean and Randomized settings. The post says it also leads Motion Quality, Flow Score, and Motion Smoothness, and averages 96.0 across 50 RoboTwin tasks versus 92.3 for second place; the post does not disclose its owner, model size, or training setup. The result matters because it supports a single-model path that combines world prediction with robot action, at least on benchmarks.

Why it matters: An anonymous model, MotuBrain, tops both WorldArena and RoboTwin2.0, averaging 96.0 across RoboTwin's fifty tasks, 3.7 points above second place.

Hacker News front page

Even 'uncensored' models can't say what they want

Morgin.ai probed 6 pretrains on 4,442 contexts and found that even “uncensored” models sharply deflate charged words, by hundreds to about 16,000x. It calls this effect flinch: no refusal fires, but token probabilities shift; in one example, qwen3.5-9b-base ranks “deportation” #506 at 0.0014%. The key issue is pretraining-level distribution shaping, not only post-training refusals.

Why it matters: Shows that even models stripped of refusal behavior still suppress sensitive-word probabilities by hundreds to roughly 16,000 times.

Apr 20Monday

X · @Yuchenj_UW

Kimi K2.6 is open-source

Kimi K2.6 is now open source, and the RSS snippet says it scored 58.6 on SWE-Bench Pro. The snippet also says it beat GPT-5.4 xhigh and Claude Opus 4.6 max effort. What matters is reproducibility; the post does not disclose weights, license, or eval setup.

Why it matters: Kimi K2.6 is open sourced and scores 58.6 on SWE-Bench Pro for code bug fixing, above GPT-5.4 and Claude Opus 4.6 in the tweet, adding a reference point for open versus closed code ability.

r/LocalLLaMA

Training LoRA adapters for Apple's on-device 3B model on a free Colab T4 and a Mac

The author built a QLoRA pipeline for Apple’s on-device 3B model, cutting training needs from about 24GB to about 1GB RAM and 5GB GPU, enough for a free Colab T4 or a 24GB Mac. The post says A100 LoRA, T4 QLoRA, and Mac QLoRA adapters perform about the same, raising accuracy from about 40% to 75%, or 86% with retrieval; it also reports a confirmed Apple bug that writes a hidden ~160MB cache copy per CLI call, reaching 269GB over ~300 runs.

Why it matters: A walkthrough of fine-tuning Apple's on-device 3B model with QLoRA, cutting memory needs to 1GB RAM plus 5GB VRAM so a free Colab T4 or a 24GB Mac can run it.

r/LocalLLaMA

Compared some models for feature planning

A Reddit user tested 9 models on planning a “load tracking” feature for a Go budgeting app, then used Claude Code to rank the generated specs, with Claude Opus 4.6 placed first. The table shows Opus 4.6 produced a 19 KB spec with 44 code reads at $2.47; GLM 5.1 ranked second and Qwen 3.6 35B fp8+vLLM ranked third. Do not treat this as a benchmark: the author says it is not representative, and the post does not disclose any manual quality review yet.

Why it matters: A Reddit user had nine models design load-tracking for the same Go bookkeeping app, then used Claude Code to score the specs, making their real-task output comparable.

r/LocalLLaMA

Actually put Gemma 4 26B to work on something real: extract trading signals from 2,400 earnings calls

A Reddit user fine-tuned Gemma 4 26B on 800 labeled earnings-call transcripts and ran inference on 2,400 transcripts over 3 years on one RTX 4090 in about 14 hours. On 600 out-of-sample transcripts, one signal linked vaguer CFO guidance to about 1.8% sector-relative underperformance over 5 days with IC 0.04. A stronger signal showed 0.85 correlation with sector returns after checks and was discarded as a ghost factor; the key point is factor sanity checks, not the profit claim.

Why it matters: A Reddit user fine-tuned Gemma 4 26B on 800 labeled earnings calls and ran 2,400 records on one RTX 4090, finding one signal where vaguer CFO guidance tracked about 1.8% underperformance.