Deployment & engineering

NVIDIA released RTX Spark, a Windows PC for local AI agents with 1 petaflops of AI compute and 128GB of unified memory. OpenShell uses new Windows security primitives with Microsoft, while llama.cpp optimizations raise Qwen 27B throughput by up to 2x.

Nvidia introduced one new PC-focused chip to enter the Windows laptop market and compete with Intel and AMD; the RSS snippet does not disclose specifications, pricing, launch timing, or AI compute metrics.

mudler_it ported NVIDIA Parakeet speech-to-text models to C++/ggml with no Python or PyTorch, reporting byte-for-byte NeMo parity on f32/f16, up to about 5x GPU speedups on larger TDT and hybrid models, and GGUF quantization across f16, q8_0, q6_k, q5_k, and q4_k.

Apple will present Siri and on-device AI upgrades at next month’s WWDC, with iPhones running a smaller Gemini-distilled model locally while complex queries route to Google Cloud using Nvidia confidential computing.

NVIDIA, Microsoft, and Arm posted the same “new era of PC” teaser, and the article says the rumored N1X laptop may use a 20-core Arm CPU, a Blackwell GPU, 6,144 CUDA cores, and 128GB of LPDDR5X unified memory, while bandwidth and x86 translation remain the stated constraints.

The author runs Qwen3.6 27B on a $6,406.45 local server with 4 MI100 GPUs, processing 20.4M input tokens and 1.32M output tokens per day; using OpenRouter prices, the first-year local cost is $2,992.72 versus $3,701.10 for API use.

NVIDIA released DynoSim for optimizing its Dynamo inference serving stack; the Rust-based tool models thousands of deployment configurations on a single virtual timeline and reached 1,500x real-time speed in tests.

The author installed an RTX Pro 6000 Blackwell in a 2016 Dell PowerEdge R730 and claims a 650K-context local AI box; the post describes fan-shroud modification, dual-riser power, PCIe BAR allocation failures, ACPI/DSDT inspection, MMIO aperture work, and Linux PCIe boot-flag testing as required conditions.

SemiAnalysis says xAI dropped JAX GPU and moved to a C training framework written with Grok Build; the snippet claims xAI’s JAX stack had MFU below 10%, but the post does not disclose reproducible benchmark conditions.

Apple’s team published PICO, a perceptual image codec that uses 57%-70% fewer bits than AV1, VVC, and JPEG AI at the same subjective visual quality, while encoding a 12MP photo in 230 ms and decoding it in 150 ms on an iPhone 17 Pro Max.

The author tested MTP on an RTX PRO 6000 Blackwell setup, where Gemma 4 31B on vLLM reached 132.52 tok/s versus a 39.69 tok/s baseline, a 3.34x speedup; the post reports 10 runs of 1,500 tokens each but does not provide a full quality or VRAM evaluation.

OpenAI launched gpt-realtime-translate, a speech translation model that accepts 70+ input languages and outputs speech in 13 target languages; the post says the feature is running on smart glasses.

Axios says Groq is seeking $650 million in internal funding while shifting from hardware toward AI inference, after Nvidia’s reported $20 billion not-acqui-hire; the RSS snippet does not disclose Groq’s valuation, investor names, deal structure, or fundraising timeline.

DeepSeek placed three models in OpenRouter’s monthly top 10 with more than 17 trillion tokens combined, including V4 Flash at 9.13T tokens; the article says Ascend’s MegaMoE operator raised Prefill throughput by 20% to 30% on DeepSeek V3.1 and Qwen3-235B tests.

Liquid AI released LFM2.5-8B-A1B with a 128K context window, 38T pre-training tokens, large-scale reinforcement learning, doubled vocabulary for non-Latin tokenization, and availability on Hugging Face.

TogetherAI and collaborators released OSCAR, a 2.28 BPE INT2 KV Cache system integrated with SGLang, reporting up to 3× decode speedup at 100k context and up to 7× job-level throughput under a fixed memory budget.

FaceMind links low-frequency token degradation to two papers: SLoW appeared at EMNLP 2025, Adam's Law was accepted as an ACL 2026 Oral, and high-frequency rewriting raised DeepSeek-V3 math accuracy from 63.55% to 71.54%.

Samsung Electronics has begun shipping samples of its most advanced memory to customers for AI accelerators from companies including Nvidia; the RSS snippet does not disclose the chip model, customer list, sample volume, pricing, or mass-production timeline.

Apollo and Blackstone are seeking additional investors for about $36 billion in debt financing for Anthropic’s AI infrastructure; the title says the deal would buy Google chips, while the post does not disclose chip models, purchase volume, or timeline.

Apple is trying to integrate a large Gemini model into the iPhone for new Siri features. The RSS snippet says full local processing is unlikely because of model size, and a cloud component is likely required; the post does not disclose parameters, latency targets, or a release timeline.