Accelerating On-Device AI: Arm and Google AI Edge Optimization Practices
加速设备端AI:Arm与Google AI Edge的优化实践
Arm SME2 and Google AI Edge integrate with LiteRT, XNNPACK, and KleidiAI to optimize Stability AI’s stable-audio-open-small, delivering over 2x faster audio generation and 4x lower memory use on Arm-based mobile devices and laptops.
Why it matters: Arm and Google AI Edge use SME2 instructions to put matrix units in the CPU, more than doubling on-device audio model inference speed and cutting memory to a quarter.