Using Gemma 4 E4B with LiteRT: about 2.4× faster text generation than Q4 GGUF
Using Gemma 4 E4B with the LiteRT engine - ~2.4x speedup over Q4 GGUF in text generation, image processing roughly the same
The author tested Gemma 4 E4B on an RTX 4060 Ti 16GB, where LiteRT averaged 157.2 tok/s for text generation versus 66.3 tok/s for llama.cpp Q4 GGUF; image captioning on 111 full-resolution images improved only 1.1×, at about 72 seconds versus 80 seconds.
Why it matters: A hands-on RTX 4060 Ti test puts LiteRT text generation at roughly 2.4x llama.cpp Q4 GGUF, with image processing about even.