Skip to main content
← All Tags

On-Device AI

1 article in this category

AI NewsAI InfrastructureOn-Device AI

Google LiteRT NeuroPilot Stack Turns MediaTek Dimensity NPUs into First Class Targets for on Device LLMs

Google’s LiteRT NeuroPilot Accelerator enables running Gemma-3n E2B at over 1600 tokens/second on MediaTek Dimensity 9500 NPUs.

Read more