We paired perception and reasoning models on NXP’s i.MX 95 to build a blueprint for agentic AI on embedded devices.
We’ve built a blueprint for agentic AI on the Toradex Verdin iMX95. In our home appliance demo, LFM2.5-VL 450M handles perception and Qwen3-0.6B handles reasoning, with both running across the CPU and NXP’s eIQ Neutron NPU, which we enabled for LLM inference jointly with NXP.
Across six benchmarked 8-bit LLMs, offloading to the NPU makes prefill up to 1.6× faster than running on all 6 CPU cores alone. Or you can keep the speed and free half the CPU: 3 cores plus the NPU match all 6 cores running CPU-only. Both models are swappable, drawn from a validated zoo of 10+ LLMs and VLMs. Torizon adds the long-term maintenance layer to keep the platform secure and updated throughout the product lifecycle.
For device makers, that means an agent that sees and reasons on the device itself, with no cloud round trip, on a platform they can keep secure for years. Today, the stack runs on a custom Yocto-based image; packaging for the Torizon OS container workflow is being finalized.
Read Juan Pisula’s post on running LLMs and VLMs on the Verdin iMX95 (Toradex blog).