With the capacity to power enhanced productivity, education, and creativity tools, and sophisticated personalized assistants with complex problem solving, the Microsoft Phi-4 family of models is transforming edge devices into powerhouses of Generative AI.
The Microsoft Phi-4-mini has now been optimized for MediaTek platforms featuring integrated NPUs. These include smartphones, tablets, smart home devices, GenAI gateways, IoT solutions, automotive platforms, and more. MediaTek’s Dimensity GenAI Toolkit 2.0 now supports the Phi-4-mini series, allowing users to convert and quantize Phi-4-mini models in just a few steps for easy deployment. This enables a wide range of “code once, deploy everywhere” opportunities, streamlining development, reducing costs, and accelerating time-to-market.
The SDK integrates with Android and Linux ecosystems and provides complete compiler suites, analyzers, and application libraries to ensure compatibility and optimize performance.
MediaTek’s flagship Dimensity 9400/9400+ platform, combined with the Dimensity GenAI Toolkit 2.0, delivers excellent performance for the Phi-4-mini (3.8B) model, achieving a prefill speed of over 800 tokens per second and a decode speed of more than 21 tokens per second.
