During Microsoft Ignite, MediaTek demonstrated the 1st Phi-3.5-mini acceleration powered by edge AI in a smartphone, using the MediaTek Dimensity 9400 flagship chip. Edge AI ensures privacy, quality and security by keeping the data processing entirely on device, without need for Cloud-based service support.
Due to their size, Small Language Models (SLMs) are prime candidates for customizing to meet specific tasks, while being processed entirely on device. The 8th Generation NPU 890 in the Dimenisty 9400 has specific hardware to accelerate SLMs, such as Phi-3.5-mini, bringing new use cases such as writing suggestions, document summarizing and Q&A, and AI agent planning and reasoning.
Sameer Sharma, AVP and GM of the AI IoT BU (Americas & Europe) at MediaTek presented a session at Microsoft Ignite, on how to customize AI to optimize Phi and SLM performance.
Connect with Sameer on LinkedIn.
