AI for Smartphones

Exceptional AI Growth

Year-on-year APU performance gains are outstripping CPU and GPU advances, all to keep up with the advances in smartphone hardware – faster and larger resolution displays, increasingly large and complex camera systems, faster always-on connectivity, larger caches, bigger storage, more sensors and features than ever – all while sharing a limited power budget in a mobile device.

5th Generation MediaTek APU

MediaTek develops its own Deep Learning Accelerators (DLA), Visual Processing Units (VPU), hardware-based, multi-core scheduler and software development kits (NeuroPilot) that make up the core components of our AI Processing Units (APUs).

Now in its 5th generation design, the new MediaTek APU is specifically designed to address the latest trends by achieving Maximum Effective Performance in AI-multimedia, -gaming, -camera, and social video experiences.

With its capacity to perform INT8, INT16, and FP16 calculations, MediaTek’s APU can work on targeted tasks or together as co-processor such as AI-ISP, AI-GPU and AI-Video, to provide new functions, performance and power-efficiency gains that are ideal for everyday use.

Maximum Effective Performance

Our new APU design considers the complete end-to-end pipeline to maximize efficiency, ensuring the smartphone will not limit performance during extended use, adversely affect battery life, and it also meets the strict power budgets set by device makers.

  • Short burst (snapping an HDR photograph at night with AI-camera enhancements)
  • Thermal constraint (video recording with AI-camera, and high frame rate gaming using AI-GPU enhancements)
  • Power-sensitive (streaming video with AI Super Resolution).

This ensures there’s plenty of power available for the other in-chip processors to work in partnership the APU, giving device makers greater platform flexibility to develop exciting new applications and features.

AI-Camera (MediaTek Imagiq)

Today, smartphone users expect to use their cameras continually, all day, in all conditions, and that requires speed, quality and power-efficiency without compromise. And that’s exactly what we’ve achieved using our 5th generation APU in the Dimensity 9000: using AI-NR is now over 16x faster in the same power envelope than MFNR used previously. This means even while compute-heavy AI-NR + AI-HDR are active, users can now snap HDR pictures twice as fast as previously and capture 4K HDR videos that are more visually accurate than ever, and enjoys unparalleled power efficiency to extend video recording without the phone heating up.

AI-GPU (MediaTek HyperEngine)

AI-GPU adds hybrid processing to reduce the GPU load and/or provide new IQ enhancement features, ensuring the gameplay is fast even while turning up the in-game visuals. HyperEngine 5.0 also introduces the first ray tracing solution using an AI-based post-processing denoiser in Vulkan, on an Android platform.

AI-Super Resolution (AI-SR) is the first Hybrid AI-GPU Super Resolution for Gaming on Android, providing users with both performance and image quality. As a hybrid system, it combines the capability of the GPU and APU together, unlocking GPU resources for more performance or up to 12% effective power-savings, while the AI engine performs intelligent image upscaling to improve perceptible image quality.

AI-Video (MediaTek MiraVision)

AI-HDR Composer (SDR to HDR)

AI-HDR Composer technology uses the APU to intelligently up-convert SDR video to HDR quality in real-time, whether captured from the smartphone camera or streamed via online service. It gives users the full experience of their HDR smartphone display by generating breathtaking visuals and a cinematic experience that is visibly superior.

AI-PQ (Picture Quality)

MediaTek AI-PQ for smartphones works by analyzing the scenes within the video streaming in real-time, and then applying scene-adaptive settings to generate maximum picture quality. The scene detection can recognize common themes such as people, food, landscapes and architecture.

Whereas conventional picture quality settings use a single, fixed setting that compromises the real-time picture quality of the content being watched, MediaTek AI-PQ delivers truer picture quality without compromises.