Leading the Generative AI
    Technology Revolution

    Generative AI is driving the next wave of innovation in semiconductors.

    As the industry leader in developing high performance and power-efficient system-on-chip products, MediaTek is already bringing the benefits of our powerful, in-house designed AI processors into our diverse product ecosystem.

    We now ship over 2 billion chips in connected devices every year, many of which contain our AI processors, making us one of the world’s leading edge AI suppliers. With our broad market reach, you’ll find our AI technologies in devices at home, in education, in businesses, in mobile, and in vehicles.

    AI_Thumbnail_with_icon
    AI-Banner-Mobile-new
    AI-Banner-Desktop-new

    MediaTek Hybrid AI – Edge and Cloud

    MediaTek is uniquely positioned to drive and support the adoption of Generative AI applications and technologies, whether deployed on the cloud, at the edge in devices, or as a hybrid approach that takes advantage of both the cloud and the edge together.

    Learn more about the importance of Hybrid AI >
    Cloud-Mobile
    Hybrid-AI

    The Comprehensive MediaTek AI Ecosystem

    The MediaTek AI ecosystem includes hardware, development tools, and a software development kit (SDK).

    Software developers have access to comprehensive tools and algorithms, while MediaTek NeuroPilot allows a write-once-deploy-everywhere strategy that simplifies app development across MediaTek’s entire product range.

    Chiplet-Mobile-npu
    AI Ecosystem-1

    The MediaTek NPU: AI Processing Unit

    The MediaTek NPU, or processor dedicated for AI tasks, is as important as the CPU and GPU within our system-on-chips.

    The MediaTek NPU provides a very efficient architecture to implement AI acceleration in edge devices, such as smartphones, tablets, AI+IoT, smart TVs, networking SoCs, and more.

    Using five common neural networks as a benchmark, the average power/performance curves show that MediaTek's Deep Learning Accelerator (DLA) contained with the NPU offers 27x greater power efficiency compared with a typical CPU and 15x greater power efficiency compared with a typical GPU.

    AI Gen new_all Gen NPU

    In 2023, MediaTek launched its 7th generation NPU, which is specifically designed to accelerate generative AI based on transformer models. Its highly flexible design can scale performance with computation units, power use, memory bandwidth, and memory capacity depending on the application requirements, whether it's in a smartphone SoC or part of a data center-grade superchip.

    What makes a MediaTek NPU?

    The MediaTek NPU is a highly scalable multi-core AI processor that can contain both MDLA and MVPU cores in varying quantities, depending on the application requirements.

    APU-Tech-Table-1

    Each MediaTek NPU contains the following:

    • Hardware-based multicore scheduler.
    • A dedicated DMA engine that performs deep layer fusion and data compression to reduce the demand on DRAM bandwidth.
    • Power intelligence and shared memory awareness.
    • MediaTek designed Network on Chip (NoC) for low latency intercore communication.
    NPU-Mobile
    APU-Desktop-1
    MDLA-Desktop-updated

    MediaTek Deep Learning Accelerator (MDLA)

    • High performance, programmable and versatile, with an energy-efficient MAC architecture that can perform data reuse in a wide-range of NN applications.
    • Designed to handle different types of networks, including:
      • (a)   Convolutional Neural Networks
      • (b)   Recurrent Neural Networks
      • (c)   Long Short-Term Memory models and
      • (d)   mobile Bidirectional Encoder Representations from Transformers (BERT)
    • Supports INT4/INT8/INT16, FP16, BF16 and mixed precision to further reduce power consumption.
    • Inter subsystem direction communication with the ISP and DPU (display) minimizes latency and power consumption.
    MDLA-Mobile

    MediaTek Vision Processing Unit (MVPU)

    • General purpose DSP optimized for computer vision (CV) and neural network (NN) applications.
    • Best balance of power and performance for visual processing applications such as photography, videography, and video stream playback.
    MVPU-Mobile
    MVPU-Desktop

    MediaTek NeuroPilot SDK

    MediaTek NeuroPilot is a set of software tools and APIs for customers and developers to optimize their AI-based applications for use on MediaTek SoCs.

    Both local and cloud versions of these tools are available, including pre-trained deep learning models that can further accelerate development. NeuroPilot supports many mainstream AI frameworks including TensorFlow, Caffe, ONNX, and transformers, and it works with both Linux and Android OS. During the post-silicon stage, developers can deploy their trained AI model on their platform to measure the performance directly.

    NeuroPilot

    Efficiency at its core

    NeuroPilot also offers platform aware optimization. With NeuroPilot an application will understand the SoC hardware it operates on, sending the AI-tasks to the most appropriate processing unit, whether it's the CPU, GPU, NPU, or DSP.

    In addition, where necessary, NeuroPilot will even adopt heterogeneous computing to combine the strengths of multiple processing units to provide the best results — for example, using a GPU and NPU together in 3D graphics rendering AI-VRS, AI-HDR, or super resolution upscaling.

    Media Tek Research Logo

    MediaTek Research is a specialized AI research team that includes accomplished researchers with diverse backgrounds in computer science, engineering, mathematics, and physics. Our vision is to push the limits of what is possible in Artificial Intelligence (AI) and Machine Learning (ML), which, we believe, can unlock new opportunities, discoveries, and progress that will shape our future.

    Our Latest Research Papers

    02-Wireless-channel-modelling_437X568
    August 28, 2023

    MediaTek Research: Wireless channel modelling with diffusion models at GLOBECOM

    Learn More
    Mediatek advances card-new
    August 24, 2023

    MediaTek advances generative AI in edge devices with Meta's Llama 2 LLM

    Learn More
    ICML
    June 23, 2023

    Improving generative modelling with Shortest Path Diffusion (ICML paper)

    Learn More
    Rectangle 1
    April 28, 2023

    MediaTek Research launches the world’s first AI LLM in Traditional Chinese

    Learn More
    Rectangle 2
    April 28, 2023

    MediaTek Research: Improving the speed and reliability of AI model training

    Learn More
    Latest update item image 1
    October 25, 2022

    AI breaks into IC design! Deep learning algorithm is showing its power

    Learn More
    Latest update item image 3
    May 5, 2022

    MediaTek Research: Wireless channel modelling with diffusion models at GLOBECOM

    Learn More
    Latest update item image 2
    November 16, 2021

    MediaTek Research opened a brand new office in National Taiwan University

    Learn More
    111
    November 11, 2021

    MediaTek Research has 6 papers accepted at NeurIPS 2021 conference and workshops

    Learn More
    YouTube Facebook Linkedin
    YouTube Facebook Linkedin
    YouTube Facebook Linkedin
    Google Youku