ICL Research Profile

Overview

MAGMA-Edge is a fast deep learning (DL) library which aims to become the de facto standard DL framework for running AI applications on commodity edge devices. Edge devices such as the Raspberry Pi, NVIDIA Jetson Nano, or embedded processors from Intel and AMD are widely used in many common applications or appliances. These devices, when equipped with various sensors, provide efficient and economical Internet of Things (IoT) solutions for many common commercial needs and operations, most obviously on the food delivery bot seen around the UTK campus. Unlike traditional IoT devices that exchange data and instructions with a cloud server, the latest generation of edge devices is capable of performing data analytics and providing real-time AI solutions for a spectrum of designated tasks. MAGMA-Edge has been built on a set of fast linear algebra kernels for tensor operations extended from the MAGMA and MagmaDNN libraries.