Title
PetaOps/W edge-AI μ Processors: Myth or reality?
Author
Gomony, Manil Dev (Eindhoven University of Technology)
de Putter, Floran (Eindhoven University of Technology)
Gebregiorgis, A.B. (TU Delft Computer Engineering)
Paulin, Gianna (ETH Zürich)
Mei, Linyan (Katholieke Universiteit Leuven)
Jain, Vikram (Katholieke Universiteit Leuven)
Hamdioui, S. (TU Delft Quantum & Computer Engineering) 
Bishnoi, R.K. (TU Delft Computer Engineering)
Sanchez, Victor (Eindhoven University of Technology)
Department
Quantum & Computer Engineering
Date
2023
Abstract
With the rise of deep learning (DL), our world braces for artificial intelligence (AI) in every edge device, creating an urgent need for edge-AI SoCs. This SoC hardware needs to support high throughput, reliable and secure AI processing at ultra-low power (ULP), with a very short time to market. With its strong legacy in edge solutions and open processing platforms, the EU is well-positioned to become a leader in this SoC market. However, this requires AI edge processing to become at least 100 times more energy-efficient, while offering sufficient flexibility and scalability to deal with AI as a fast-moving target. Since the design space of these complex SoCs is huge, advanced tooling is needed to make their design tractable. The CONVOLVE project (currently in Inital stage) addresses these roadblocks. It takes a holistic approach with innovations at all levels of the design hierarchy. Starting with an overview of SOTA DL processing support and our project methodology, this paper presents 8 important design choices largely impacting the energy efficiency and flexibility of DL hardware. Finding good solutions is key to making smart-edge computing a reality.
Subject
ULP
dynamic DL
edge-AI
SoC
memristor
approximate computing
DSE
compiler stack
To reference this document use:
http://resolver.tudelft.nl/uuid:fd2a2867-7b58-4ded-8628-75b7e54514cf
DOI
https://doi.org/10.23919/DATE56975.2023.10136926
Publisher
IEEE, Piscataway
Embargo date
2023-12-02
ISBN
979-8-3503-9624-9
Source
Proceedings of the 2023 Design, Automation & Test in Europe Conference & Exhibition (DATE)
Event
DATE 2023, 2023-04-17 → 2023-04-19, Antwerp, Belgium
Bibliographical note
Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.
Part of collection
Institutional Repository
Document type
conference paper
Rights
© 2023 Manil Dev Gomony, Floran de Putter, A.B. Gebregiorgis, Gianna Paulin, Linyan Mei, Vikram Jain, S. Hamdioui, R.K. Bishnoi, Victor Sanchez, More Authors