Logo image
Back
Hardware-Software Co-Design for On-Chip Learning in AI Systems
Conference proceeding   Open access

Hardware-Software Co-Design for On-Chip Learning in AI Systems

M. L. Varshika, Abhishek Kumar Mishra, Nagarajan Kandasamy, Anup Das and IEEE
2023 28TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC, pp 624-631
01 Jan 2023
DOI: https://doi.org/10.1145/3566097.3568359
url
https://doi.org/10.1145/3566097.3568359View
Published, Version of Record (VoR) Open

Abstract

Automation & Control Systems Computer Science Computer Science, Hardware & Architecture Computer Science, Software Engineering Engineering Engineering, Electrical & Electronic Science & Technology Technology
Spike-based convolutional neural networks (CNNs) are empowered with on-chip learning in their convolution layers, enabling the layer to learn to detect features by combining those extracted in the previous layer. We propose ECHELON, a generalized design template for a tile-based neuromorphic hardware with on-chip learning capabilities. Each tile in ECHELON consists of a neural processing units (NPU) to implement convolution and dense layers of a CNN model, an on-chip learning unit (OLU) to facilitate spike-timing dependent plasticity (STDP) in the convolution layer, and a special function unit (SFU) to implement other CNN functions such as pooling, concatenation, and residual computation. These tile resources are interconnected using a shared bus, which is segmented and configured via the software to facilitate parallel communication inside the tile. Tiles are themselves interconnected using a classical Network-on-Chip (NoC) interconnect. We propose a system software to map CNN models to ECHELON, maximizing the performance. We integrate the hardware design and software optimization within a co-design loop to obtain the hardware and software architectures for a target CNN, satisfying both performance and resource constraints. In this preliminary work, we show the implementation of a tile on a FPGA and some early evaluations. Using 8 STDP-enabled CNN models, we show the potential of our co-design methodology to optimize hardware resources.

Metrics

18 Record Views
9 citations in Web of Science
11 citations in Scopus

Details

InCites Highlights

Data related to this publication, from InCites Benchmarking & Analytics tool:

Web of Science research areas
Automation & Control Systems
Computer Science, Hardware & Architecture
Computer Science, Software Engineering
Engineering, Electrical & Electronic
Logo image