Energy-efficient In-Memory Address Calculation

Energy-efficient In-Memory Address Calculation

Yousefzadeh, Amirreza (Stichting IMEC Nederland)
Stuijt, Jan (Stichting IMEC Nederland)
Hijdra, Martijn (Stichting IMEC Nederland)
Liu, Hsiao-Hsuan (IMEC)
Gebregiorgis, A.B. (TU Delft Computer Engineering)
Singh, A. (TU Delft Computer Engineering)
Hamdioui, S. (TU Delft Quantum & Computer Engineering)
Catthoor, Francky (IMEC)

Quantum & Computer Engineering

2022

Computation-in-Memory (CIM) is an emerging computing paradigm to address memory bottleneck challenges in computer architecture. A CIM unit cannot fully replace a general-purpose processor. Still, it significantly reduces the amount of data transfer between a traditional memory unit and the processor by enriching the transferred information. Data transactions between processor and memory consist of memory access addresses and values. While the main focus in the field of in-memory computing is to apply computations on the content of the memory (values), the importance of CPU-CIM address transactions and calculations for generating the sequence of access addresses for data-dominated applications is generally overlooked. However, the amount of information transactions used for "address"can easily be even more than half of the total transferred bits in many applications. In this article, we propose a circuit to perform the in-memory Address Calculation Accelerator. Our simulation results showed that calculating address sequences inside the memory (instead of the CPU) can significantly reduce the CPU-CIM address transactions and therefore contribute to considerable energy saving, latency, and bus traffic. For a chosen application of guided image filtering, in-memory address calculation results in almost two orders of magnitude reduction in address transactions over the memory bus.

Hardware
Semiconductor memory
Memory and dense storage
Power estimation and optimization
Emerging architectures
In-memory processing
address calculation unit
energy optimization

http://resolver.tudelft.nl/uuid:2c66be20-9343-4b2c-8649-e842ae0391d7

https://doi.org/10.1145/3546071

1544-3566

ACM Transactions on Architecture and Code Optimization, 19 (4), 1-16

Institutional Repository

journal article

© 2022 Amirreza Yousefzadeh, Jan Stuijt, Martijn Hijdra, Hsiao-Hsuan Liu, A.B. Gebregiorgis, A. Singh, S. Hamdioui, Francky Catthoor