DB
D.A. Barantiev
info
Please Note
<p>This page displays the records of the person named above and is not linked to a unique person identifier. This record may need to be merged to a profile.</p>
2 records found
1
Towards modeling of Computation-in-Memory аccelerators
Latency estimation of distributed-memory architectures
The growing data demands of industry applications have led to Von Neumann computing systems increasingly facing a performance bottleneck in the compute-memory data path because of the memory wall problem. Computation-in-Memory (CiM) is a novel type of architecture that tries to address this by combining memory storage and computing in one CiM macro device to achieve a more efficient dataflow.
However, CiM-centric systems still require theoretical analysis through the use of analytical modeling due to a broad design space and practical hardware limitations. One unexplored modeling scope is multi-macro accelerators with a distributed-memory architecture, where inter-macro data messages are necessary to combine and redistribute results. In this thesis, we present 3DCLM - a latency model
for end-to-end execution of 3D convolutional layers on multi-macro distributed-memory accelerators. In the absence of a good real-life reference for model validation, we design CIMsim-distributed, an event-based simulator of the target CiM-centric accelerator system, which accounts for local and inter-
macro data movement as well as the effects of traffic congestion. We compare predicted and simulated latencies to assess 3DCLM’s ability to capture how key parameters influence overall execution and the relative importance of compute and data movement stages. The results show that 3DCLM can predict the overall impact of convolution input channels and CiM macro columns, but often fails to represent
the importance of memory movement costs, both absolute and proportional to total execution latency. Consequently, it can be practically useful for constrained Design Space Exploration of CiM-centric systems, and future iterations should extend its model of critical data movement operations. ...
However, CiM-centric systems still require theoretical analysis through the use of analytical modeling due to a broad design space and practical hardware limitations. One unexplored modeling scope is multi-macro accelerators with a distributed-memory architecture, where inter-macro data messages are necessary to combine and redistribute results. In this thesis, we present 3DCLM - a latency model
for end-to-end execution of 3D convolutional layers on multi-macro distributed-memory accelerators. In the absence of a good real-life reference for model validation, we design CIMsim-distributed, an event-based simulator of the target CiM-centric accelerator system, which accounts for local and inter-
macro data movement as well as the effects of traffic congestion. We compare predicted and simulated latencies to assess 3DCLM’s ability to capture how key parameters influence overall execution and the relative importance of compute and data movement stages. The results show that 3DCLM can predict the overall impact of convolution input channels and CiM macro columns, but often fails to represent
the importance of memory movement costs, both absolute and proportional to total execution latency. Consequently, it can be practically useful for constrained Design Space Exploration of CiM-centric systems, and future iterations should extend its model of critical data movement operations. ...
The growing data demands of industry applications have led to Von Neumann computing systems increasingly facing a performance bottleneck in the compute-memory data path because of the memory wall problem. Computation-in-Memory (CiM) is a novel type of architecture that tries to address this by combining memory storage and computing in one CiM macro device to achieve a more efficient dataflow.
However, CiM-centric systems still require theoretical analysis through the use of analytical modeling due to a broad design space and practical hardware limitations. One unexplored modeling scope is multi-macro accelerators with a distributed-memory architecture, where inter-macro data messages are necessary to combine and redistribute results. In this thesis, we present 3DCLM - a latency model
for end-to-end execution of 3D convolutional layers on multi-macro distributed-memory accelerators. In the absence of a good real-life reference for model validation, we design CIMsim-distributed, an event-based simulator of the target CiM-centric accelerator system, which accounts for local and inter-
macro data movement as well as the effects of traffic congestion. We compare predicted and simulated latencies to assess 3DCLM’s ability to capture how key parameters influence overall execution and the relative importance of compute and data movement stages. The results show that 3DCLM can predict the overall impact of convolution input channels and CiM macro columns, but often fails to represent
the importance of memory movement costs, both absolute and proportional to total execution latency. Consequently, it can be practically useful for constrained Design Space Exploration of CiM-centric systems, and future iterations should extend its model of critical data movement operations.
However, CiM-centric systems still require theoretical analysis through the use of analytical modeling due to a broad design space and practical hardware limitations. One unexplored modeling scope is multi-macro accelerators with a distributed-memory architecture, where inter-macro data messages are necessary to combine and redistribute results. In this thesis, we present 3DCLM - a latency model
for end-to-end execution of 3D convolutional layers on multi-macro distributed-memory accelerators. In the absence of a good real-life reference for model validation, we design CIMsim-distributed, an event-based simulator of the target CiM-centric accelerator system, which accounts for local and inter-
macro data movement as well as the effects of traffic congestion. We compare predicted and simulated latencies to assess 3DCLM’s ability to capture how key parameters influence overall execution and the relative importance of compute and data movement stages. The results show that 3DCLM can predict the overall impact of convolution input channels and CiM macro columns, but often fails to represent
the importance of memory movement costs, both absolute and proportional to total execution latency. Consequently, it can be practically useful for constrained Design Space Exploration of CiM-centric systems, and future iterations should extend its model of critical data movement operations.
There is a growing need for touch-free interaction with public utilities such as coffeemakers and vending machines that will help prevent the spread of diseases such as COVID-19. One solution is the integration of embedded gesture recognition systems relying on ambient light. However, existing work so far is found to be inefficient in terms of size, cost and recognisable gestures. This research is part of the development of a smaller and more economical machine learning-powered gesture recognition system using only 3 photodiodes and an Arduino microcontroller. The goal is to design the software for sensor reading, gesture detection and data preprocessing. The resulting receiver samples at 100 Hz, uses an adaptable threshold for identifying gesture endpoints and a mix of FFT,
maximum division and Linear Interpolation for signal processing. It is evaluated in two lighting conditions on two distinct gestures and is found to provide a
good trade-off between simplicity, real-time processing within milliseconds and robustness against environmental changes. This is achieved with a small RAM memory footprint of only 2 KB and independence of classification backend. The existing design
can be further improved in the future through software optimisation and extended environment dynamics support. ...
maximum division and Linear Interpolation for signal processing. It is evaluated in two lighting conditions on two distinct gestures and is found to provide a
good trade-off between simplicity, real-time processing within milliseconds and robustness against environmental changes. This is achieved with a small RAM memory footprint of only 2 KB and independence of classification backend. The existing design
can be further improved in the future through software optimisation and extended environment dynamics support. ...
There is a growing need for touch-free interaction with public utilities such as coffeemakers and vending machines that will help prevent the spread of diseases such as COVID-19. One solution is the integration of embedded gesture recognition systems relying on ambient light. However, existing work so far is found to be inefficient in terms of size, cost and recognisable gestures. This research is part of the development of a smaller and more economical machine learning-powered gesture recognition system using only 3 photodiodes and an Arduino microcontroller. The goal is to design the software for sensor reading, gesture detection and data preprocessing. The resulting receiver samples at 100 Hz, uses an adaptable threshold for identifying gesture endpoints and a mix of FFT,
maximum division and Linear Interpolation for signal processing. It is evaluated in two lighting conditions on two distinct gestures and is found to provide a
good trade-off between simplicity, real-time processing within milliseconds and robustness against environmental changes. This is achieved with a small RAM memory footprint of only 2 KB and independence of classification backend. The existing design
can be further improved in the future through software optimisation and extended environment dynamics support.
maximum division and Linear Interpolation for signal processing. It is evaluated in two lighting conditions on two distinct gestures and is found to provide a
good trade-off between simplicity, real-time processing within milliseconds and robustness against environmental changes. This is achieved with a small RAM memory footprint of only 2 KB and independence of classification backend. The existing design
can be further improved in the future through software optimisation and extended environment dynamics support.