Spiking neural networks (SNNs) for event-based optical flow are claimed to be computationally more efficient than their artificial neural networks (ANNs) counterparts, but a fair comparison is missing in the literature. In this work, we propose an event-based optical flow solution based on activation sparsification and a neuromorphic processor, SENECA. SENECA has an event-driven processing mechanism that can exploit the sparsity in ANN activations and SNN spikes to accelerate the inference of both types of neural networks. The ANN and the SNN for comparison have similar low activation/spike density (∼5%) thanks to our novel sparsification-aware training. In the hardware-in-loop experiments designed to deduce the average time and energy consumption, the SNN consumes 44.9ms and 927.0μJ, which are 62.5% and 75.2% of the ANN's consumption, respectively. We find that SNN's higher efficiency is attributed to its lower pixel-wise spike density (43.5% vs. 66.5%) that requires fewer memory access operations for neuron states.@en

In this paper, we present SENSIM, which is an open-source simulator designed specifically for the SENECA neuromorphic processor. This simulator is unique in that it combines features from both hardware-specific and hardware-agnostic spiking neural network simulators, resulting in a hybrid event-driven and time-step-driven simulation approach. This allows for flexibility between accuracy and speed during different stages of simulation. Our work highlights the open-source SENSIM platform, which enables the mapping of large-scale SNN/DNN models to the SENECA cores, as well as the benchmarking of crucial KPIs such as power and latency estimations.@en

Designing processors for implantable closed-loop neuromodulation systems presents a formidable challenge owing to the constrained operational environment, which requires low latency and high energy efficacy. Previous benchmarks have provided limited insights into power consumption and latency. However, this study introduces algorithmic metrics that capture the potential and limitations of neural decoders for closed-loop intra-cortical brain-computer interfaces in the context of energy and hardware constraints. This study benchmarks common decoding methods for predicting a primate’s finger kinematics from the motor cortex and explores their suitability for low latency and high energy efficient neural decoding. The study found that ANN-based decoders provide superior decoding accuracy, requiring high latency and many operations to effectively decode neural signals. Spiking neural networks (SNNs) have emerged as a solution, bridging this gap by achieving competitive decoding performance within sub-10 ms while utilizing a fraction of computational resources. These distinctive advantages of neuromorphic SNNs make them highly suitable for the challenging closed-loop neural modulation environment. Their capacity to balance decoding accuracy and operational efficiency offers immense potential in reshaping the landscape of neural decoders, fostering greater understanding, and opening new frontiers in closed-loop intra-cortical human-machine interaction.

@en

Cardiovascular diseases are the leading cause of mortality and early assessment of carotid artery abnormalities with ultrasound is key for effective prevention. Obtaining the carotid diameter waveform is essential for hemodynamic parameter extraction. However, since it is not a trivial task to automate, compact computational models are needed to operate reliably in view of physiological variability. Modern machine learning (ML) techniques hold promise for fully automated carotid diameter extraction from ultrasonic data without requiring annotation by trained clinicians. Using a conventional digital signal processing (DSP) based approach as reference, our goal is to (a) build data-driven ML models to identify and track the carotid diameter, and (b) keep the computational complexity minimal for deployment in embedded systems. A ML pipeline is developed to estimate the carotid artery diameter from Hilbert-transformed ultrasound signals acquired at 500Hz sampling frequency. The proposed ML pipeline consists of 3 processing stages: two neural-network (NN) models and a smoothing filter. The first NN, a compact 3-layer convolutional NN (CNN), is a region-of-interest (ROI) detector confining the tracking to a reduced portion of the ultrasound signal. The second NN, an 8-layer (5 convolutional, 3 fully-connected) CNN, tracks the arterial diameter. It is followed by a smoothing filter for removing any superimposed artifacts. Data was acquired from 6 subjects (4 male, 2 female, 37 ± 7 years, baseline mean arterial pressure 86.3 ± 7.6 mmHg) at rest and with diameter variation induced by paced breathing and a hand grip intervention. The label reference is extracted from a fine-tuned DSP-based approach. After training, diameter waveforms are extracted and compared to the DSP reference. The predicted diameter waveform from the proposed NN-based pipeline has near perfect temporal alignment with the reference signal and does not suffer from drift. Specifically, we obtain a Pearson correlation coefficient of r = 0.87 between prediction and reference waveforms. The mean absolute deviation of the arterial diameter prediction was quantified as 0.077 mm, corresponding to a 1% error given an average carotid artery diameter of 7.5 mm in the study population. This work proposed and evaluated an ML neural network-based pipeline to track the carotid artery diameter from an ultrasound stream of A-mode frames. By contrast to current clinical practice, the proposed solution does not rely on specialist intervention (e.g. imaging markers) to track the arterial diameter. In contrast to conventional DSP-based counterpart solutions, the ML-based approach does not require handcrafted heuristics and manual fine-tuning to produce reliable estimates. Being trainable from small cohort data and reasonably fast, it is useful for quick deployment and easy to adjust accounting for demographic variability. Finally, its reliance on A-mode ultrasound frames renders the solution promising for miniaturization and deployment in on-line clinical and ambulatory monitoring.@en