M.A. Neerincx
Please Note
27 records found
1
Adapting Mamba Models for Deployment on Microcontrollers
Enabling Linear-Time Sequence Modeling on Ultra-Low-Power Tiny Devices
The Mamba architecture, built around State-Space Model, is a promising candidate due to its compact parameterization and strong performance on long-context tasks. Nevertheless, Mamba was originally designed for highly parallelized GPUs, making its adaptation for TinyML non-trivial. This paper evaluates Mamba deployment strategies on microcontrollers using TensorFlow Lite Micro.
We propose architecture modifications and optimization techniques tailored specifically to microcontroller constraints. Our deployment of a quantized Mamba model achieves a 60.4~KB peak RAM footprint on a Keyword Spotting task, a 74\% memory reduction compared to state-of-the-art work (MambaLite-Micro). Furthermore, we analyze the trade-offs of quantization, demonstrating that while it substantially reduces memory, it can introduce latency overhead on hardware lacking acceleration of INT8 operations.
To mitigate code size and loop-unrolling overheads, we introduce a model-splitting technique that enables the execution of larger models. Our findings demonstrate that while Mamba is a viable architecture for TinyML, further research is required to fully optimize State Space Model implementations for edge hardware. ...
The Mamba architecture, built around State-Space Model, is a promising candidate due to its compact parameterization and strong performance on long-context tasks. Nevertheless, Mamba was originally designed for highly parallelized GPUs, making its adaptation for TinyML non-trivial. This paper evaluates Mamba deployment strategies on microcontrollers using TensorFlow Lite Micro.
We propose architecture modifications and optimization techniques tailored specifically to microcontroller constraints. Our deployment of a quantized Mamba model achieves a 60.4~KB peak RAM footprint on a Keyword Spotting task, a 74\% memory reduction compared to state-of-the-art work (MambaLite-Micro). Furthermore, we analyze the trade-offs of quantization, demonstrating that while it substantially reduces memory, it can introduce latency overhead on hardware lacking acceleration of INT8 operations.
To mitigate code size and loop-unrolling overheads, we introduce a model-splitting technique that enables the execution of larger models. Our findings demonstrate that while Mamba is a viable architecture for TinyML, further research is required to fully optimize State Space Model implementations for edge hardware.
Embedded Trustworthy AI for Healthcare
A Multi-Objective Study of Fairness, Privacy, and Efficiency under TinyML Constraints
Structured Degradation in Visible Light Positioning
Modeling and Compensation of Long-Term Degradation in RSS-Based VLP System
The proposed method combines scaling-based compensation for gradual degradation with anomaly detection for sudden degradation events such as broken LEDs. This method is tested through a long-term deployment simulation using the DenseVLC dataset and is also implemented on a Raspberry Pi Pico to assess embedded feasibility. The results show that VLP systems suffer increasing errors over time, while degradation-aware compensation improves long-term robustness. However, embedded deployment introduces accuracy trade-offs due to quantization and memory constraints.
These results show that modeling and compensating for degradation mechanisms is important for reliable long-term VLP deployment, and that compensation methods need to account for both gradual and sudden changes in received signal strength. ...
The proposed method combines scaling-based compensation for gradual degradation with anomaly detection for sudden degradation events such as broken LEDs. This method is tested through a long-term deployment simulation using the DenseVLC dataset and is also implemented on a Raspberry Pi Pico to assess embedded feasibility. The results show that VLP systems suffer increasing errors over time, while degradation-aware compensation improves long-term robustness. However, embedded deployment introduces accuracy trade-offs due to quantization and memory constraints.
These results show that modeling and compensating for degradation mechanisms is important for reliable long-term VLP deployment, and that compensation methods need to account for both gradual and sudden changes in received signal strength.
Exploring the feasibility of short-range VLC schemes in MIMO systems
Otsu Thresholding and Sliding Window Protocols
With radio communication bandwidth becoming increasingly scarce and expensive, researchers have turned toward the light medium, namely the field of Visible Light Communication (VLC). Although the field of Visible Light Communication (VLC) was pioneered in the late 1800s, it faced criticism from scientists of that era, with radio communications being preferred instead. VLC has since regained attention by complementing existing radio communication methods. This research paper focuses on exploring different short-range multiple-input multiple-output (MIMO) screen-to-camera VLC schemes operating solely on the red optical channel. The transmitting screen is a 4×6 LED grid on a prototype board, while the receiver is an off-the-shelf smartphone back camera. The chosen modulation technique is on-off keying (OOK) with Manchester encoding (ME), while demodulation is performed using three different strategies, the first two using Otsu thresholding and the last using a sliding window approach. Our experiments show that, while the modulation scheme achieves a transmission rate of 6 symbols per LED per frame (up to 144 symbols per frame) and a bit error rate (BER) of less than 10⁻¹, the limited resolution and frame rate make it difficult to reliably include important data frame header fields such as the sequence number. ...
With radio communication bandwidth becoming increasingly scarce and expensive, researchers have turned toward the light medium, namely the field of Visible Light Communication (VLC). Although the field of Visible Light Communication (VLC) was pioneered in the late 1800s, it faced criticism from scientists of that era, with radio communications being preferred instead. VLC has since regained attention by complementing existing radio communication methods.
This research paper focuses on exploring different short-range multiple-input multiple-output (MIMO) screen-to-camera VLC schemes operating solely on the red optical channel. The transmitting screen is a 4×6 LED grid on a prototype board, while the receiver is an off-the-shelf smartphone back camera. The chosen modulation technique is on-off keying (OOK) with Manchester encoding (ME), while demodulation is performed using three different strategies, the first two using Otsu thresholding and the last using a sliding window approach.
Our experiments show that, while the modulation scheme achieves a transmission rate of 6 symbols per LED per frame (up to 144 symbols per frame) and a bit error rate (BER) of less than 10⁻¹, the limited resolution and frame rate make it difficult to reliably include important data frame header fields such as the sequence number.
Put words into action
Exploring the Effect of Authority Change as a Trust Repair Strategy in Human-Agent Teams
We conducted the experiment with thirty participants divided into a two groups with differing trust repair strategies (promise only, promise with the authority change) and measured trust perception at three different time steps.
Results show no significant difference between the two trust repair strategies when directly comparing to trust. A positive correlation between the authority change trust repair strategy and task load on trust recovery was found. Through thematic analysis we did find that the shared mental model and communication richness to be dissonant to what participants expected which is in line with literature on the complexity of triadic teams. ...
We conducted the experiment with thirty participants divided into a two groups with differing trust repair strategies (promise only, promise with the authority change) and measured trust perception at three different time steps.
Results show no significant difference between the two trust repair strategies when directly comparing to trust. A positive correlation between the authority change trust repair strategy and task load on trust recovery was found. Through thematic analysis we did find that the shared mental model and communication richness to be dissonant to what participants expected which is in line with literature on the complexity of triadic teams.
Generating Expertise-Specific Explanations in Cricket Pose Estimation
Design, Implementation, and Evaluation of Adaptive XAI Feedback
...
Enhancing Self-Efficacy in Computer Science Education
The Role of Large Language Models in Clarifying Error Messages for High School Students
Hand gestures classification in crowded environments
Classification of gesture phases in a crowded social setting recorded from top-view angle
Analysing Hand Gestures in Real-World Interactions
Employing gesture coding schemes and machine learning to predict physical features of hand gestures in video footage from a crowded social setting
by a coding scheme, in social interactions in the wild.
...
by a coding scheme, in social interactions in the wild.
The influence of assessment types on students' performance in Machine Learning Education
An analysis of students' learning gain in k-means clustering
How to Teach Machine Learning in an Engaging Way
An Analysis of Machine Learning Teaching Methods Aimed at Student Engagement
Scaffolded Learning Assignments in University Machine Learning Education
A study into the effectiveness of assignment scaffolding
Enhancing Understanding in Receiver Operating Characteristic (ROC) Curve Analysis
An Investigation into the Impact of Interactive Teaching Methods
This research investigates the impact of agent-provided explanations about the agent's trust in humans (artificial trust) and corresponding behavior changes on human trust in the agent and their satisfaction with explanations during a simulated SAR task. Two types of explanations were explored: Trust-Explained (TE) explanations, where the agent explains its trust level and trust-based decisions, and Trust-Unexplained (TU) explanations, which solely describe the agent’s behavior without reference to trust dynamics. Besides, this research also investigates the correlation between human trust and explanation satisfaction, and in the end, whether the differences in the provided explanations result in differences in team performance and artificial trust.
The study involved 40 participants divided into two groups: an experimental group (the trust-enhanced explanation group) receiving TE explanations and a control group (the non-trust explanation group) receiving TU explanations. Participants' trust in the agent, satisfaction with the explanations, and team performance and artificial trust were measured and analyzed. Contrary to initial expectations, no statistically significant differences in explanation satisfaction and human trust in the agent were found between the two groups. However, a strong positive correlation was observed between participants' satisfaction with the explanations and their trust in the agent, indicating that explanation quality plays a crucial role in human trust development. Furthermore, no significant differences in team performance were detected, suggesting that trust explanations may not directly influence task outcomes. In the analysis of artificial trust, the agent in the trust-enhanced explanation group exhibited more conservative adjustments in trust levels compared to the non-trust explanation group. This conservative approach may have influenced players in the trust-enhanced explanation group to adopt a more cautious or deliberate decision-making process, potentially prioritizing the comprehension of explanations over the optimization of task performance.
For future research, it may be worth delving deeper into the influence of trust explanations on user behavior, the more complex HAT task environments, the relationship between artificial trust and user behavior, the dynamic and adaptive explanations, and the causal relationship between explanation satisfaction and human trust in the agent to understand further how trust can be fostered in HAT.
...
This research investigates the impact of agent-provided explanations about the agent's trust in humans (artificial trust) and corresponding behavior changes on human trust in the agent and their satisfaction with explanations during a simulated SAR task. Two types of explanations were explored: Trust-Explained (TE) explanations, where the agent explains its trust level and trust-based decisions, and Trust-Unexplained (TU) explanations, which solely describe the agent’s behavior without reference to trust dynamics. Besides, this research also investigates the correlation between human trust and explanation satisfaction, and in the end, whether the differences in the provided explanations result in differences in team performance and artificial trust.
The study involved 40 participants divided into two groups: an experimental group (the trust-enhanced explanation group) receiving TE explanations and a control group (the non-trust explanation group) receiving TU explanations. Participants' trust in the agent, satisfaction with the explanations, and team performance and artificial trust were measured and analyzed. Contrary to initial expectations, no statistically significant differences in explanation satisfaction and human trust in the agent were found between the two groups. However, a strong positive correlation was observed between participants' satisfaction with the explanations and their trust in the agent, indicating that explanation quality plays a crucial role in human trust development. Furthermore, no significant differences in team performance were detected, suggesting that trust explanations may not directly influence task outcomes. In the analysis of artificial trust, the agent in the trust-enhanced explanation group exhibited more conservative adjustments in trust levels compared to the non-trust explanation group. This conservative approach may have influenced players in the trust-enhanced explanation group to adopt a more cautious or deliberate decision-making process, potentially prioritizing the comprehension of explanations over the optimization of task performance.
For future research, it may be worth delving deeper into the influence of trust explanations on user behavior, the more complex HAT task environments, the relationship between artificial trust and user behavior, the dynamic and adaptive explanations, and the causal relationship between explanation satisfaction and human trust in the agent to understand further how trust can be fostered in HAT.