A.J. van der Veen
Please Note
23 records found
1
Exploration of the AMD Ryzen NPU for Real-time Signal Processing
Real-time Imaging of LOFAR Station Data
Four implementations of the algorithm were developed: three using the MLIR-AIE toolchain and one using the TINA framework. These implementations explored various parallelization and pipelining strategies to optimize performance while ensuring correctness and minimal power consumption. Experimental evaluations revealed up to a 77.4× speedup over a CPU baseline and a 2.84× speedup over a GPU implementation. Notably, three of the four implementations met the 10 Hz real-time requirement. All implementations yielded accurate results, with only minor variations due to differences in data types.
Although power consumption data for the NPU implementations was unavailable, the performance gains underscore the Ryzen NPU's potential for non-AI workloads. This thesis provides a proof of concept for DSP acceleration on the Ryzen NPU, contributes a new layer to the TINA toolchain, and offers insights for future application development. ...
Four implementations of the algorithm were developed: three using the MLIR-AIE toolchain and one using the TINA framework. These implementations explored various parallelization and pipelining strategies to optimize performance while ensuring correctness and minimal power consumption. Experimental evaluations revealed up to a 77.4× speedup over a CPU baseline and a 2.84× speedup over a GPU implementation. Notably, three of the four implementations met the 10 Hz real-time requirement. All implementations yielded accurate results, with only minor variations due to differences in data types.
Although power consumption data for the NPU implementations was unavailable, the performance gains underscore the Ryzen NPU's potential for non-AI workloads. This thesis provides a proof of concept for DSP acceleration on the Ryzen NPU, contributes a new layer to the TINA toolchain, and offers insights for future application development.
Motion Control for Visual Tracking
Visual Recording Object Oriented Mapping
serve as an user interface for an existing system, the ADEPTH. The goal of the rotational ring is to allow a surgeon to make selections in the user interface system. After careful consideration of the provided list of requirements, it was decided to use changes in magnetic fields, sensed by a Hall sensor. This Hall sensor detects whether an external ring was rotated to the left or to the right. The inside of the ring contains six samarium-cobalt magnets, chosen for their extreme resistance to demagnetisation at high temperatures. This was a consideration, because the magnets have to undergo repeated cycles of sterilisation as hot as 134◦ C. After iterated prototype testing, a final working prototype has been developed, which can communicate wirelessly with the user interface system and send ’left’ & ’right’ commands. This final prototype is watertight and low power, which satisfies two of the most desired requirements. ...
serve as an user interface for an existing system, the ADEPTH. The goal of the rotational ring is to allow a surgeon to make selections in the user interface system. After careful consideration of the provided list of requirements, it was decided to use changes in magnetic fields, sensed by a Hall sensor. This Hall sensor detects whether an external ring was rotated to the left or to the right. The inside of the ring contains six samarium-cobalt magnets, chosen for their extreme resistance to demagnetisation at high temperatures. This was a consideration, because the magnets have to undergo repeated cycles of sterilisation as hot as 134◦ C. After iterated prototype testing, a final working prototype has been developed, which can communicate wirelessly with the user interface system and send ’left’ & ’right’ commands. This final prototype is watertight and low power, which satisfies two of the most desired requirements.
The research begins with an analysis of existing models used to describe friction behavior in precision engineering systems. A critical evaluation of empirical models highlighting strengths and limitations is presented, and the LuGre friction model is selected. Subsequently, a simulation work is conducted to identify the viscous coefficients, the stiffness coefficient, the Coulomb friction, the Stribeck friction, and the Stribeck velocity in the LuGre model. The simulation setup is described, including the incorporation of the LuGre friction model and the identification of system parameters. The accuracy of the identification value to the true value is above 99\%. A comparison of the sensitivity of the objective function to the change of parameters is also conducted to enable a comprehensive exploration of friction dynamics. Finally, the research delves into static and dynamic parameter experiments, where cable slab forces' position-dependent impacts and velocity-friction maps that capture the intricate Stribeck effect are presented, and closed-loop and open-loop setups to dissect friction behavior during rapid motion changes are employed. Residual analysis of histogram and 90\% confidence autocorrelation and cross-correlation is also presented to study the quality of identification and shows that the LuGre model does not fully capture the friction phenomena on the Proton Motion Stage. Future research should involve the modification of the LuGre model and data-driven approaches such as machine learning. Overall, this thesis fills the gap in state-of-the-art works by combining theory and practice to enhance the understanding of friction in precision engineering systems. ...
The research begins with an analysis of existing models used to describe friction behavior in precision engineering systems. A critical evaluation of empirical models highlighting strengths and limitations is presented, and the LuGre friction model is selected. Subsequently, a simulation work is conducted to identify the viscous coefficients, the stiffness coefficient, the Coulomb friction, the Stribeck friction, and the Stribeck velocity in the LuGre model. The simulation setup is described, including the incorporation of the LuGre friction model and the identification of system parameters. The accuracy of the identification value to the true value is above 99\%. A comparison of the sensitivity of the objective function to the change of parameters is also conducted to enable a comprehensive exploration of friction dynamics. Finally, the research delves into static and dynamic parameter experiments, where cable slab forces' position-dependent impacts and velocity-friction maps that capture the intricate Stribeck effect are presented, and closed-loop and open-loop setups to dissect friction behavior during rapid motion changes are employed. Residual analysis of histogram and 90\% confidence autocorrelation and cross-correlation is also presented to study the quality of identification and shows that the LuGre model does not fully capture the friction phenomena on the Proton Motion Stage. Future research should involve the modification of the LuGre model and data-driven approaches such as machine learning. Overall, this thesis fills the gap in state-of-the-art works by combining theory and practice to enhance the understanding of friction in precision engineering systems.
Autonomous Wireless Charging System for Robot Swarms
Robot Control and Navigation
• An image recognition module;
• A navigation module;
• A motion control module;
The image recognition module uses linear image processing techniques and YOLO object detection in order to detect objects in images from the robots front facing camera. It detects traffic lights and road markings in order to tell the robot where to go.
The navigation module uses odometry to keep track of the robots current position. The odometry is reset in order to maintain accuracy. When the battery of the robot reaches a certain point the robot will decide to
charge. It will then initiate path finding using Lee’s algorithm in order to find a path to a charging park.
Finally the motion control processes all the information in order to drive the wheels of the robot.
The system is thought to be able to navigate to a charging station, charge and then leave the charging station using the designed ROS package. ...
• An image recognition module;
• A navigation module;
• A motion control module;
The image recognition module uses linear image processing techniques and YOLO object detection in order to detect objects in images from the robots front facing camera. It detects traffic lights and road markings in order to tell the robot where to go.
The navigation module uses odometry to keep track of the robots current position. The odometry is reset in order to maintain accuracy. When the battery of the robot reaches a certain point the robot will decide to
charge. It will then initiate path finding using Lee’s algorithm in order to find a path to a charging park.
Finally the motion control processes all the information in order to drive the wheels of the robot.
The system is thought to be able to navigate to a charging station, charge and then leave the charging station using the designed ROS package.
In this project, we delve into ADS-B-based trajectory prediction for both aircraft and drone motion trajectories with the overarching goal of improving prediction accuracy. We initially implement several model-based Kalman filters—including interactive multiple models (IMM)—to assess the accuracy of aircraft trajectory predictions across different model structures. The results reveal that the IMM filter outperforms the single model predictions in terms of root mean square error (RMSE).
Furthermore, we implement the Gaussian process (GP) with a sliding window scheme to predict online drone trajectories. Recognizing the high computational complexity of the GP, we also introduce a low-rank approximation method, structured kernel interpolation (SKI) GP, aiming to conserve computational resources. Finally, we compare the prediction performances of the IMM filter, classical GP, and SKI GP on real drone trajectories. The results highlight that the classical GP method enhanced prediction accuracy, achieving an RMSE of less than 1.7m, which is 50% lower compared to the model-based IMM filter. Additionally, the SKI GP realizes a 25% reduction in computation time compared to the classical GP, despite a slight compromise in prediction accuracy. ...
In this project, we delve into ADS-B-based trajectory prediction for both aircraft and drone motion trajectories with the overarching goal of improving prediction accuracy. We initially implement several model-based Kalman filters—including interactive multiple models (IMM)—to assess the accuracy of aircraft trajectory predictions across different model structures. The results reveal that the IMM filter outperforms the single model predictions in terms of root mean square error (RMSE).
Furthermore, we implement the Gaussian process (GP) with a sliding window scheme to predict online drone trajectories. Recognizing the high computational complexity of the GP, we also introduce a low-rank approximation method, structured kernel interpolation (SKI) GP, aiming to conserve computational resources. Finally, we compare the prediction performances of the IMM filter, classical GP, and SKI GP on real drone trajectories. The results highlight that the classical GP method enhanced prediction accuracy, achieving an RMSE of less than 1.7m, which is 50% lower compared to the model-based IMM filter. Additionally, the SKI GP realizes a 25% reduction in computation time compared to the classical GP, despite a slight compromise in prediction accuracy.
The current study aims to identify the best fiber direction estimation method under consistent and realistic conditions. To achieve this goal, synthetic EGMs and local activation time (LAT) maps were generated from 2D and 3D monodomain models that mimicked the muscle bundle, atrial bilayer, and ventricular transmural fiber rotation structures. A comparison analysis of existing fiber direction estimation methods, first as described by their authors and then standardized to have the same spatial resolution, showed the superior performance of the techniques based on fitting an ellipse to local conduction velocity or conduction slowness vectors from a whole LAT map. The estimation accuracy of these methods can be further improved by increasing the number of vectors to which the ellipse is fitted. Nonetheless, given the influence of underlying layers in the epicardial recordings, the estimation error increases in the tissue models where fibers in the epicardial and endocardial layers run perpendicularly. The effect on the estimate of such architecture, characteristic of the inferior side of the right atria and the ventricles, can be accounted for by combining epicardial electrical recordings obtained after pacing either in the endocardium or the epicardium. Although a preliminary assessment of the estimation methods was carried out with human EGMs, future studies should focus on validating the methods in a controlled experimental framework and refining them for more localized fiber direction estimation. All in all, the automation of the techniques and their integration into electrophysiological models brings us a step closer to creating valuable clinical tools for diagnosing and treating electropathologies.
...
The current study aims to identify the best fiber direction estimation method under consistent and realistic conditions. To achieve this goal, synthetic EGMs and local activation time (LAT) maps were generated from 2D and 3D monodomain models that mimicked the muscle bundle, atrial bilayer, and ventricular transmural fiber rotation structures. A comparison analysis of existing fiber direction estimation methods, first as described by their authors and then standardized to have the same spatial resolution, showed the superior performance of the techniques based on fitting an ellipse to local conduction velocity or conduction slowness vectors from a whole LAT map. The estimation accuracy of these methods can be further improved by increasing the number of vectors to which the ellipse is fitted. Nonetheless, given the influence of underlying layers in the epicardial recordings, the estimation error increases in the tissue models where fibers in the epicardial and endocardial layers run perpendicularly. The effect on the estimate of such architecture, characteristic of the inferior side of the right atria and the ventricles, can be accounted for by combining epicardial electrical recordings obtained after pacing either in the endocardium or the epicardium. Although a preliminary assessment of the estimation methods was carried out with human EGMs, future studies should focus on validating the methods in a controlled experimental framework and refining them for more localized fiber direction estimation. All in all, the automation of the techniques and their integration into electrophysiological models brings us a step closer to creating valuable clinical tools for diagnosing and treating electropathologies.
Few shot emotion recognition using intelligent voice assistants and wearables
Learning from few samples of speech and physiological signals
In this setting, we propose to introduce and develop emotion recognition pipelines that are suited to the interactions, common with these IVAs. To augment the existing emotion recognition pipelines which rely on audio information, we look at physiological information derived from wearables. Our proposed model uses multimodal embeddings with a Siamese Network to achieve the task of emotion recognition from a few samples. Physiological signals of blood volume pulse (BVP) and electrodermal activity (EDA) are used as additional input embeddings to two audio embeddings arising from the speech samples. We employ the state-of-the-art training schedules for Siamese Networks, which use a very limited amount of training on support datasets via sample pair comparisons. The performance of the model is evaluated using weighted binary accuracy and f1 scores.
The proposed model is applied on two datasets that denote two unique experimental settings - the K-EmoCon dataset and RECOLA dataset. We demonstrate an improvement in the state-of-the-art accuracy with the K-EmoCon dataset with accuracies of 63.97% and 66.91% on arousal and valence dimensions respectively. Further, on the RECOLA dataset, the model performs moderately well with 53.81% and 53.87% respectively for arousal and valence dimensions. In addition to this, we present a study of the effects of variation of available support set for training from the dataset. We make some salient observations for these experiments across individual participants and also identify how the label distributions affect the performance of the model. Further, we investigate the impact of real-world noise samples from the DEMAND dataset on the two datasets. We observe that the proposed model is robust and performs sustainingly well even in the presence of imputed noise.
...
In this setting, we propose to introduce and develop emotion recognition pipelines that are suited to the interactions, common with these IVAs. To augment the existing emotion recognition pipelines which rely on audio information, we look at physiological information derived from wearables. Our proposed model uses multimodal embeddings with a Siamese Network to achieve the task of emotion recognition from a few samples. Physiological signals of blood volume pulse (BVP) and electrodermal activity (EDA) are used as additional input embeddings to two audio embeddings arising from the speech samples. We employ the state-of-the-art training schedules for Siamese Networks, which use a very limited amount of training on support datasets via sample pair comparisons. The performance of the model is evaluated using weighted binary accuracy and f1 scores.
The proposed model is applied on two datasets that denote two unique experimental settings - the K-EmoCon dataset and RECOLA dataset. We demonstrate an improvement in the state-of-the-art accuracy with the K-EmoCon dataset with accuracies of 63.97% and 66.91% on arousal and valence dimensions respectively. Further, on the RECOLA dataset, the model performs moderately well with 53.81% and 53.87% respectively for arousal and valence dimensions. In addition to this, we present a study of the effects of variation of available support set for training from the dataset. We make some salient observations for these experiments across individual participants and also identify how the label distributions affect the performance of the model. Further, we investigate the impact of real-world noise samples from the DEMAND dataset on the two datasets. We observe that the proposed model is robust and performs sustainingly well even in the presence of imputed noise.
Quantum Random Number Generator
Hardware, software and PCB design
We define two main research questions regarding fUS data analysis. First, for compressing the large-scale raw beamformed fUS data, we apply sequentially truncated multilinear singular value decomposition. This compression method is compared against ensemble averaging used in the conventional pipeline, and shown to provide a higher compression rate while preserving more temporal resolution for specific ranks. Furthermore, it is observed to denoise the data, resulting in a more precise extraction of the active region of Superior Colliculus using correlation maps.
Secondly, in order to investigate the advantage of multi-slice processing that incorporates 3-D informa- tion, blind-source separation methods are applied to single slice and two-slice fUS recordings. After applying independent component analysis (ICA) to the matricized data as a benchmark method, block term decompo- sition (BTD) is used as a way of processing the data as it is, in its natural 3-D structure without vectorization. Through a simulation study, it is shown that the method is able to separate two images even when using a rank that is lower than the true rank, as well as in noisy conditions. Subsequently, BTD is applied to real 4-D fUS data formed by concatenation of slices in a new dimension. However, this method is seen to perform worse than single slice ICA in terms of extracting the active regions. In order to amplify common information between slices, a new 3-D data structure is then formed by summing the fUS data of two slices. For extraction of this common information, a BTD is then applied to the aggregate 3-D data. The findings of this decomposition reveal that both taking a longer portion of single slice data and incorporating the second slice helps to achieve better results. ...
We define two main research questions regarding fUS data analysis. First, for compressing the large-scale raw beamformed fUS data, we apply sequentially truncated multilinear singular value decomposition. This compression method is compared against ensemble averaging used in the conventional pipeline, and shown to provide a higher compression rate while preserving more temporal resolution for specific ranks. Furthermore, it is observed to denoise the data, resulting in a more precise extraction of the active region of Superior Colliculus using correlation maps.
Secondly, in order to investigate the advantage of multi-slice processing that incorporates 3-D informa- tion, blind-source separation methods are applied to single slice and two-slice fUS recordings. After applying independent component analysis (ICA) to the matricized data as a benchmark method, block term decompo- sition (BTD) is used as a way of processing the data as it is, in its natural 3-D structure without vectorization. Through a simulation study, it is shown that the method is able to separate two images even when using a rank that is lower than the true rank, as well as in noisy conditions. Subsequently, BTD is applied to real 4-D fUS data formed by concatenation of slices in a new dimension. However, this method is seen to perform worse than single slice ICA in terms of extracting the active regions. In order to amplify common information between slices, a new 3-D data structure is then formed by summing the fUS data of two slices. For extraction of this common information, a BTD is then applied to the aggregate 3-D data. The findings of this decomposition reveal that both taking a longer portion of single slice data and incorporating the second slice helps to achieve better results.
This work presents, to the best of our knowledge, the first decentralised key management system to be used by railway KMC across Europe. Existing procedures mandate that key distribution activities concerning key generation, distribution and deletion must be logged. To meet this requirement, the proposed decentralised system is based on a private and permissioned blockchain. The network is maintained by the KMC making use of the system and access to the system is granted by Registration Centres.
During the design of a single system to replace several one-to-one solutions between KMC, it came into light that train and/or trackside equipment owners might not accept revealing certain types of relationships, as these could, for example, reveal commercial strategies. To overcome this, the proposed decentralised system introduces privacy-preserving and verifiable combinations of train and trackside entities. The protocol is based around the decisional Diffie–Hellman assumption witness indistinguishable proofs.
The proposed design enables European railway KMC to use a single decentralised and scalable system to exchange cryptographic material in a secure and privacy-preserving way. Scalability is shown by building a proof-of-concept based a Byzantine Fault Tolerance consensus protocol. Performance analysis shows that the proposed system is scalable when a proof of concept is implemented with settings close to the expected railway landscape in 2030. ...
This work presents, to the best of our knowledge, the first decentralised key management system to be used by railway KMC across Europe. Existing procedures mandate that key distribution activities concerning key generation, distribution and deletion must be logged. To meet this requirement, the proposed decentralised system is based on a private and permissioned blockchain. The network is maintained by the KMC making use of the system and access to the system is granted by Registration Centres.
During the design of a single system to replace several one-to-one solutions between KMC, it came into light that train and/or trackside equipment owners might not accept revealing certain types of relationships, as these could, for example, reveal commercial strategies. To overcome this, the proposed decentralised system introduces privacy-preserving and verifiable combinations of train and trackside entities. The protocol is based around the decisional Diffie–Hellman assumption witness indistinguishable proofs.
The proposed design enables European railway KMC to use a single decentralised and scalable system to exchange cryptographic material in a secure and privacy-preserving way. Scalability is shown by building a proof-of-concept based a Byzantine Fault Tolerance consensus protocol. Performance analysis shows that the proposed system is scalable when a proof of concept is implemented with settings close to the expected railway landscape in 2030.
Electronic markers for geological research
Tag Design
Fast Dynamic Programming
A Numerical Method for Solving Dynamic Programming Problems