IMU-to-Segment Calibration with Stiff Joint Using Deep Learning Integrating Kinematic Constraints

Master Thesis (2025)
Author(s)

L. Zhu (TU Delft - Mechanical Engineering)

Contributor(s)

Manon Kok – Mentor (TU Delft - Team Manon Kok)

Ajay Seth – Graduation committee member (TU Delft - Biomechatronics & Human-Machine Control)

R. Li – Mentor (TU Delft - Team Manon Kok)

Faculty
Mechanical Engineering
More Info
expand_more
Publication Year
2025
Language
English
Coordinates
52.0013985, 4.3714381
Graduation Date
30-01-2025
Awarding Institution
Delft University of Technology
Programme
Mechanical Engineering | Systems and Control
Faculty
Mechanical Engineering
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

IMU-to-Segment(I2S) calibration is a critical step in using IMU for human motion capture, as it determines the relative orientation and position between the IMU and the body segment it is attached to. Traditional constraint-based method rely on kinematic constraints to perform I2S calibration but fail in scenarios where no relative motion occurs between connected segments. To address this limitation, this thesis extends existing deep learning approaches for I2S calibration to the stiff case and investigates methods to further enhance calibration accuracy.

After completing I2S calibration using deep learning with a single IMU in stiff case, this thesis further explores joint training with dual-IMU model and integrates kinematic constraints into the model. Experiment results demonstrate that the joint training allows the models to leverage inter-IMU motion information, improving the model performance. Furthermore, integrating kinematic constraints with appropriate weights into the loss function of deep learning model improves calibration accuracy by guiding predictions to satisfy physical constraints. However, overly large constraint weights may result in larger calibration error.

This thesis provides insights into how deep learning can be adapted to address the challenges of I2S calibration in stiff joint scenarios. It also combines deep learning with kinematic information through joint training and the integration of kinematic constraints, achieving improved calibration accuracy. Future work will explore the application of this approach to real-world motion data and the integration of diverse kinematic constraints.

Files

Thesis_Liuyizhu.pdf
(pdf | 2.06 Mb)
License info not available