<p>This page displays the records of the person named above and is not linked to a unique person identifier. This record may need to be merged to a profile.</p>
A Sensor-Based Augmented Reality System for Experience Capture and Re-enactment
Conference paper(2019)
-
Bibeg Limbu, Alla Vovk, Halszka Jarodzka, Roland Klemke, Fridolin Wild, Marcus Specht
Body-worn sensors can be used to capture, analyze, and replay human performance for training purposes. The key challenge to any such approach is to establish validity that the captured expert experience is actually suitable for training. In this paper, to evaluate this, we apply a questionnaire-based expert assessment and a complementary trainee knowledge assessment to study the approach adopted and the models generated with the WEKIT solution, a hardware and software application that complements Augmented Reality glasses with wearable sensor-actuator experience. This solution was developed using the ID4AR framework which as also developed within the WEKIT project. ID4AR framework is a domain agnostic framework which can be used to design augmented reality and sensor based applications for training. The study presented triangulates validity across three independent test-beds in the professional domains of aircraft maintenance, medical imaging, and astronaut training, with 61 experts completing the expert survey and 337 students completing the trainee knowledge test. Results show that the captured expert models were positively received in all three domains and the identified level of acceptance suggests that the solution is capable of capturing models for training purposes at large.
...
Body-worn sensors can be used to capture, analyze, and replay human performance for training purposes. The key challenge to any such approach is to establish validity that the captured expert experience is actually suitable for training. In this paper, to evaluate this, we apply a questionnaire-based expert assessment and a complementary trainee knowledge assessment to study the approach adopted and the models generated with the WEKIT solution, a hardware and software application that complements Augmented Reality glasses with wearable sensor-actuator experience. This solution was developed using the ID4AR framework which as also developed within the WEKIT project. ID4AR framework is a domain agnostic framework which can be used to design augmented reality and sensor based applications for training. The study presented triangulates validity across three independent test-beds in the professional domains of aircraft maintenance, medical imaging, and astronaut training, with 61 experts completing the expert survey and 337 students completing the trainee knowledge test. Results show that the captured expert models were positively received in all three domains and the identified level of acceptance suggests that the solution is capable of capturing models for training purposes at large.
Journal article(2018)
-
Bibeg Hang Limbu, Halszka Jarodzka, Roland Klemke, Fridolin Wild, Marcus Specht
Augmented reality and sensor technologies have been analysed extensively in several domains including education and training. Although, varieties of use cases and applications exist, these studies were conducted in controlled laboratory environments. This paper reports on the first user study of augmented reality prototype developed to support students to learn from trainers in professional domains using augmented reality and sensors. The prototype records the performance of trainers in the first phase to support students by making it available during practice in the second phase. The performance data is made available to both the students and trainers in the third phase for reflection. A total of 142 participants which included trainers and students from three professional domains, namely 1) aircraft maintenance 2) medical imaging and 3) astronaut training, evaluated the prototype. The trainers used the prototype to record their performance while the students used the prototype to learn from the recorded performance. Participants from the three professional domains evaluated the usability of the prototype by means of a questionnaire. Randomly selected participants were also interviewed to collect their opinions and suggestion for further usability improvement. Furthermore, they also evaluated the implementation of the instructional design methods, which were identified prior in a literature review, with a brief questionnaire. The questionnaire was designed to measure the acceptance of the implementation of instructional design methods and to evaluate its adherence to the authors definition. The results of this study show that the usability of the prototype is below expected standard acceptable level. The results of the questionnaire on the implementation of the instructional design methods varied show above average acceptance levels by both the trainers and the students in the three professional domains. To conclude, the prototype shows potential to be used in different domains to support expertise development.
...
Augmented reality and sensor technologies have been analysed extensively in several domains including education and training. Although, varieties of use cases and applications exist, these studies were conducted in controlled laboratory environments. This paper reports on the first user study of augmented reality prototype developed to support students to learn from trainers in professional domains using augmented reality and sensors. The prototype records the performance of trainers in the first phase to support students by making it available during practice in the second phase. The performance data is made available to both the students and trainers in the third phase for reflection. A total of 142 participants which included trainers and students from three professional domains, namely 1) aircraft maintenance 2) medical imaging and 3) astronaut training, evaluated the prototype. The trainers used the prototype to record their performance while the students used the prototype to learn from the recorded performance. Participants from the three professional domains evaluated the usability of the prototype by means of a questionnaire. Randomly selected participants were also interviewed to collect their opinions and suggestion for further usability improvement. Furthermore, they also evaluated the implementation of the instructional design methods, which were identified prior in a literature review, with a brief questionnaire. The questionnaire was designed to measure the acceptance of the implementation of instructional design methods and to evaluate its adherence to the authors definition. The results of this study show that the usability of the prototype is below expected standard acceptable level. The results of the questionnaire on the implementation of the instructional design methods varied show above average acceptance levels by both the trainers and the students in the three professional domains. To conclude, the prototype shows potential to be used in different domains to support expertise development.
