D.M. Pool
Please Note
141 records found
1
Detecting Operator Distraction Through Multivariate Signal Processing
Statistical and Machine Learning Perspectives
This paper compares different multivariate signal processing methods - both based on classical statistical or machine learning models - for detecting human operator distraction in a preview tracking task. Binary Time Series Classification (TSC) methods proposed in prior work, which require both 'non-distracted' and 'distracted' training examples, were found to be out-performed by dedicated Anomaly Detection (AD) methods that aim to detect outliers from a learned 'non-distracted' prior distribution only. Even when applied in an ensemble learning framework, the TSC methods suffer from high false alarms and are highly sensitive to domain shift, due to their explicit reliance on representative 'distracted' training data. The considered statistical AD method, based on calculation of the Mahalanobis Distance (MD) of tested multivariate time-series samples, was found to be outperformed by a machine learning One-Class Support Vector Machine (OCSVM) method, as the latter more faithfully captured the (non-normal) distribution of the 'non-distracted' training data. Combining both AD methods in a meta detector only gave marginal improvement in the attained F1 score (0.5694) compared to the OCSVM (0.5610). The presented findings show that statistical and machine learning methods for AD can enable relevant detection of potentially impactful moments of distraction from human control data, which can be tested in real-time monitoring and adaptive support frameworks.
Touchscreens are used increasingly in moving environments, where they can in fact be very difficult to use. A key issue is biodynamic feedthrough (BDFT): perturbing finger movements induced by feedthrough of motion accelerations (e.g., turbulence) through users' outstretched arms. Modeling the BDFT dynamics allows such erroneous components of touchscreen inputs to be computationally removed. Estimating accurate BDFT models using system identification methods traditionally requires experiments with prolonged measurement times. However, for touchscreen BDFT measurements, where participants generally keep their arms outstretched for the full measurement duration, long measurements lead to muscle fatigue, which impacts data quality. By means of a dedicated human-in-the-loop simulator experiment, this paper shows that reducing the measurement duration to around 30 s does not significantly affect participants BDFT dynamics, or our ability to model them. As a result, these experimental findings enable future investigations to use shorter measurement times to increase participant comfort without compromising BDFT model quality.
Haptic Shared Control during Automated Take-Off
Effects on Trust and Workload
Automation reduces pilot workload but introduces risks such as mode confusion and automation surprise, which can impair situation awareness and delay responses. Haptic shared control, delivered via active sidesticks, may mitigate these risks by providing continuous force feedback to convey automation intent and warnings. This study examined how the haptic information in shared control systems affects trust, workload, and awareness during automated take-off scenarios involving normal and abnormal autopilot behaviors. Twenty participants monitored automation performance while completing a secondary 2-back task under two shared control conditions: haptic shared versus input-mixing shared control. Results show that abnormal autopilot behaviors significantly increased workload and reduced trust, with haptic shared control having context-dependent effects - supporting trust and reducing workload during over-rotation but lowering trust in normal conditions. Haptic shared control had no significant effect upon participant situation awareness or secondary task performance. These findings suggest that the provision of haptic information within shared control can support pilots during automation anomalies but require human-centered implementation and training to avoid unintended effects under normal conditions.
Electrovibration technology enables tactile texture rendering on capacitive touchscreens by modulating friction between the finger and the screen through electrostatic attraction forces, generated by applying an alternating voltage signal to the screen. Accurate signal calibration is essential for robust texture rendering but remains challenging due to variations in sliding speed, applied force, and individual skin mechanics, all of which unpredictably affect frictional behavior. Here, we investigate how exploration conditions affect electrovibration-induced finger friction on touchscreens and the role of skin mechanics in this process. Ten participants slid their index fingers across an electrovibration-enabled touchscreen at five sliding speeds (20∼100 mm/s) and applied force levels (0.2∼0.6 N). Contact forces and skin accelerations were measured while amplitude modulated voltage signals spanning the tactile frequency range were applied to the screen. We modeled the finger-touchscreen friction response as a first-order system and the skin mechanics as a mass–spring-damper system. Results showed that sliding speed influenced the friction response's cutoff frequency, along with the estimated finger moving mass and stiffness. For every 1 mm/s increase in speed, the cutoff frequency, the finger moving mass, and stiffness increased by 13.8 Hz, 3.23×10−5 kg, and 4.04 N/m, respectively. Correlation analysis revealed that finger stiffness had a greater impact on the cutoff frequency than moving mass. Notably, we observed a substantial inter-participant variability in both finger-display interaction and skin mechanics parameters. Finally, we developed a speed-dependent friction model to support consistent and perceptually stable electrovibration-based haptic feedback across varying user conditions.
This paper investigates the effects of motion mismatches on simulator sickness and subjective ratings of the motion. In an open-loop driving simulator experiment, participants were driven through a recorded urban drive twelve times, in which mismatches were induced by manipulating the following three aspects in motion cueing: (i) mismatches in specific vehicle axes, (ii) mismatch types (scaling, missing, and false cues), and (iii) inconsistent scaling between different motion axes. Subjects (N=52) reported simulator sickness post-hoc (after each drive), as well as continuously during each drive, a first in simulator sickness research. Furthermore, subjective post-hoc motion incongruence ratings on the quality of the motion were extracted. Results show that longitudinal motion mismatches lead to the most simulator sickness and the highest ratings, followed by mismatches in lateral motion, then yaw rate. False cues induce the most sickness, followed by missing and then scaled motion. Inconsistent scaling between the axes has no significant effect. The continuous sickness ratings support that the occurrence and severity of simulator sickness are indeed related to mismatches in simulator motion of specific maneuvers. This paper contributes to an improved understanding of the relationship between simulator motion and sickness, allowing for more targeted motion cueing strategies to prevent and reduce sickness in driving simulators. These strategies may include the appropriate selection of the simulator, the motion cueing, and the sample of participants, following the presented results.
Erratum
Effects of Target Trajectory Bandwidth on Manual Control Behavior in Pursuit and Preview Tracking (IEEE Trans. Hum.-Mach. Syst. (2020) 50:1 (68–78) DOI: 10.1109/THMS.2019.2947577)
This erratum applies to the following published paper [1]. In Fig. 10(e) and (f) of the published version of the paper, the measured values for the t f and T l,f (both having values around 1 s for the considered dataset) were interchanged. This erratum includes both the published and corrected versions of Fig. 10 and the related paragraph in the paper's Results section. PUBLISHED VERSION In preview tasks, bandwidth changes yield only minor adaptations in the model parameters, see Fig. 10. Only the average look-ahead time t f decreases slightly with bandwidth from around 1.05 to 0.9 s, Fig. 10(e) but with substantial between-participant variability, as indicated by the overlapping confidence intervals. The lower t f may not reflect a systematic adaptation to the bandwidth, but a more subtle adaptation to minimize the errors due to the additional high-amplitude sinusoids at 2.5 and 4 rad/s, see also Fig. 8c. The general way in which participants use the available preview for control is, however, not affected by the target signal bandwidth: the target response gain (K f ≈ 0.95, Fig. 10(d)) and lag time-constant (T l, f ≈ 1.15 s, Fig. 10(f)) are approximately invariant. The estimated control dynamics in Fig. 12 show that the target trajectory is tracked almost perfectly at all frequencies below 4 rad/s, mostly because the phase lead due to τ f allows for synchronizing the CE output with the target signal (as opposed to pursuit tasks, see Fig. 11, bottom right). Therefore, different-bandwidth target signals provide no incentive for HCs to strongly adapt their control behavior in preview tasks. (Figure Presneted) CORRECTED VERSION In preview tasks, bandwidth changes yield only minor adaptations in the model parameters, see Fig. 10. Only the average target smoothing time-constant T l, f decreases slightly with bandwidth [from around 1.05 to 0.9 s, Fig. 10(f)], but with substantial between-participant variability, as indicated by the overlapping confidence intervals. The lower T l, f indicates that slightly more smoothing is applied to reduce tracking of the more high-amplitude high-frequency sinusoids in the 2.5 and 4 rad/s bandwidth signals through the feedforward response, see also Fig. 8(c). The general way in which participants use the available preview for control is, however, not affected by the target signal bandwidth: the target response gain [K f ≈ 0.95, Fig. 10(d)] and look-ahead time [τ f ≈ 1.15 s, Fig. 10(e)] are approximately invariant. The estimated control dynamics in Fig. 12 show that the target trajectory is tracked almost perfectly at all frequencies below 4 rad/s, mostly because the phase lead due to τ f allows for synchronizing the CE output with the target signal (as opposed to pursuit tasks, see Fig. 11, bottom right). Therefore, different-bandwidth target signals provide no incentive for HCs to strongly adapt their control behavior in preview tasks. (Figure presented).
This study investigates the impact of whole-body vibrations caused by external vehicle perturbations, such as aircraft turbulence, on the perception of electrovibration displayed on touchscreens.
Background
Electrovibration is a promising technology for providing tactile feedback on future touchscreens, potentially addressing usability challenges in vehicle cockpits. However, its performance under dynamic conditions, such as whole-body vibrations caused by turbulence, remains largely unexplored.
Method
We measured the absolute detection thresholds of 24 human participants for short (0.2 s) and long (0.5 s) duration electrovibration stimuli displayed on a touchscreen. These measurements were taken in the absence and presence of two types of turbulence motion (Gaussian and Multisine) generated by a motion simulator. Concurrently, we recorded participants’ applied contact force and finger displacements.
Results
Electrovibration stimuli displayed on vehicle cockpit touchscreens were more reliably perceived with a 0.5-s duration than a 0.2-s duration, both in the presence and absence of turbulence. Both turbulence types led to increased vibration-induced finger displacements and scan speeds in the direction of turbulence, as well as higher applied forces and force fluctuation rates. Gaussian turbulence significantly elevated perception thresholds, but only for short-duration electrovibration stimuli.
Conclusion
The findings indicate that whole-body vibrations impair the perception of short-duration electrovibration stimuli, primarily due to unintentional finger movements and increased fluctuations in applied normal force.
Application
Our findings offer valuable insights for the future design of touchscreens with tactile feedback in vehicle cockpits. ...
This study investigates the impact of whole-body vibrations caused by external vehicle perturbations, such as aircraft turbulence, on the perception of electrovibration displayed on touchscreens.
Background
Electrovibration is a promising technology for providing tactile feedback on future touchscreens, potentially addressing usability challenges in vehicle cockpits. However, its performance under dynamic conditions, such as whole-body vibrations caused by turbulence, remains largely unexplored.
Method
We measured the absolute detection thresholds of 24 human participants for short (0.2 s) and long (0.5 s) duration electrovibration stimuli displayed on a touchscreen. These measurements were taken in the absence and presence of two types of turbulence motion (Gaussian and Multisine) generated by a motion simulator. Concurrently, we recorded participants’ applied contact force and finger displacements.
Results
Electrovibration stimuli displayed on vehicle cockpit touchscreens were more reliably perceived with a 0.5-s duration than a 0.2-s duration, both in the presence and absence of turbulence. Both turbulence types led to increased vibration-induced finger displacements and scan speeds in the direction of turbulence, as well as higher applied forces and force fluctuation rates. Gaussian turbulence significantly elevated perception thresholds, but only for short-duration electrovibration stimuli.
Conclusion
The findings indicate that whole-body vibrations impair the perception of short-duration electrovibration stimuli, primarily due to unintentional finger movements and increased fluctuations in applied normal force.
Application
Our findings offer valuable insights for the future design of touchscreens with tactile feedback in vehicle cockpits.