Y. Vardar
Please Note
33 records found
1
Generating Tactile Textures from Perceptual Descriptors with Diffusion Models
A Feasibility Study
Capturing high-quality tactile signals typically requires specialized hardware and controlled laboratory conditions, limiting the scalability and diversity of haptic content. Generative models, which have transformed digital language, vision, and audio content, offer a promising alternative for haptics. We propose a two-stage latent diffusion framework for generating tactile texture signals conditioned on psychophysical descriptors. In the first stage, a diffusion model learns a compact latent representation of friction signals produced by a finger sliding over diverse surfaces and reconstructs them with high temporal fidelity. In the second stage, a diffusion-based encoder maps perceptual ratings, such as roughness, bumpiness, and slipperiness, into this latent space, enabling texture generation from perceptual input. Reconstruction results demonstrate low error and a realistic signal structure. However, conditioning on psychophysical descriptors produces limited variations, primarily affecting signal amplitude, highlighting an open challenge in perceptually conditioned generative haptics.
Electrovibration technology enables tactile texture rendering on capacitive touchscreens by modulating friction between the finger and the screen through electrostatic attraction forces, generated by applying an alternating voltage signal to the screen. Accurate signal calibration is essential for robust texture rendering but remains challenging due to variations in sliding speed, applied force, and individual skin mechanics, all of which unpredictably affect frictional behavior. Here, we investigate how exploration conditions affect electrovibration-induced finger friction on touchscreens and the role of skin mechanics in this process. Ten participants slid their index fingers across an electrovibration-enabled touchscreen at five sliding speeds (20∼100 mm/s) and applied force levels (0.2∼0.6 N). Contact forces and skin accelerations were measured while amplitude modulated voltage signals spanning the tactile frequency range were applied to the screen. We modeled the finger-touchscreen friction response as a first-order system and the skin mechanics as a mass–spring-damper system. Results showed that sliding speed influenced the friction response's cutoff frequency, along with the estimated finger moving mass and stiffness. For every 1 mm/s increase in speed, the cutoff frequency, the finger moving mass, and stiffness increased by 13.8 Hz, 3.23×10−5 kg, and 4.04 N/m, respectively. Correlation analysis revealed that finger stiffness had a greater impact on the cutoff frequency than moving mass. Notably, we observed a substantial inter-participant variability in both finger-display interaction and skin mechanics parameters. Finally, we developed a speed-dependent friction model to support consistent and perceptually stable electrovibration-based haptic feedback across varying user conditions.
The growing adoption of extended reality (XR) has increased demand for wearable technologies that provide naturalistic tactile sensations while allowing users to interact freely with their environments using bare fingers. However, most existing wearable haptic devices support only a limited range of tactile modalities. Here, we introduce a soft haptic ring and a data-driven rendering methodology for generating multimodal texture sensations. The device integrates pneumatic and hydraulic actuation to render roughness, thermal, and softness cues on the proximal phalanx. The ring can generate forces up to 1.75 N, produce displacements up to 0.27 mm within a 30–300 Hz operating range, and modulate display temperature by up to 25 ∘[jls-end-space/]C within 65 s. The rendering methodology modulates these cues based on the user’s exploratory actions: the hydraulic actuator conveys perceived temperature during static contact, while the pneumatic actuator generates pressure and vibration cues to convey softness and roughness during pressing and sliding gestures, respectively. We evaluated the system in a user study with 15 participants who matched six virtual textures generated by the ring to their real counterparts and rated their perceived sensations using guided exploratory actions. Participants achieved an average texture-matching precision of 68% and an F1 score of 0.68. Adjective ratings confirmed that the ring produces distinct and perceptually rich stimuli across all rendered modalities. These findings demonstrate the potential of the proposed haptic ring and rendering methodology to deliver multimodal tactile cues away from the fingertip for immersive XR applications, enabling diverse tactile feedback while preserving natural physical interaction.
Tactile Weight Rendering
A Review for Researchers and Developers
Haptic rendering of weight plays an essential role in naturalistic object interaction in virtual environments. While kinesthetic devices have traditionally been used for this aim by applying forces on the limbs, tactile interfaces acting on the skin have recently offered potential solutions to enhance or substitute kinesthetic ones. Here, we aim to provide an in-depth overview and comparison of existing tactile weight rendering approaches. We categorized these approaches based on their type of stimulation into asymmetric vibration and skin stretch, further divided according to the working mechanism of the devices. Then, we compared these approaches using various criteria, including physical, mechanical, and perceptual characteristics of the reported devices. We found that asymmetric vibration devices have the smallest form factor, while skin stretch devices relying on the motion of flat surfaces, belts, or tactors present numerous mechanical and perceptual advantages for scenarios requiring more accurate weight rendering. Finally, we discussed the selection of the proposed categorization of devices together with the limitations and opportunities for future research. We hope this study guides the development and use of tactile interfaces to achieve a more naturalistic object interaction and manipulation in virtual environments.
SENS3
Multisensory Database of Finger-Surface Interactions and Corresponding Sensations
This study investigates the impact of whole-body vibrations caused by external vehicle perturbations, such as aircraft turbulence, on the perception of electrovibration displayed on touchscreens.
Background
Electrovibration is a promising technology for providing tactile feedback on future touchscreens, potentially addressing usability challenges in vehicle cockpits. However, its performance under dynamic conditions, such as whole-body vibrations caused by turbulence, remains largely unexplored.
Method
We measured the absolute detection thresholds of 24 human participants for short (0.2 s) and long (0.5 s) duration electrovibration stimuli displayed on a touchscreen. These measurements were taken in the absence and presence of two types of turbulence motion (Gaussian and Multisine) generated by a motion simulator. Concurrently, we recorded participants’ applied contact force and finger displacements.
Results
Electrovibration stimuli displayed on vehicle cockpit touchscreens were more reliably perceived with a 0.5-s duration than a 0.2-s duration, both in the presence and absence of turbulence. Both turbulence types led to increased vibration-induced finger displacements and scan speeds in the direction of turbulence, as well as higher applied forces and force fluctuation rates. Gaussian turbulence significantly elevated perception thresholds, but only for short-duration electrovibration stimuli.
Conclusion
The findings indicate that whole-body vibrations impair the perception of short-duration electrovibration stimuli, primarily due to unintentional finger movements and increased fluctuations in applied normal force.
Application
Our findings offer valuable insights for the future design of touchscreens with tactile feedback in vehicle cockpits. ...
This study investigates the impact of whole-body vibrations caused by external vehicle perturbations, such as aircraft turbulence, on the perception of electrovibration displayed on touchscreens.
Background
Electrovibration is a promising technology for providing tactile feedback on future touchscreens, potentially addressing usability challenges in vehicle cockpits. However, its performance under dynamic conditions, such as whole-body vibrations caused by turbulence, remains largely unexplored.
Method
We measured the absolute detection thresholds of 24 human participants for short (0.2 s) and long (0.5 s) duration electrovibration stimuli displayed on a touchscreen. These measurements were taken in the absence and presence of two types of turbulence motion (Gaussian and Multisine) generated by a motion simulator. Concurrently, we recorded participants’ applied contact force and finger displacements.
Results
Electrovibration stimuli displayed on vehicle cockpit touchscreens were more reliably perceived with a 0.5-s duration than a 0.2-s duration, both in the presence and absence of turbulence. Both turbulence types led to increased vibration-induced finger displacements and scan speeds in the direction of turbulence, as well as higher applied forces and force fluctuation rates. Gaussian turbulence significantly elevated perception thresholds, but only for short-duration electrovibration stimuli.
Conclusion
The findings indicate that whole-body vibrations impair the perception of short-duration electrovibration stimuli, primarily due to unintentional finger movements and increased fluctuations in applied normal force.
Application
Our findings offer valuable insights for the future design of touchscreens with tactile feedback in vehicle cockpits.
Wearable haptic displays that relocate feedback away from the fingertip provide a much-needed sense of touch to interactions in virtual reality, while also leaving the fingertip free from occlusion for augmented reality tasks. However, the impact of relocation on perceptual sensitivity to dynamic changes in actuation during active movement remains unclear. In this work, we investigate the perceived realism of virtual textures rendered via vibrations relocated to the base of the index finger and compare three different methods of modulating vibrations with active finger speed. For the first two methods, changing finger speed induced proportional changes in either frequency or amplitude of vibration, and for the third method did not modulate vibration. In psychophysical experiments, participants compared different types of modulation to each other, as well as to real 3D-printed textured surfaces. Results suggest that frequency modulation results in more realistic sensations for coarser textures, whereas participants were less discerning of modulation type for finer textures. Additionally, we presented virtual textures either fully virtually in midair or under augmented reality in which the finger contacted a flat surface; while we found no difference in experimental performance, participants were divided by a strong preference for either the contact or non-contact condition.
Object properties perceived through the tactile sense, such as weight, friction, and slip, greatly influence motor control during manipulation tasks. However, the provision of tactile information during robotic training in neurorehabilitation has not been well explored. Therefore, we designed and evaluated a tactile interface based on a two-degrees-of-freedom moving platform mounted on a hand rehabilitation robot that provides skin stretch at four fingertips, from the index through the little finger. To accurately control the rendered forces, we included a custom magnetic-based force sensor to control the tactile interface in a closed loop. The technical evaluation showed that our custom force sensor achieved measurable shear forces of ± 8 N with accuracies of 95.2-98.4 % influenced by hysteresis, viscoelastic creep, and torsional deformation. The tactile interface accurately rendered forces with a step response steady-state accuracy of 97.5-99.4% and a frequency response in the range of most activities of daily living. Our sensor showed the highest measurement-range-to-size ratio and comparable accuracy to sensors of its kind. These characteristics enabled the closed-loop force control of the tactile interface for precise rendering of multi-finger two-dimensional skin stretch. The proposed system is a first step towards more realistic and rich haptic feedback during robotic sensorimotor rehabilitation, potentially improving therapy outcomes.
Wearable devices that relocate tactile feedback from fingertips can enable users to interact with their physical world augmented by virtual effects. While studies have shown that relocating same-modality tactile stimuli can influence the one perceived at the fingertip, the interaction of cross-modal tactile stimuli remains unclear. Here, we investigate how thermal cues applied on the index finger's proximal phalanx affect vibrotactile sensitivity at the fingertip of the same finger when employed at varying contact pressures. We designed a novel wearable device that can deliver thermal stimuli at adjustable contact pressures on the proximal phalanx. Utilizing this device, we measured the detection thresholds of fifteen participants for 250 Hz sinusoidal vibration applied on the fingertip while concurrently applying constant cold (18 C°), neutral (32 C°), and warm (40 C°) stimuli at high (2 N) and low (0.5 N) contact pressures to the proximal phalanx. Our results revealed no significant differences in detection thresholds across conditions. These preliminary findings suggest that applying constant thermal stimuli to other skin locations does not affect fingertip vibrotactile sensitivity, possibly due to perceptual adaptation. However, the influence of dynamic multisensory tactile stimuli remains an open question for future research.
FITS
Ensuring Safe and Effective Touchscreen Use in Moving Vehicles
Touch interfaces are replacing physical buttons, dials, and switches in the new generation of cars, aircraft, and vessels. However, vehicle vibrations and accelerations perturb finger movements and cause erroneous touchscreen inputs by users. Furthermore, unlike physical buttons, touchscreens cannot be operated by touch alone and always require users' visual focus. Hence, despite their numerous benefits, touchscreens are not inherently suited for use in vehicles, which results in an increased risk of accidents. In a recently awarded research project, titled "Right Touch Right Time: Future In-vehicle Touchscreens (FITS)", we aim to address these problems by developing novel in-vehicle touchscreens that actively predict and correct perturbed finger movements and simulate physical touch interactions with artificial tactile feedback.
FeelPen
A Haptic Stylus Displaying Multimodal Texture Feels on Touchscreens
The ever-emerging mobile market induced a blooming interest in stylus-based interactions. Most state-of-the-art styluses either provide no haptic feedback or only deliver one type of sensation, such as vibration or skin stretch. Improving these devices with display abilities of a palette of tactile feels can pave the way for rendering realistic surface sensations, resulting in more natural virtual experiences. However, integrating necessary actuators and sensors while keeping the compact form factor of a stylus for comfortable user interactions challenges their design. This situation also limits the scientific knowledge of relevant parameters for rendering compelling artificial textures for stylus-based interactions. To address these challenges, we developed FeelPen, a haptic stylus that can display multimodal texture properties (compliance, roughness, friction, and temperature) on touchscreens. We validated the texture rendering capability of our design by conducting system identification and psychophysical experiments. The experimental results confirmed that FeelPen could render a variety of modalities with wide parameter ranges necessary to create perceptually salient texture feels, making it a one-of-a-kind stylus. Our unique design and experimental results pave the way for new perspectives with stylus-based interactions on future touchscreens.
ThermoSurf
Thermal display technology for dynamic and multi-finger interactions
Thermal feedback has been proven to enhance user experience in human-machine interactions. Yet state-of-the-art thermal technology has focused on the single finger or palm in static contact, overlooking dynamic and multi-finger interactions. The underlying challenges include incompatible designs of conventional interfaces for providing salient thermal stimuli for such interactions and, thereby, a lack of knowledge on human thermal perception for relevant conditions. Here we present the ThermoSurf, a new thermal display technology that can deliver temperature patterns on a large interface suitable for dynamic and multi-finger interactions. We also investigate how user exploration affects the perception of the generated temperature distributions. Twenty-three human participants interacted with the device following three exploration conditions: static-single finger, dynamic-single finger, and static-multi finger. In these experiments, the individuals evaluated 15 temperature differences ranging from -7.5°C to +1.5°C with an initial temperature of 38°C. Our results showed that human sensitivity against thermal stimuli is significantly greater for static-single finger contact compared to the other tested conditions. In addition, this interaction type resulted in higher thermal discrimination thresholds than the ones reported in the literature. Our findings offer new perspectives on providing salient and consistent thermal feedback for future tactile interfaces.
Wearable vibrotactile actuators are non-intrusive and inexpensive means to provide haptic feedback directly to the user's skin. Complex spatiotemporal stimuli can be achieved by combining multiple of these actuators, using the funneling illusion. This illusion can funnel the sensation to a particular position between the actuators, thereby creating virtual actuators. However, using the funneling illusion to create virtual actuation points is not robust and leads to sensations that are difficult to locate. We postulate that poor localization can be improved by considering the dispersion and attenuation of the wave propagation on the skin. We used the inverse filter technique to compute the delays and amplification of each frequency to correct the distortion and create sharp sensations that are easier to detect. We developed a wearable device stimulating the volar surface of the forearm composed of four independently controlled actuators. A psychophysical study involving twenty participants showed that the focused sensation improves confidence in the localization by 20% compared to the non-corrected funneling illusion. We anticipate our results to improve the control of wearable vibrotactile devices used for emotional touch or tactile communication.
Pressing the fingertips into surfaces causes skin deformations that enable humans to grip objects and sense their physical properties. This process involves intricate finger geometry, non-uniform tissue properties, and moisture, complicating the underlying contact mechanics. Here we explore the initial contact evolution of dry and hydrated fingers to isolate the roles of governing physical factors. Two participants gradually pressed an index finger on a glass surface under three moisture conditions: dry, water-hydrated, and glycerin-hydrated. Gross and real contact area were optically measured over time, revealing that glycerin hydration produced strikingly higher real contact area, while gross contact area was similar for all conditions. To elucidate the causes for this phenomenon, we investigated the combined effects of tissue elasticity, skin-surface friction, and fingerprint ridges on contact area using simulation. Our analyses show the dominant influence of elastic modulus over friction and an unusual contact phenomenon, which we call friction-induced hinging.
Learning to Feel Textures
Predicting Perceptual Similarities From Unconstrained Finger-Surface Interactions
Whenever we touch a surface with our fingers, we perceive distinct tactile properties that are based on the underlying dynamics of the interaction. However, little is known about how the brain aggregates the sensory information from these dynamics to form abstract representations of textures. Earlier studies in surface perception all used general surface descriptors measured in controlled conditions instead of considering the unique dynamics of specific interactions, reducing the comprehensiveness and interpretability of the results. Here, we present an interpretable modeling method that predicts the perceptual similarity of surfaces by comparing probability distributions of features calculated from short time windows of specific physical signals (finger motion, contact force, fingernail acceleration) elicited during unconstrained finger-surface interactions. The results show that our method can predict the similarity judgments of individual participants with a maximum Spearman's correlation of 0.7. Furthermore, we found evidence that different participants weight interaction features differently when judging surface similarity. Our findings provide new perspectives on human texture perception during active touch, and our approach could benefit haptic surface assessment, robotic tactile perception, and haptic rendering.
Wearable tactile displays can create the illusion of touching real textures by applying vibrations to the finger as it moves across a virtual surface. There are many possible methods of modulating this vibratory content with finger movement, each potentially best suited to different texture length scales. Using a vibrotactile haptic ring paired with finger position tracking, here we explore the advantages of three vibration modulation schemes that scale the frequency or amplitude of applied vibrations as a function of finger velocity. Ongoing psychophysical experiments will characterize trade-offs between ease of control and perceived texture realism for frequencies associated with both coarse and fine textures.
One may notice a relatively wide range of tactile sensations even when touching the same hard, flat surface in similar ways. Little is known about the reasons for this variability, so we decided to investigate how the perceptual intensity of light stickiness relates to the physical interaction between the skin and the surface. We conducted a psychophysical experiment in which nine participants actively pressed their finger on a flat glass plate with a normal force close to 1.5 N and detached it after a few seconds. A custom-designed apparatus recorded the contact force vector and the finger contact area during each interaction as well as pre- and post-trial finger moisture. After detaching their finger, participants judged the stickiness of the glass using a nine-point scale. We explored how sixteen physical variables derived from the recorded data correlate with each other and with the stickiness judgments of each participant. These analyses indicate that stickiness perception mainly depends on the pre-detachment pressing duration, the time taken for the finger to detach, and the impulse in the normal direction after the normal force changes sign; finger-surface adhesion seems to build with pressing time, causing a larger normal impulse during detachment and thus a more intense stickiness sensation. We additionally found a strong between-subjects correlation between maximum real contact area and peak pull-off force, as well as between finger moisture and impulse.