Abstract: A task as simple as holding a cup between your fingers generates complex motor commands to finely regulate the forces applied by muscles. These fine force adjustments ensure the stability and integrity of the object by preventing it from slipping out of grip during manipulation and by reacting to perturbations. To do so, our sensorimotor system constantly monitors tactile and proprioceptive information about the force object exerts on fingertips and the friction of the surfaces to determine the optimal grip force. While the literature describes the transient responses, humans can generate to react to perturbations in load force, it is yet to be determined if humans can also react to abrupt changes in friction while already holding an object. Only recently technology using imperceivable ultrasonic vibrations became available to modulate friction in real time to investigate this question. In this study, we used an object with an integrated friction modulation device suspended in a pulley system controlling the load. With this device, we explored the rapid adaptation of the sensorimotor system to changes in friction alone and in combination with changes in load. When load force and friction changed simultaneously, the grip force response was regulated based on the grip safety requirements. Participants increased their grip force in response to decrease in friction. However, they did not adjust their grip force when the friction increased, which is expected based on our biomechanical model of friction sensing mechanisms. (Figure presented.). Key points: Simple tasks like pouring water into a glass mobilize intricate interactions between fingertip sensory inputs and motor commands to account for the weight change and friction. It has been investigated how humans react to force perturbations when holding an object, but very little is known about how frictional changes are sensed and acted upon while holding an object, for example, due to sweating or condensation. We engineered a unique experimental object that utilizes imperceivable ultrasonic vibrations to change the frictional properties of the surface in a few milliseconds. This apparatus enabled us to study how human subjects react to change of friction when gripping or holding an object. We showed that humans adjust the strength of their grasp when forces in the direction of gravity either increase or decrease; however, frictional change evokes adjustments only when friction decreases.

To gently grasp objects, robots need to balance generating enough friction yet avoiding too much force that could damage the object. In practice, the force regulation is challenging to implement since it requires knowledge of the friction coefficient, which can vary from object to object and even from grasp to grasp. Tactile sensing offers a window in the contact mechanics and provides information about friction. Notably touch can detect the precursor of the object slipping away from the grasp. To find this information, tactile sensors measure the deformation field of an artificial skin in both the normal and tangential direction. However, current approaches only react to slip and therefore react too late to perturbations. The object slips, inducing a failure of the grasp and damage. In this study, we introduce a method that uses machine-learning to anticipate slip by computing the so-called safety margin of the grasp. This safety margin represents the extra lateral force that maintains the contact away from the frictional limit. To find this value, we use a high-density camera-based tactile sensor to measure the 3D deformation of the surface via the movement of 82 colored markers. We trained a Convolutional Neural Network (CNN) to estimate the safety margin from the tactile images. Because it gives a distance to slip, the safety margin is a powerful metric for regulating grasp forces. As a testament of this effectiveness, we show that a simple proportional controller can robustly grasp a wide variety of objects. The results show that this control method outperforms slip detection methods, by reducing regrasp reaction times while decreasing grasping forces to 1-3 N.

Shortly after touching an object, humans can tactually gauge the frictional resistance of a surface. The knowledge of surface friction is paramount to tactile perception and the motor control of grasp. While potent correlations between friction and participants' perceptual response have been found, the causal link between the friction of the surface, its evolution and its perceptual experience has yet to be demonstrated. Here, we leverage new experimental apparatus able to modify friction in real time, to show that participants can perceive sudden changes in friction when they are pressing on a surface. Surprisingly, only a reduction of the friction coefficient leads to a robust perception. High-speed imaging data indicate that the sensation is caused by a release of a latent elastic strain over a 20 ms timeframe after the activation of the friction-reduction device. This rapid change of frictional properties during initial contact is interpreted as a normal displacement of the surface, which paves the way for haptic surfaces that can produce illusions of interacting with mechanical buttons.

The contact between the fingertip and an object is formed by a collection of micro-scale junctions, which collectively constitute the real contact area. This real area of contact is only a fraction of the apparent area of contact and is directly linked to the frictional strength of the contact (i.e., the lateral force at which the finger starts sliding). As a consequence, a measure of this area of real contact can help probe into the mechanism behind the friction of skin on glass. In this article, we present two methods to measure the variations of contact area;one that improves upon a tried-and-true fingertip imaging technique to provide ground truth, and the other that relies on the absorption and reflection of acoustic energy. To achieve precise measurements, the ultrasonic method exploits a recently developed model of the interaction that incorporates the non-linearity of squeeze film levitation. The two methods are in good agreement (= 0.94) over a large range of normal forces and vibration amplitudes. Since the real area of contact fundamentally underlies fingertip friction, the methods described in the article have importance for studying human grasping, understanding friction perception, and controlling surface-haptic devices.

Humans efficiently estimate the grip force necessary to lift a variety of objects, including slippery ones. The regulation of grip force starts with the initial contact and takes into account the surface properties, such as friction. This estimation of the frictional strength has been shown to depend critically on cutaneous information. However, the physical and perceptual mechanism that provides such early tactile information remains elusive. In this study, we developed a friction-modulation apparatus to elucidate the effects of the frictional properties of objects during initial contact. We found a correlation between participants’ conscious perception of friction and radial strain patterns of skin deformation. The results provide insights into the tactile cues made available by contact mechanics to the sensorimotor regulation of grip, as well as to the conscious perception of the frictional properties of an object.