Circular Image

C. Della Santina

info

Please Note

145 records found

A real-world empirical Study with SAM2

Segmenting gas bubbles in multiphase flows is a critical yet unsolved challenge in numerous industrial settings, from metallurgical processing to maritime drag reduction. Traditional approaches — and most recent learning-based methods — assume near-spherical shapes, limiting their effectiveness in regimes where bubbles undergo deformation, coalescence, or breakup. This complexity is particularly evident in air lubrication systems, where coalesced bubbles form amorphous and topologically diverse patches. In this work, we revisit the problem through the lens of modern vision foundation models. We cast the task as a transfer learning problem and demonstrate, for the first time, that a fine-tuned Segment Anything Model (SAM v2.1) can accurately segment highly non-convex, irregular bubble structures using as few as 100 annotated images. ...
Journal article (2026) - Giovanni Franzese, Max Spahn, Jens Kober, Javier Alonso-Mora, Cosimo Della Santina
To reliably perform everyday tasks, collaborative robots must be accurate, not merely repeatable. Unfortunately, precise kinematic calibration often relies on tools that are more expensive than the robots themselves. We address this limitation by proposing a low-cost and effective calibration method aimed at democratizing cobot calibration. Our minimalist approach uses a single 3D-printable two-socket spherical-joint tool to kinematically constrain the robot end effector during data collection. An optimization routine updates the nominal kinematic model to ensure consistent socket predictions while preserving their mean distance. We validate the method on Franka, KUKA, and Kinova cobots, consistently reducing mean absolute errors, for example, from approximately 10 mm to 0.2 mm on Franka robots. To demonstrate practical impact, we further evaluate the calibrated model on a Franka robot in a peg-in-the-hole task with 0.4 mm tolerance and in a repeated drawing task using Cartesian control and learning from demonstration. Both tasks fail without calibration and consistently succeed with the calibrated model. The proposed method enables affordable and practical cobot calibration, providing a foundation for accurate manipulation tasks. ...
Journal article (2026) - Ghanishtha Bhatti, Pietro Pustina, Daniel Feliu-Talegon, Bastian Deutschmann, Cosimo Della Santina
Soft robots, with their compliant and underactuated nature, pose significant challenges for real-time shape regulation. Practical implementations of these methods often rely on fully-actuated approximations, over-looking the underactuated nature of these continuum structures. This study experimentally validates model-based controllers through collocated control that explicitly address underactuation, incorporating gravity cancellation and elasticity compensation to outperform conventional PD/PID approaches. A new multi-segment soft robot with a passively actuated segment has been designed, enabling experimental validation and providing strong evidence of the controllers’ effectiveness. The work bridges theory and practice, offering a practical framework for real-time shape regulation applicable to diverse soft robotic systems. ...
Journal article (2026) - Giulio Evangelisti, Cosimo Della Santina, Sandra Hirche
Designing accurate yet reliable tracking controllers with tight performance guarantees for Lagrangian systems is challenging due to nonlinear modeling uncertainties and conservative stability criteria. This article proposes a structure-preserving projector-based tracking control law for uncertain Euler-Lagrange (EL) systems using physically consistent Lagrangian-Gaussian Processes (LGPs). We leverage the uncertainty quantification of the LGP for adaptive feedforward-feedback balancing. In particular, an accurate probabilistic guarantee for exponential stability is derived by leveraging matrix analysis results and ideas from contraction analysis, where the benefit of the proposed controller is proven and shown in the closed-form expressions for convergence rate and radius. Extensive numerical simulations not only demonstrate the controller's efficacy based on a two-link and a soft robotic manipulator, but also all theoretical results are explicitly analyzed and validated. ...

Supercharging harmonic oscillator networks via non-holonomic constraints

Conference paper (2026) - M. Ramirez Montero, Andrea Ceni, Andrea Cossu, Davide Bacciu, Claudio Gallicchio, C. Della Santina
Motivated by advances in physical reservoir computing, we seek models that retain the modularity of echo state networks while enriching their internal dynamics. Recent studies have demonstrated that oscillator networks can achieve this balance, although their simple harmonic nature may limit their expressiveness. Here, we investigate the idea of augmenting harmonic oscillators with non-holonomic (velocity-level) constraints, known to induce rich, nonlocal behaviors. We implement these constraints intrinsically within each dynamical unit, yielding a model equivalent to the unicycle — the canonical representation of the simplest vehicle. We test the model on three time-series classification benchmarks, achieving competitive or superior accuracy compared to the state of the art, with reservoirs as small as 20 unicycles. ...
Journal article (2026) - Carina Veil, Moritz Flaschel, Ellen Kuhl, Cosimo Della Santina
For fully actuated rigid robots, kinematic inversion is a purely geometric problem, efficiently solved by closed-loop inverse kinematics (CLIK) schemes that compute joint velocities to position the robot body in space. For underactuated soft robots, however, not all configurations are attainable through control action, making kinematic inversion extremely ill-posed. Extensions of CLIK address this by introducing end-to-end mappings from actuation to task space for the controller to operate on, but typically assume finite dimensions of the underlying virtual configuration space. In this work, we formulate CLIK in the infinite-dimensional domain to reason about the entire soft robot shape while solving tasks, thereby skipping intermediate approximation steps. We do this by composing an actuation-to-shape map with a shape-to-task map, deriving the differential end-to-end kinematics via an infinite-dimensional chain rule, and thereby obtaining a Jacobian-based CLIK algorithm. Since complex soft-robot models are rarely available in closed form, and neither the actuation-to-shape mapping nor its Jacobian can typically be obtained analytically, we propose to learn it using differentiable neural operator networks. We first present an analytical study on a constant-curvature segment, and then apply the neural version of the algorithm to a three-fiber soft robotic arm whose underlying model relies on morphoelasticity and active filament theory. ...
Reduced-order models are central to motion planning and control of quadruped robots, yet existing templates are often hand-crafted for a specific locomotion modality. This motivates the need for automatic methods that extract task-specific, interpretable low-dimensional dynamics directly from data. We propose a methodology that combines a linear autoencoder with symbolic regression to derive such models. The linear autoencoder provides a consistent latent embedding for configurations, velocities, accelerations, and inputs, enabling the sparse identification of nonlinear dynamics (SINDy) to operate in a compact, physics-aligned space. A multi-phase, hybrid-aware training scheme ensures coherent latent coordinates across contact transitions. We focus our validation on quadruped jumping—a representative, challenging, yet contained scenario in which a principled template model is especially valuable. The resulting symbolic dynamics outperform the state-of-the-art handcrafted actuated spring-loaded inverted pendulum (aSLIP) baseline in simulation and hardware across multiple robots and jumping modalities. ...
Journal article (2026) - Domenico Dona, Giovanni Franzese, Cosimo Della Santina, Paolo Boscariol, Basilio Lenzo
Industrial robotics demands significant energy to operate, making energy-reduction methodologies increasingly important. Strategies for planning minimum-energy trajectories typically involve solving nonlinear optimal control problems (OCPs), which rarely cope with real-time (RT) requirements. In this article, we propose a paradigm for generating near minimum-energy trajectories for manipulators by learning from optimal solutions. Our paradigm leverages a residual learning approach, which embeds boundary conditions (BCs) while focusing on learning only the adjustments needed to steer a standard solution to an optimal one. Compared to a computationally expensive OCP-based planner, our paradigm achieves 87.3% of the performance near the training dataset and 50.8% far from the dataset, while being two to three orders-of-magnitude faster. ...
Recent advances in machine learning have begun to embed oscillatory network principles within neural architectures, aiming to enhance computational efficiency and robustness in time-series regression. Building on these developments, we take a step toward applying such principles to the learning of physical dynamics. We introduce Neural Linear Oscillator Networks (nLON): a vision-based framework that extracts compact latent representations of complex motion directly from image sequences. A convolutional autoencoder encodes position and velocity into a low-dimensional manifold, whose temporal evolution is governed by coupled linear mechanical oscillators driven by a linear combination of the inputs. This strong structural prior not only promotes sample efficiency and interpretability but also guarantees that the learned model remains a mechanical, Wiener-type system. From this formulation, we derive closed-loop controllers that ensure stable regulation. We focus on soft robots-systems whose nonlinear, continuous, and high-dimensional dynamics make them both a challenging and ideal testbed for our approach. Using tentacle robots in high-fidelity simulations and real-world experiments, we validate that our framework delivers accurate long-horizon predictions and consistently surpasses state-of-the-art baselines, achieving superior structural fidelity and final-step accuracy. Finally, we leverage the learned dynamics for model-based control, demonstrating in simulation that the resulting scheme achieves robust and reliable tracking. ...

Bridging Robotics and AI Toward Real-World Applications [From the Guest Editors]

Journal article (2026) - Hao Su, Yunduan Cui, Cosimo Della Santina, Kuan Fang, Jens Kober, Yanan Li, Yunzhu Li, Takamitsu Matsubara, Maria Pozzi
Conference paper (2026) - Peiyu Yang, Jiatao Ding, Wei Pan, Claudio Semini, Cosimo Della Santina
Achieving safe quadrupedal locomotion in realworld environments has attracted much attention in recent years. When walking over uneven terrain, achieving reliable estimation and realizing safety-critical control based on the obtained information is still an open question. To address this challenge, especially for low-cost robots equipped solely with proprioceptive sensors (e.g., IMUs, joint encoders, and contact force sensors), this work first presents an estimation framework that generates a 2.5-D terrain map and extracts support plane parameters, which are then integrated into contact and state estimation. Then, we integrate this estimation framework into a safety-critical control pipeline by formulating control barrier functions that provide rigorous safety guarantees. Experiments demonstrate that the proposed terrain estimation method provides smooth terrain representations. Moreover, the coupled estimation framework of terrain, state, and contact reduces the mean absolute error of base position estimation by 64.8%, decreases the estimation variance by 47.2%, and improves the robustness of contact estimation compared to a decoupled framework. The terrain-informed CBFs integrate historical terrain information and current proprioceptive measurements to ensure global safety by keeping the robot out of hazardous areas and local safety by preventing body-terrain collision, relying solely on proprioceptive sensing. ...
Soft robots enable safe and adaptive interaction with their environment, but still face major challenges in detecting contact during manipulation. This paper presents a low-cost vision-based setup designed to obtain groundtruth contact areas of soft manipulators without requiring the embedding of sensors into their structure. The platform uses an external camera and controlled lighting to capture the contact interface under different materials and configurations. Three segmentation methods, HSV thresholding, the Segment Anything Model (SAM 2.1), and a CNN with a VGG16 encoder, were compared for performance. Among them, optimized HSV thresholding achieved the best balance between accuracy and simplicity, with a Dice score of 0.97 and a mean error of 8% on reference tests. The proposed setup provides a practical and reproducible method to study contact formation in soft robotics and a reproducible method for obtaining ground-truth data for tactile sensing and control. ...
Conference paper (2026) - Chuhan Zhang, Jingyue Liu, Ebrahim Shahabi, Wei Pan, Cosimo Della Santina
Modeling and predicting the motion of soft robots remains challenging due to their infinite-dimensional and highly nonlinear dynamics. A promising direction is to learn dynamics directly from high-dimensional sensory streams. Yet, standard RGB cameras suffer from motion blur, making it challenging to capture fast transients and biasing learning toward steadystate behaviors. Here, we turn to event-based cameras, which provide asynchronous, high-frequency visual information better suited to capturing dynamic deformations. We propose a learning architecture that encodes two-channel event frames from a DVS sensor through a convolutional autoencoder while jointly learning a compact latent representation of the robot's dynamics. Within this space, we test several latent models, including a novel spiking-harmonic latent oscillator network (snLON), in which spiking neurons capture the event structure of the data stream and drive a latent Oscillator Network that represents the underlying mechanical dynamics. Validated in both simulation and real-world experiments, the proposed framework predicts long-horizon soft-robot motion with high accuracy and consistency from a single initial event frame and control sequence. ...
Journal article (2026) - Peiyi Wang, Daniel Feliu-Talegon, Yuchen Sun, Zhexin Xie, Wenci Xin, Muhammad Sunny Nazeer, Cosimo Della Santina, Cecilia Laschi, Federico Renda
Soft robots' ability to safely navigate complex environments motivates the development of algorithms for accurate environmental interaction assessment, enabling greater autonomy. Specifically, strain-based shape and force estimation of continuum robots with embedded soft sensors poses an open challenge mainly owing to continuous softness, anisotropic deformation, and non-linear properties. Mathematical description of deformable soft bodies and accurate estimation of external forces are crucial for achieving controllable and intelligent behaviors of these robots. In this paper, a kinetostatic strain-based modeling for rod-driven soft robots (RDSR) with embedded stretch sensors is proposed, which incorporates local strains, actuation variables, and external interactions. The strain model enables full shape estimation of the robot and prediction of strain variations in soft bodies. Building on this, we develop a force estimator based on predicted and measured sensor and actuator lengths to evaluate 3D external forces, accounting for both orthogonal and tangential components relative to the backbone. Moreover, we introduce a methodology using a novel ellipsoid representation to handle tangential forces that may become insensitive in certain singular configurations. This estimator allows us to either disregard such forces when they do not influence deformation or estimate them when they become observable. Our simulations and experiments demonstrate how this approach can be used to analyze the robot's configuration and successfully estimate external forces. Finally, it is demonstrated that when the continuum arm follows trajectories with higher strain sensitivity, tangential force estimation is significantly improved. ...

Implementations, Applications, and Prospects [Survey]

Journal article (2026) - Zixi Chen, Di Wu, Cesare Stefanini, Qinghua Guan, David Hardman, Federico Renda, Josie Hughes, Thomas George Thuruthel, Cosimo Della Santina, Barbara Mazzolai, Huichan Zhao
Soft robots, compared to rigid robots, possess inherent advantages, including higher degrees of freedom, compliance, and enhanced safety, which have contributed to their increasing application across various fields. Among these benefits, adaptability is particularly noteworthy. In this article, adaptability in soft robots is categorized into external and internal adaptability. External adaptability refers to the robot’s ability to adjust, either passively or actively, to variations in environments, object properties, geometries, and task dynamics. Internal adaptability refers to the robot’s ability to cope with internal variations, such as manufacturing tolerances or material aging, and to generalize control strategies across different robots. As the field of soft robotics continues to evolve, the significance of adaptability has become increasingly pronounced. In this review article, we summarize various approaches to enhancing the adaptability of soft robots, including design, sensing, and control strategies. Additionally, we assess the impact of adaptability on applications such as surgery, wearable devices, locomotion, and manipulation. We also discuss the limitations of soft robotics adaptability and prospective directions for future research. By analyzing adaptability through the lenses of implementation, application, and challenges, this article aims to provide a comprehensive understanding of this essential characteristic in soft robotics and its implications for diverse applications. ...
Journal article (2026) - Kirsten Lussenburg, Giovanni Colucci, Giuseppe Quaglia, Cosimo Della Santina, Aimée Sakes
Breastfeeding is essential for infant nutrition, but the increasing number of women returning to work before weaning highlights the need for efficient and comfortable milk expression methods. Traditional breast pumps rely solely on vacuum suction, which can cause discomfort, tissue damage, and longer extraction times compared to natural nursing. This study aims to develop a breast pump that better mimics the biomechanics of infant breastfeeding to improve comfort and efficiency. We investigated two actuator designs–membrane and soft pleated–integrated into the breast shield to replicate infant sucking. The pleated actuator proved most effective, offering a wide range of expansion and contraction. Unlike traditional pumps, vacuum is applied through radial expansion, allowing the nipple to widen rather than elongate, closely simulating infant tongue movements. The breast shield was fabricated using additive manufacturing with soft, elastic materials, enabling complex geometries and varied stiffness. The prototype was tested against a commercial pump using an artificial breast phantom. Results suggest this design can enhance milk output, reduce pumping time, and improve user comfort. By merging soft robotics with biological insights, our approach offers a promising alternative to conventional breast pumps. ...
Obtaining dynamic models of continuum soft robots is central to the analysis and control of soft robots, and researchers have devoted much attention to the challenge of proposing both data-driven and first-principle solutions. Both avenues have, however, shown their limitations; the former lacks structure and performs poorly outside training data, while the latter requires significant simplifications and extensive expert knowledge to be used in practice. This paper introduces a streamlined method for learning low-dimensional, physicsbased models that are both accurate and easy to interpret. We start with an algorithm that uses image data (i.e., shape evolutions) to determine the minimal necessary segments for describing a soft robot's movement. Following this, we apply a dynamic regression and strain sparsification algorithm to identify relevant strains and define the model's dynamics. We validate our approach through simulations with various planar soft manipulators, comparing its performance against other learning strategies, showing that our models are both computationally efficient and 25x more accurate on out-of-training distribution inputs. Finally, we demonstrate that thanks to the capability of the method of generating physically compatible models, the learned models can be straightforwardly combined with model-based control policies. ...

Noniterative Spiking Neural Network With Attention With Application to Motor Imagery EEG Classification

Journal article (2025) - Chuhan Zhang, Wei Pan, Cosimo Della Santina
Motor imagery (MI), an important category in electroencephalogram (EEG) research, often intersects with scenarios demanding low energy consumption, such as portable medical devices and isolated environment operations. Traditional deep learning (DL) algorithms, despite their effectiveness, are characterized by significant computational demands accompanied by high energy usage. As an alternative, spiking neural networks (SNNs), inspired by the biological functions of the brain, emerge as a promising energy-efficient solution. However, SNNs typically exhibit lower accuracy than their counterpart convolutional neural networks (CNNs). Although attention mechanisms successfully increase network accuracy by focusing on relevant features, their integration in the SNN framework remains an open question. In this work, we combine the SNN and the attention mechanisms for the EEG classification, aiming to improve precision and reduce energy consumption. To this end, we first propose a noniterative leaky integrate-and-fire (NiLIF) neuron model, overcoming the gradient issues in traditional SNNs that use iterative LIF neurons for long time steps. Then, we introduce the sequence-based attention mechanisms to refine the feature map. We evaluated the proposed noniterative SNN with attention (NiSNN-A) model on two MI EEG datasets, OpenBMI and BCIC IV 2a. Experimental results demonstrate that: 1) our model outperforms other SNN models by achieving higher accuracy and 2) our model increases energy efficiency compared with the counterpart CNN models (i.e., by 2.13 times) while maintaining comparable accuracy. ...
Journal article (2025) - Pietro Pustina, Cosimo Della Santina, Alessandro De Luca
Robotics is shifting from rigid, articulated systems to more sophisticated and heterogeneous mechanical structures. Soft robots, for example, have continuously deformable elements capable of large deformations. The flourishing of control techniques developed for this class of systems is fueling the need of efficient procedures for evaluating their inverse dynamics (ID), which is challenging due to the complex and mixed nature of these systems. As of today, no single ID algorithm can describe the behavior of generic (combinations of) models of soft robots. We address this challenge for generic series-like interconnections of possibly soft structures that may require heterogeneous modeling techniques. Our proposed algorithm requires as input a purely geometric description (forward-kinematics-like) of the mapping from configuration space to deformation space. With this information only, the complete equations of motion can be given an exact recursive structure which is essentially independent from (or “agnostic” to) the underlying reduced-order kinematics. We achieve this by exploiting Kane’s method to manipulate the equations of motion, showing then their recursive structure. The resulting ID algorithms have optimal computational complexity within the proposed setting, that is, linear in the number of distinct modules. Further, a variation of the algorithm is introduced that can evaluate the generalized mass matrix without increasing computation costs. We showcase the method applicability to robot models involving a mixture of rigid and soft elements, described via possibly heterogeneous reduced order models (ROMs), such as Volumetric FEM, Cosserat strain-based, and volume-preserving deformation primitives. None of these systems can be handled using existing ID techniques. ...