The new simulator can automatically tune simulation parameters from real-world measurements. Photo/Eric Heiden/NVIDIA.
Researchers from the USC’s Department of Computer Science and NVIDIA have unveiled a new simulator for robotic cutting that can accurately reproduce the forces acting on a knife as it slices through common food, such as fruit and vegetables. The system could also simulate cutting through human tissue, offering potential applications in surgical robotics. The paper was presented at the Robotics: Science and Systems (RSS) Conference 2021 on July 16, where it received the Best Student Paper Award.
In the past, researchers have had trouble creating intelligent robots that replicate cutting. One challenge, they’ve argued, is that no two objects are the same, and current robotic cutting systems struggle with variation. To overcome this, the team devised a unique approach to simulate cutting by introducing springs between the two halves of the object being cut, represented by a mesh. These springs are weakened over time in proportion to the force exerted by the knife on the mesh.
the team devised a unique approach to simulate cutting by introducing springs between the two halves of the object being cut, represented by a mesh.
“What makes ours a special kind of simulator is that it is ‘differentiable,’ which means that it can help us automatically tune these simulation parameters from real-world measurements,” said lead author Eric Heiden, a PhD in computer science student at USC. “That’s important because closing this reality gap is a significant challenge for roboticists today. Without this, robots may never break out of simulation into the real world.”
“With our approach, we are able to automatically tune our simulator to match different types of material.” Eric Heiden
To transfer skills from simulation to reality, the simulator must be able to model a real system. In one of the experiments, the researchers used a dataset of force profiles from a physical robot to produce highly accurate predictions of how the knife would move in real life. In addition to applications in the food processing industry, where robots could take over dangerous tasks like repetitive cutting, the simulator could improve force haptic feedback accuracy in surgical robots, helping to guide surgeons and prevent injury.
“Here, it is important to have an accurate model of the cutting process and to be able to realistically reproduce the forces acting on the cutting tool as different kinds of tissue are being cut,” said Heiden. “With our approach, we are able to automatically tune our simulator to match different types of material and achieve highly accurate simulations of the force profile.” In ongoing research, the team is applying the system to real-world robots.
Co-authors are Miles Macklin, Yashraj S Narang, Dieter Fox, Animesh Garg, Fabio Ramos, all of NVIDIA.
The full paper (open access) and blog post are available here.
Published on July 22nd, 2021
Last updated on May 16th, 2024
