Team Develops Robotic Machine Vision Solution for Shiny Objects

Southwest Research Institute and ROS-Industrial developed a solution that enables industrial robots to scan and manipulate metallic objects that had previously been too “shiny” for machine vision to process.

The project integrates intelligent part reconstruction using the second generation of the Robot Operating System (ROS2) framework to improve 3-D image perception when robots autonomously sand and finish parts. See a demonstration at SwRI’s Booth No. 8214 at Automate in Chicago April 8-11.

“This is a great case study in the benefits and challenges of integrating ROS2 into industrial robotics,” said Matt Robinson, an SwRI manager who supports ROS-Industrial. “It also shows how advanced perception algorithms can enable faster, more reliable scanning of metallic objects.”

The ROS-Industrial consortia leverage ROS to create ROS-I, an industrial form of the open-source software used by major manufacturers around the world.

The latest ROS-I solution uses ROS2 to integrate cameras affixed to a robotic arm, collecting point cloud data at a high frame-rate to create a 3-D output mesh that optimizes path planning. Machine vision cameras and algorithms have historically struggled to render accurate 3-D images of metallic objects due to the “visual noise” that scatters off highly reflective surfaces. This significant challenge limits automation of welding and surface finishing processes in aerospace and automotive manufacturing.

SwRI, in collaboration with ROS-Industrial, overcomes this challenge by integrating truncated sign distance field algorithms that stitch together several images, or point clouds, at a higher rate. The solution uses TrajOpt, or trajectory optimization for motion planning, within the ROS-Industrial Scan-N-Plan framework, to enable real-time trajectory planning from 3-D scan data.

Robinson said the project also underscores the benefits of a ROS-based approach, as this solution is hardware agnostic. The sensors and robot may be changed out with relatively little effort. ROS-Industrial, known for its open-source interoperability, provides manufacturers with standard software drivers for end effectors and fine-motor movement hardware that typically use earlier ROS software.

“This project was ultimately a successful bridge from ROS to ROS2,” Robinson said. “But we know it’s going to be a big task to move toward ROS2 as so many dependent packages and capabilities are still in ROS.”

SwRI initiated the development of ROS-Industrial in 2012 through an SwRI internal research program conducted with industry collaborators. SwRI maintains the ROS-Industrial software repository and manages the ROS-Industrial Consortium.

The ROS-Industrial consortia —with branches in the Americas, Europe, and now Asia—provide cost-shared applied research and development for advanced factory automation. Consortia members drive new capabilities in ROS-I by championing focused technical projects based on their near-term automation requirements.