Towards Autonomous Robotic Assembly: Using Combined Visual and Tactile Sensing for Adaptive Task Execution

Korbinian Nottensteiner, Arne Sachtler, Alin Albu‐Schäffer

Journal of Intelligent & Robotic Systems · 2021 · 33 citations · 52 references

DOIFull text

Open access

Concepts

TL;DR

Robotic assembly is typically performed in static settings with parts fixed by holders, yet few studies address moving parts, and autonomous robots operating in dynamic environments could increase flexibility and reduce product‑specific implementation effort. This paper proposes a general approach for autonomous robotic assembly that fuses visual and intrinsic tactile sensing to continuously track parts. The method applies to peg‑in‑hole tasks, employing a tilt‑and‑align strategy with a Cartesian impedance controller and an adaptive path executor within a Bayesian sensor‑fusion framework. Experimental results with multiple part combinations show that object‑centric assembly skills guided by estimated poses can successfully handle occlusions and perform peg‑in‑hole tasks.

Abstract

Abstract Robotic assembly tasks are typically implemented in static settings in which parts are kept at fixed locations by making use of part holders. Very few works deal with the problem of moving parts in industrial assembly applications. However, having autonomous robots that are able to execute assembly tasks in dynamic environments could lead to more flexible facilities with reduced implementation efforts for individual products. In this paper, we present a general approach towards autonomous robotic assembly that combines visual and intrinsic tactile sensing to continuously track parts within a single Bayesian framework. Based on this, it is possible to implement object-centric assembly skills that are guided by the estimated poses of the parts, including cases where occlusions block the vision system. In particular, we investigate the application of this approach for peg-in-hole assembly. A tilt-and-align strategy is implemented using a Cartesian impedance controller, and combined with an adaptive path executor. Experimental results with multiple part combinations are provided and analyzed in detail.

References

52