2019 · 28 citations · 23 references
EngineeringComputer ScienceRobotics EngineeringComputer VisionMobile RoboticsRoboticsImpedance ControlRobot Control ArchitectureRobot ManipulationRobot ManipulatorsRobotic VisionRobotics AutomationCartesian Impedance ControlConvolutional Neural Network DetectionConvolutional Neural Network SegmentationConvolutional Neural NetworksDoor HandlesHandlesObject Detection For RoboticsRgb Color Space
This paper presents a holistic approach for door opening with a cartesian impedance controlled mobile robot, a KUICA KMR iiwa. Based on a given map of the environment, the robot autonomously detects the door handle, opens doors and traverses doorways without knowledge of a door model or the door's geometry. The door handle detection uses a convolutional neural network (CNN)-based architecture to obtain the handle's bounding box in a RGB image that works robustly for various handle shapes and colors. We achieve a detection rate of 100% for an evaluation set of 38 different door handles, by always selecting for highest confidence score. Registered depth data segmentation defines the door plane to construct a handle coordinate frame. We introduce a control structure based on the task frame formalism that uses the handle frame for reference in an outer loop for the manipulator's impedance controller. It runs in soft real-time on an external computer with approximately 20 Hz since access to inner controller loops is not available for the KMR iiwa. With the approach proposed in this paper, the robot successfully opened and traversed for 22 out of 25 trials at five different doors.
23
Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors
Jonathan Huang, Vivek Rathod, Chen Sun et al. · 2017 · 2.7K citations