Bin Picking of Reflective Steel Parts using a Dual-Resolution Convolutional Neural Network Trained in a Simulated Environment
Dyrstad, Jonatan Sjølund; Bakken, Marianne; Grøtli, Esten Ingar; Schulerud, Helene; Mathiassen, John Reidar Bartle
Journal article, Peer reviewed
Accepted version
Permanent lenke
http://hdl.handle.net/11250/2603749Utgivelsesdato
2018-12-12Metadata
Vis full innførselSamlinger
- Publikasjoner fra CRIStin - SINTEF Ocean [1312]
- SINTEF Ocean [1384]
Originalversjon
2018 IEEE International Conference on Robotics and Biomimetrics (ROBIO) 10.1109/ROBIO.2018.8664766Sammendrag
We consider the case of robotic bin picking of reflective steel parts, using a structured light 3D camera as a depth imaging device. In this paper, we present a new method for bin picking, based on a dual-resolution convolutional neural network trained entirely in a simulated environment. The dualresolution network consists of a high resolution focus network to compute the grasp and a low resolution context network to avoid local collisions.The reflectivity of the steel parts result in depth images that have a lot of missing data. To take this into account, training of the neural net is done by domain randomization on a large set of synthetic depth images that simulate the missing data problems of the real depth images. We demonstrate both in simulation and in a real-world test that our method can perform bin picking of reflective steel parts