Artificial Intelligence (AI) is an enabling technology in the context of Industry 4.0. In particular, the automotive sector is among those who can benefit most of the use of AI in conjunction with advanced vision techniques. The scope of this work is to integrate deep learning algorithms in an industrial scenario involving a robotic Peg-in-Hole task. More in detail, we focus on a scenario where a human operator manually positions a carbon fiber automotive part in the workspace of a 7 Degrees of Freedom (DOF) manipulator. To cope with the uncertainty on the relative position between the robot and the workpiece, we adopt a three stage strategy. The first stage concerns the Three-Dimensional (3D) reconstruction of the workpiece using a registration algorithm based on the Iterative Closest Point (ICP) paradigm. Such a procedure is integrated with a semantic image segmentation neural network, which is in charge of removing the background of the scene to improve the registration. The adoption of such network allows to reduce the registration time of about 28.8%. In the second stage, the reconstructed surface is compared with a Computer Aided Design (CAD) model of the workpiece to locate the holes and their axes. In this stage, the adoption of a Convolutional Neural Network (CNN) allows to improve the holes’ position estimation of about 57.3%. The third stage concerns the insertion of the peg by implementing a search phase to handle the remaining estimation errors. Also in this case, the use of the CNN reduces the search phase duration of about 71.3%. Quantitative experiments, including a comparison with a previous approach without both the segmentation network and the CNN, have been conducted in a realistic scenario. The results show the effectiveness of the proposed approach and how the integration of AI techniques improves the success rate from 84.5% to 99.0%.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Vision-enhanced Peg-in-Hole for automotive body parts using semantic image segmentation and object detection



    Erscheinungsdatum :

    01.01.2024



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Semantic image segmentation for information presentation in enhanced vision

    Vygolov, Oleg V. / Gorbatsevich, Vladimir S. / Kostromov, Nikita A. et al. | SPIE | 2017


    SEMANTIC SEGMENTATION ON AUTOMOTIVE RADAR MAPS

    Prophet, Robert / Li, Gang / Sturm, Christian et al. | British Library Conference Proceedings | 2019


    Semantic Segmentation on Automotive Radar Maps

    Prophet, Robert / Li, Gang / Sturm, Christian et al. | IEEE | 2019


    Research on Object Detection and Location Using Semantic Segmentation

    Zhu, Huijie / Cai, Yan / Guo, Yingchun et al. | TIBKAT | 2022


    Research on Object Detection and Location Using Semantic Segmentation

    Zhu, Huijie / Cai, Yan / Guo, Yingchun et al. | Springer Verlag | 2021