The invention discloses a strain clamp defect unmanned aerial vehicle detection method fused with multi-modal data, which comprises the following steps: establishing a data set which comprises an X-ray image, an ultrasonic image and a hydraulic strain clamp image, and constructing a strain clamp defect detection model fused with the multi-modal data; inputting the data set into a strain clamp defect detection model fused with the multi-modal data for training to obtain a trained strain clamp defect detection model fused with the multi-modal data, inputting the X-ray image and the ultrasonic image into the trained strain clamp defect detection model fused with the multi-modal data at the same time for processing to obtain a Grad-CAM heat map, and obtaining the strain clamp defect detection model fused with the multi-modal data. And processing the Grad-CAM heat map into the size of a hydraulic strain clamp map, carrying out fusion imaging, and displaying and outputting a detected defect type and a judgment position on the fusion imaging. According to the invention, intelligent defect detection of the hydraulic strain clamp is realized by fusing the ultrasonic image and the X-ray image.

    本发明公开了一种融合多模态数据的耐张线夹缺陷无人机检测方法,包括以下步骤,建立数据集,数据集包含X光图像、超声图像和液压型耐张线夹图,构建融合多模态数据的耐张线夹缺陷检测模型;将数据集输入融合多模态数据的耐张线夹缺陷检测模型进行训练,获得训练后的融合多模态数据的耐张线夹缺陷检测模型,将X光图像和超声图像同时输入到训练后的融合多模态数据的耐张线夹缺陷检测模型中进行处理,获得Grad‑CAM热图,将Grad‑CAM热图处理为液压型耐张线夹图的大小并融合成像,在融合成像上显示输出检测的缺陷类型及判断位置。本发明通过融合超声图像和X光图像实现液压型耐张线夹缺陷智能检测。


    Access

    Download


    Export, share and cite



    Title :

    Multi-modal data fused strain clamp defect unmanned aerial vehicle detection method


    Additional title:

    一种融合多模态数据的耐张线夹缺陷无人机检测方法


    Contributors:
    WU SHIYOU (author) / LIU ZHOU (author) / ZHOU FUWEN (author) / SHANG WENHUI (author) / FU LIXIANG (author) / LI FAN (author) / LI MING (author) / ZHANG ZHENG (author) / ZENG CHUN (author) / FU SHIXUN (author)

    Publication date :

    2025-04-25


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06V / B64U / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G01N Untersuchen oder Analysieren von Stoffen durch Bestimmen ihrer chemischen oder physikalischen Eigenschaften , INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES




    FPV auxiliary mounting system for strain clamp unmanned aerial vehicle ray detection

    YUE XIANQIANG / WANG CHI / ZHANG HUA et al. | European Patent Office | 2022

    Free access

    Unmanned aerial vehicle propeller clamp device

    HUANG HAIJUN / WU XIAOGUANG / WU MIN et al. | European Patent Office | 2024

    Free access

    Pipeline defect detection method based on unmanned aerial vehicle spectrum and unmanned aerial vehicle

    WANG YANFEI / LIU LIBO / HU QIANG | European Patent Office | 2023

    Free access

    Unmanned aerial vehicle for wire clamp X-ray detection

    WANG WEI / XU XIAOBIN / ZHAO XI et al. | European Patent Office | 2021

    Free access