The invention belongs to the technical field of augmented reality, and discloses a forklift operation assisting method and system based on augmented reality, and the method comprises the steps: collecting an internal environment image in a cockpit, recognizing the internal environment image, obtaining a recognition result, and marking the recognition result on the internal environment image to generate a first augmented display image; matching corresponding prompt information according to the current operation information of the forklift and the identification result, and sending the prompt information to a driver; an external environment image of the forklift is collected, parameters of all objects in the external environment image are extracted and determined, and the parameters of all the objects are marked on the external environment image to generate a second enhanced display image; and acquiring external navigation data of the forklift, generating a virtual state display image based on the external navigation data, and overlapping the virtual state display image on the second augmented display image to generate a third augmented reality image. According to the technical scheme of the invention, the method can reduce the time spent by a driver on the operation task, and improves the driving experience.

    本发明属于增强现实技术领域,公开了一种基于增强现实的叉车操作辅助方法及系统,包括:采集驾驶舱内的内部环境图像,对内部环境图像进行识别并获取识别结果,将识别结果标注在内部环境图像上生成第一增强显示图像;根据叉车当前的操作信息和识别结果匹配相对应的提示信息发送给驾驶员;采集叉车的外部环境图像,提取并确定外部环境图像中各个对象的参数,将每个对象的参数标注在外部环境图像上生成第二增强显示图像;获取叉车的外部导航数据,基于外部导航数据生成虚拟状态显示图像,将虚拟状态显示图像叠加在第二增强显示图像上生成第三增强现实图像。根据本发明技术方案,可减少驾驶员花费在操作任务上的时间,提升驾乘体验感。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Forklift operation assisting method and system based on augmented reality


    Weitere Titelangaben:

    一种基于增强现实的叉车操作辅助方法及系统


    Beteiligte:
    PAN JIE (Autor:in) / LI FEI (Autor:in) / YAO XIN (Autor:in)

    Erscheinungsdatum :

    06.09.2024


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G06V / B66F HOISTING, LIFTING, HAULING, OR PUSHING, NOT OTHERWISE PROVIDED FOR, e.g. DEVICES WHICH APPLY A LIFTING OR PUSHING FORCE DIRECTLY TO THE SURFACE OF A LOAD , Hub-, Verhol- oder Schubvorrichtungen, soweit nicht anderweitig vorgesehen, z.B. Vorrichtungen mit unmittelbarer Krafteinwirkung auf die Last / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    FORKLIFT WORK ASSISTING SYSTEM

    FUJIMORI HIROYUKI | Europäisches Patentamt | 2017

    Freier Zugriff


    Augmented reality method and device for assisting driving

    WANG CHUN / LI WEIMING / LIU ZHIHUA et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Augmented reality method and device for assisting driving

    CHEN QI | Europäisches Patentamt | 2023

    Freier Zugriff

    Industrial forklift attachment for assisting tire assembly

    XIANG WEIFENG / WANG HENGFEI / ZHONG CHUANHAO et al. | Europäisches Patentamt | 2025

    Freier Zugriff