The invention discloses a vehicle cabin screen display information acquisition method, which comprises the following steps: analyzing a text control and an icon control in a screen display content picture, including information of text control content and information of control position; adding labels to the text control and the icon control respectively; analyzing an association relationship between the icon control and the text control according to the control position information and the label information; acquiring user voice request information corresponding to the current screen display state; generating voice text information according to the user voice request information; analyzing an action and a main body in the voice text information; obtaining a user instruction action and a screen operation main body according to the action and the main body in the analyzed voice text information; searching a control according to the user instruction action and the screen operation main body; according to the retrieval control label, taking the matched icon control position coordinate as a touch click interface; and simulating a screen click operation according to the touch click interface.

    本申请公开了一种车辆座舱屏显信息获取方法,包括:解析所述屏显内容图片中的文本控件和图标控件,包括文本控件内容的信息和控件位置的信息;对所述文本控件和所述图标控件分别添加标签;根据所述控件位置信息和标签信息,分析所述图标控件与所述文本控件的关联关系;对应当前屏幕显示状态,获取用户语音请求信息;根据所述用户语音请求信息,生成语音文本信息;解析所述语音文本信息中动作和主体;根据解析所述语音文本信息中的动作和主体,获取用户指令动作和屏幕操作主体;根据所述用户指令动作和所述屏幕操作主体检索控件;根据所述检索控件标签,将匹配的所述图标控件位置坐标作为触摸点击接口;根据所述触摸点击接口,模拟对屏幕点击操作。


    Access

    Download


    Export, share and cite



    Title :

    Vehicle cabin screen display information acquisition method and device, electronic equipment and storage medium


    Additional title:

    车辆座舱屏显信息获取方法、装置、电子设备及存储介质


    Contributors:
    LYU GUILIN (author) / YUAN LIPENG (author)

    Publication date :

    2024-08-09


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06V / B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    Cabin display screen adjusting method, device and equipment and storage medium

    ZOU ZHILING / JIN DING / ZHU JIAN | European Patent Office | 2024

    Free access

    Vehicle cabin time display method and device, electronic equipment and medium

    LEI HONGWEI | European Patent Office | 2024

    Free access

    Display method and device of vehicle display screen, electronic equipment and storage medium

    ZHU HONGHAI / QI RONGJIA / LI MINGQUAN et al. | European Patent Office | 2025

    Free access


    Cabin screen control method and device, computer equipment and storage medium

    YANG YONGJI | European Patent Office | 2020

    Free access