The invention discloses a man-machine interaction method and device, related equipment and a computer program product, and relates to the technical field of artificial intelligence. The man-machine interaction method comprises the steps that an interaction problem proposed by a target user in a vehicle is acquired, an image of the target user is acquired through shooting of a first camera in the vehicle, sight line direction information of the target user is determined according to the image, and therefore the intention and requirements of the user can be better understood. The sight direction information of a target user is determined by utilizing the first camera, the visual angle of the second camera is adjusted according to the sight direction information, and the out-of-vehicle image shot by the second camera is obtained, so that the system can see an object or scene concerned by the user, and the interaction problem of the out-of-vehicle image and the user is solved by calling the multi-modal large model. According to the method, deeper information processing and understanding can be carried out, and the corresponding reply result is generated according to the image outside the vehicle by understanding the interaction problem of the user, so that the reply is more accurate and related, and the interaction efficiency and quality are improved.
本申请公开了一种人机交互方法、装置、相关设备及计算机程序产品,涉及人工智能技术领域。其中人机交互方法包括,通过获取车内目标用户提出的交互问题,利用车内的第一摄像头拍摄来获取目标用户的影像,根据影像确定目标用户的视线方向信息,从而能够更好地理解用户的意图和需求。利用第一摄像头确定目标用户的视线方向信息,并据此调整第二摄像头的视角,并获取第二摄像头拍摄的车外图像,使得系统能够看到用户所关注的对象或场景,并通过调用多模态大模型,结合车外图像和用户的交互问题,能够进行更深层次的信息处理和理解,通过理解用户的交互问题,根据车外图像生成对应的回复结果,使得回复更加准确和相关,提高了交互的效率和质量。
Human-computer interaction method and device, related equipment and computer program product
人机交互方法、装置、相关设备及计算机程序产品
2025-02-14
Patent
Electronic Resource
Chinese
European Patent Office | 2024
|Interaction method, computer equipment and program product
European Patent Office | 2024
|Interaction method and device, computing equipment and computer program product
European Patent Office | 2024
|European Patent Office | 2024
|Interaction method and device, computer equipment, storage medium and program product
European Patent Office | 2025
|