The present invention relates to a mixed reality (MR) monitoring system using a wearable device, which comprises: a drone having a gimbal camera which captures a real image of a geofencing area when flying autonomously; an object detection server extracting an object from the real image transmitted by the drone through a deep learning method and displaying the extracted object to provide an object displaying image; an MR display device displaying the object displaying image and a macroscopic image together; a wearable controller providing an operation control signal for controlling operation of the gimbal camera; and a transmission board transmitting the operation control signal to the drone, thereby allowing the geofencing area to be monitored in real time and enabling a practical control system to be established to take immediate actions.

    본 발명은 웨어러블 기기를 이용한 혼합현실 모니터링 시스템에 관한 것으로, 자율 주행 중 지오펜싱 지역에 대한 실제영상을 촬영하는 짐벌카메라를 구비하는 드론과, 상기 드론으로부터 전송되는 실제영상에서 딥러닝 방식으로 객체를 추출하고, 상기 추출된 객체를 표시하여 객체표시영상을 제공하는 객체검출서버와, 상기 객체표시영상과 육안이미지를 함께 디스플레이하는 혼합현실디스플레이장치와, 상기 짐벌카메라의 동작을 제어하는 동작제어신호를 제공하는 웨어러블컨트롤러와, 상기 동작제어신호를 상기 드론으로 전송하는 송신보드를 포함함으로써, 지오펜싱 지역에 대한 실시간 모니터링이 가능할 뿐만 아니라 즉각 대처 가능한 실용적인 관제 시스템을 구축할 수 있다.


    Access

    Download


    Export, share and cite



    Title :

    MIXED REALITY MONITERING SYSTEM USING WEARABLE DEVICE


    Additional title:

    웨어러블 기기를 이용한 혼합현실 모니터링 시스템


    Contributors:
    SHIN SOO YOUNG (author) / LEE SEUNG HO (author) / KWON YONG BI (author) / SEO JONG WAN (author)

    Publication date :

    2022-03-23


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Korean


    Classification :

    IPC:    G02B Optische Elemente, Systeme oder Geräte , OPTICAL ELEMENTS, SYSTEMS, OR APPARATUS / B64C AEROPLANES , Flugzeuge / B64D Ausrüstung für Flugzeuge , EQUIPMENT FOR FITTING IN OR TO AIRCRAFT / G03B APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM , Geräte oder Anordnungen zum Aufnehmen, Projizieren oder Betrachten von Fotografien / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen



    rigid bar monitering system

    European Patent Office | 2020

    Free access

    RIGID BAR MONITERING SYSTEM

    BAE SANG JOON / JANG KWANG DONG | European Patent Office | 2015

    Free access

    SYSTEM FOR REMOTE MONITERING RADAR

    LEE HEE YONG | European Patent Office | 2015

    Free access

    SYSTEM FOR REMOTE MONITERING RADAR

    European Patent Office | 2016

    Free access

    SYSTEM AND METHOD FOR MONITERING DRIVER

    PARK GE O | European Patent Office | 2022

    Free access