The invention belongs to the technical field of platform monitoring, and particularly relates to a big data computing platform monitoring system. A data acquisition module is established on a big dataplatform, acquires monitoring information such as distributed file system information, computing resource use information and operation state information in various modes, performs analytic statistics on the operation state information, and stores the operation state information into a database; a data processing module is used for processing and analyzing the operation information of the Hadoopcomponent so as to obtain the operation state monitoring information of the big data platform; the data storage module comprises a command execution database, an execution information real-time database, a real-time operation database, a monitoring information database and a statistical information database; the data display module has the main functions of platform management, resource monitoringinformation display, operation monitoring information display and abnormity alarm. And the alarm module is used for alarming the monitored abnormal data and sending alarm information to an abnormal LED display panel administrator.

    本发明属于平台监控技术领域,具体的说是一种大数据计算平台监控系统;数据采集模块建立在大数据平台上,以多种方式采集监控信息,如分布式文件系统信息、计算资源使用信息和作业运行状态信息,并对这些运行状态信息进行解析统计,存放至数据库中;数据处理模块通过对Hadoop组件的运行信息进行处理和分析,从而获取大数据平台运行状态监控信息;数据存储模块包括命令执行数据库、执行信息实时数据库、实时作业数据库、监控信息数据库和统计信息数据库;数据展示模块的主要功能在与对平台管理、资源监控信息展示、作业监控信息展示和异常报警;报警模块用于对监控到的异常数据进行报警,同时还能够对出现异常的LED显示板管理员发送报警信息。


    Access

    Download


    Export, share and cite



    Title :

    Big data computing platform monitoring system


    Additional title:

    一种大数据计算平台监控系统


    Contributors:
    XU LIANGYUN (author) / WANG BINBIN (author)

    Publication date :

    2020-11-13


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B66F HOISTING, LIFTING, HAULING, OR PUSHING, NOT OTHERWISE PROVIDED FOR, e.g. DEVICES WHICH APPLY A LIFTING OR PUSHING FORCE DIRECTLY TO THE SURFACE OF A LOAD , Hub-, Verhol- oder Schubvorrichtungen, soweit nicht anderweitig vorgesehen, z.B. Vorrichtungen mit unmittelbarer Krafteinwirkung auf die Last / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    Traffic monitoring platform system based on stream computing technology

    DUAN DONGDONG | European Patent Office | 2023

    Free access

    Computing platform and data processing method

    ZHANG MINGFEI / FENG LIANGSHAN | European Patent Office | 2023

    Free access

    PLATFORM MONITORING SYSTEM

    MARUBAYASHI ISAO | European Patent Office | 2016

    Free access

    PLATFORM MONITORING SYSTEM

    EGAMI TSUKASA / MATSUBARA TATSUYA | European Patent Office | 2023

    Free access

    COMPUTING PLATFORM FOR VEHICLE DATA COLLECTION AND ANALYSIS

    JOHANSSON KRISTER / BÖRJESSON ANDERS | European Patent Office | 2023

    Free access