ISSN 1671-1092 CN 33-1260/TK

大坝与安全 ›› 2024 ›› Issue (1): 25-31.

• 监测技术 • 上一篇    下一篇

基于分布式任务调度技术对在线监控系统自动化任务的优化研究

孔 华   

  1. 中国电建集团华东勘测设计研究院有限公司,浙江杭州,311122
  • 收稿日期:2023-09-07 出版日期:2024-02-20 发布日期:2024-06-21
  • 作者简介:孔 华(1992—),男,河南信阳人,工程师,从事大坝安全在线监控系统的开发工作。

Optimization of automated tasks in online monitoring systems based on distributed task scheduling technology

KONG Hua   

  1. PowerChina Huadong Engineering Corporation Limited
  • Received:2023-09-07 Online:2024-02-20 Published:2024-06-21

摘要: 目前水电站大坝运行安全在线监控系统中自动化任务涉及数据处理、信息推送、消息通知和系统监控等 多个模块,各模块的自动化任务独立管理维护,存在执行标准不统一、记录不规范及管理混乱等问题,导致自动化 任务执行效率低,运维难度大。为解决这一问题,系统引入了PowerJob分布式任务调度平台,充分利用其集中管 理、可视化、高可靠性和在线日志追溯等优势对自动化任务进行优化改造,通过PowerJob实现了任务集中配置、集 中调度、多节点并行执行、工作流编排和实时监控等功能,并进行了针对性的扩展开发以满足大坝监控系统的自 动化任务执行需求,提高了自动化任务的执行效率和运维便利性。

关键词: 自动化, 分布式调度, PowerJob, MapReduce, 大坝监控系统

Abstract: Currently,the automated tasks involved in the online safety monitoring system for hydropower dams include data processing,information pushing,message notification,and system monitoring across multiple modules.The automated tasks in each module are independently maintained,resulting in inconsistencies in execution standards,unstandardized recording and poor management which would lead to low task execution efficiency as well as difficult operations and maintenance.To solve this problem,the PowerJob distributed task scheduling platform is introduced to optimize and reform the automated tasks by taking full advantage of its centralized management,visualization,high reliability,and online log tracking capabilities. PowerJob enables centralized configuration,centralized scheduling,multi-node parallel execution,workflow arrangement and real-time monitoring for the automated tasks.Moreover,it is customized and extended to meet the execution requirements of automated tasks in the dam monitoring system,which improves the execution efficiency and convenience in operation and maintenance of the automated tasks.

Key words: automation, distributed scheduling, PowerJob, MapReduce, dam safety monitoring system

中图分类号: