69 Star 205 Fork 67

daye / job-dispatcher

加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
克隆/下载
贡献代码
同步代码
取消
提示: 由于 Git 不支持空文件夾,创建文件夹后会生成空的 .keep 文件
Loading...
README
AFL-3.0

job-dispatcher

介绍

一个工作流编排,任务调度引擎

Email:783380930@qq.com

欢迎加入QQ讨论群:558192118

GtiHub地址:https://github.com/xuda783380930/job-dispatcher.git

基本模型:

基于事件或者定时生成一个job,每个job由若干个task组成,task之间存在串行或并行的依赖关系

task的具体实现引由客户端(用户自己编程实现),调度引擎只负责按照拓扑顺序发出HTTP信号触发任务

由客户端发出HTTP通知引擎任务任务的完成状态,调度引擎据此继续发出后续调度信号

使用场景:

任务编排,事件驱动或时间驱动的任务调度,如企业级ETL调度等

特点:

调度引擎只做调度和任务编排,不参与具体任务实现和执行,可看作一个HTTP信号发射和接收器,具有极大的适用性,天生支持异构系统,引擎端和任务实现端彻底的解耦。

job-dispatcher是微服务中的一个独立组件,而非作业平台,因此它并不去实现各类任务的运行环境的适配工作,任何实现了配置中子任务HTTP启动接口的程序都可以作为job-dispatche的客户端,无论是何种语言何种数据库的程序。

使用很简单,懂SpringBoot和HTTP就可以了,无需其它领域的知识

相似项目: Linkedin公司推出的Azkaban国产软件TASKCTL流程引擎 Flowable /Activiti ,欢迎大家对比提出意见

软件架构

软件架构说明

1.时间调度引擎:基于Quartz,按时触发对应的Job

2.Job引擎:可注册JobBuilder(包含子任务的依赖关系),Job引擎收到触发信号后,根据builder生成JobBox实例(包含批次时间和任务执行状态) 按照时间顺序JobBox被Put到队列中,队首的JobBox会被消费,即按照拓扑关系依次发出信号,直到所有子任务执行完毕,继续执行下一个 JobBox。

输入图片说明

                                                   调度引擎任务队列样例

通过单点的任务依赖关系形成的Job拓扑图

                                                   任务拓扑图样例

3.使用的框架:JDK1.8,SpringBoot2.0,Quartz,JPA,Echarts,Amazeui,Swagger2

安装教程

1.修改对应的jdbc数据源配置和pom里面的jdbc驱动依赖

2.基于Springboot,用maven打包成Jar后启动即可

使用说明

  1. JDK1.8环境,通过默认端口浏览器访问就可以看到主页

  2. 通过quartz/registerjob接口,传入Json格式的Job配置文件注册任务即可,具体如下

    1.任务端向引擎注册一个定时Job http://ip:port/quartz/register?json={}

    //通过下列的json配置样例

    {

    "jobBoxBuilder": {

     "jobCode": "job1",
    
             "monitorParas":{mobileNos:[ "18621711111","18616152222"]} //短信收信人
    
             "taskBuilderMap": [ //Job内的task组成列表
    
     	{
     		"taskCode": "task1",
    
     		"adapterPara": "http://172.11.33.44/trigger?jobCode=jos1&taskCode=task1", 
    
     		"upstreamTaskCodes": ["task2"], //依赖task2,task2完成后task1才可执行
    
     		"overTime":"60" //超时时间60分钟则报警
     	},
    
     	{
     		"taskCode": "task2",
    
     		"adapterPara": "http://172.11.33.44/trigger? jobCode=jos2&taskCode=task2",
    
     		//"upstreamTaskCodes":[],//不依赖任何任务可以不填该字段
    
                             //"overTime":"60" //可不填
    
     	}
    
     ]

    },

    "jobCronExpression": "0 0/1 11 * * ?", //每天11点每隔一分钟执行一次

    "filterCalendarName": "nonTradingDays" //过滤nonTradingDays日历组

    }

    2.任务端向引擎通知任务执行情况

    UNSTART("未开始", 0),TRIGGERED("正在触发", 1),STARTED("正在执行", 2),NEED_RESTART("需重新执行", 3), PAUSED("已暂停", 4),FINISHED("已完毕", 5);

    http://ip:port/task/call?jobcode=job1&taskcode=task2&status=0

    3.查看job的等待队列的情况,查看正在执行的job的情况(通过前端页面关系图查看)

参与贡献

  1. Fork 本仓库
  2. 新建 Feat_xxx 分支
  3. 提交代码
  4. 新建 Pull Request

码云特技

  1. 使用 Readme_XXX.md 来支持不同的语言,例如 Readme_en.md, Readme_zh.md
  2. 码云官方博客 blog.gitee.com
  3. 你可以 https://gitee.com/explore 这个地址来了解码云上的优秀开源项目
  4. GVP 全称是码云最有价值开源项目,是码云综合评定出的优秀开源项目
  5. 码云官方提供的使用手册 https://gitee.com/help
  6. 码云封面人物是一档用来展示码云会员风采的栏目 https://gitee.com/gitee-stars/
Academic Free License (“AFL”) v. 3.0 This Academic Free License (the "License") applies to any original work of authorship (the "Original Work") whose owner (the "Licensor") has placed the following licensing notice adjacent to the copyright notice for the Original Work: Licensed under the Academic Free License version 3.0 1) Grant of Copyright License. Licensor grants You a worldwide, royalty-free, non-exclusive, sublicensable license, for the duration of the copyright, to do the following: a) to reproduce the Original Work in copies, either alone or as part of a collective work; b) to translate, adapt, alter, transform, modify, or arrange the Original Work, thereby creating derivative works ("Derivative Works") based upon the Original Work; c) to distribute or communicate copies of the Original Work and Derivative Works to the public, under any license of your choice that does not contradict the terms and conditions, including Licensor’s reserved rights and remedies, in this Academic Free License; d) to perform the Original Work publicly; and e) to display the Original Work publicly. 2) Grant of Patent License. Licensor grants You a worldwide, royalty-free, non-exclusive, sublicensable license, under patent claims owned or controlled by the Licensor that are embodied in the Original Work as furnished by the Licensor, for the duration of the patents, to make, use, sell, offer for sale, have made, and import the Original Work and Derivative Works. 3) Grant of Source Code License. The term "Source Code" means the preferred form of the Original Work for making modifications to it and all available documentation describing how to modify the Original Work. Licensor agrees to provide a machine-readable copy of the Source Code of the Original Work along with each copy of the Original Work that Licensor distributes. Licensor reserves the right to satisfy this obligation by placing a machine-readable copy of the Source Code in an information repository reasonably calculated to permit inexpensive and convenient access by You for as long as Licensor continues to distribute the Original Work. 4) Exclusions From License Grant. Neither the names of Licensor, nor the names of any contributors to the Original Work, nor any of their trademarks or service marks, may be used to endorse or promote products derived from this Original Work without express prior permission of the Licensor. Except as expressly stated herein, nothing in this License grants any license to Licensor’s trademarks, copyrights, patents, trade secrets or any other intellectual property. No patent license is granted to make, use, sell, offer for sale, have made, or import embodiments of any patent claims other than the licensed claims defined in Section 2. No license is granted to the trademarks of Licensor even if such marks are included in the Original Work. Nothing in this License shall be interpreted to prohibit Licensor from licensing under terms different from this License any Original Work that Licensor otherwise would have a right to license. 5) External Deployment. The term "External Deployment" means the use, distribution, or communication of the Original Work or Derivative Works in any way such that the Original Work or Derivative Works may be used by anyone other than You, whether those works are distributed or communicated to those persons or made available as an application intended for use over a network. As an express condition for the grants of license hereunder, You must treat any External Deployment by You of the Original Work or a Derivative Work as a distribution under section 1(c). 6) Attribution Rights. You must retain, in the Source Code of any Derivative Works that You create, all copyright, patent, or trademark notices from the Source Code of the Original Work, as well as any notices of licensing and any descriptive text identified therein as an "Attribution Notice." You must cause the Source Code for any Derivative Works that You create to carry a prominent Attribution Notice reasonably calculated to inform recipients that You have modified the Original Work. 7) Warranty of Provenance and Disclaimer of Warranty. Licensor warrants that the copyright in and to the Original Work and the patent rights granted herein by Licensor are owned by the Licensor or are sublicensed to You under the terms of this License with the permission of the contributor(s) of those copyrights and patent rights. Except as expressly stated in the immediately preceding sentence, the Original Work is provided under this License on an "AS IS" BASIS and WITHOUT WARRANTY, either express or implied, including, without limitation, the warranties of non-infringement, merchantability or fitness for a particular purpose. THE ENTIRE RISK AS TO THE QUALITY OF THE ORIGINAL WORK IS WITH YOU. This DISCLAIMER OF WARRANTY constitutes an essential part of this License. No license to the Original Work is granted by this License except under this disclaimer. 8) Limitation of Liability. Under no circumstances and under no legal theory, whether in tort (including negligence), contract, or otherwise, shall the Licensor be liable to anyone for any indirect, special, incidental, or consequential damages of any character arising as a result of this License or the use of the Original Work including, without limitation, damages for loss of goodwill, work stoppage, computer failure or malfunction, or any and all other commercial damages or losses. This limitation of liability shall not apply to the extent applicable law prohibits such limitation. 9) Acceptance and Termination. If, at any time, You expressly assented to this License, that assent indicates your clear and irrevocable acceptance of this License and all of its terms and conditions. If You distribute or communicate copies of the Original Work or a Derivative Work, You must make a reasonable effort under the circumstances to obtain the express assent of recipients to the terms of this License. This License conditions your rights to undertake the activities listed in Section 1, including your right to create Derivative Works based upon the Original Work, and doing so without honoring these terms and conditions is prohibited by copyright law and international treaty. Nothing in this License is intended to affect copyright exceptions and limitations (including “fair use” or “fair dealing”). This License shall terminate immediately and You may no longer exercise any of the rights granted to You by this License upon your failure to honor the conditions in Section 1(c). 10) Termination for Patent Action. This License shall terminate automatically and You may no longer exercise any of the rights granted to You by this License as of the date You commence an action, including a cross-claim or counterclaim, against Licensor or any licensee alleging that the Original Work infringes a patent. This termination provision shall not apply for an action alleging patent infringement by combinations of the Original Work with other software or hardware. 11) Jurisdiction, Venue and Governing Law. Any action or suit relating to this License may be brought only in the courts of a jurisdiction wherein the Licensor resides or in which Licensor conducts its primary business, and under the laws of that jurisdiction excluding its conflict-of-law provisions. The application of the United Nations Convention on Contracts for the International Sale of Goods is expressly excluded. Any use of the Original Work outside the scope of this License or after its termination shall be subject to the requirements and penalties of copyright or patent law in the appropriate jurisdiction. This section shall survive the termination of this License. 12) Attorneys’ Fees. In any action to enforce the terms of this License or seeking damages relating thereto, the prevailing party shall be entitled to recover its costs and expenses, including, without limitation, reasonable attorneys' fees and costs incurred in connection with such action, including any appeal of such action. This section shall survive the termination of this License. 13) Miscellaneous. If any provision of this License is held to be unenforceable, such provision shall be reformed only to the extent necessary to make it enforceable. 14) Definition of "You" in This License. "You" throughout this License, whether in upper or lower case, means an individual or a legal entity exercising rights under, and complying with all of the terms of, this License. For legal entities, "You" includes any entity that controls, is controlled by, or is under common control with you. For purposes of this definition, "control" means (i) the power, direct or indirect, to cause the direction or management of such entity, whether by contract or otherwise, or (ii) ownership of fifty percent (50%) or more of the outstanding shares, or (iii) beneficial ownership of such entity. 15) Right to Use. You may use the Original Work in all ways not otherwise restricted or conditioned by this License or by law, and Licensor promises not to interfere with or be responsible for such uses by You. 16) Modification of This License. This License is Copyright © 2005 Lawrence Rosen. Permission is granted to copy, distribute, or communicate this License without modification. Nothing in this License permits You to modify this License as applied to the Original Work or to Derivative Works. However, You may modify the text of this License and copy, distribute or communicate your modified version (the "Modified License") and apply it to other original works of authorship subject to the following conditions: (i) You may not indicate in any way that your Modified License is the "Academic Free License" or "AFL" and you may not use those names in the name of your Modified License; (ii) You must replace the notice specified in the first paragraph above with the notice "Licensed under <insert your license name here>" or with a notice of your own that is not confusingly similar to the notice in this License; and (iii) You may not claim that your original works are open source software unless your Modified License has been approved by Open Source Initiative (OSI) and You comply with its license review and certification process.

简介

一个国产的基于事件的流程编排和调度引擎, 优势是自动生成有依赖关系的任务拓扑关系图, 并展示子任务的执行状态和时序图 展开 收起
Java 等 4 种语言
AFL-3.0
取消

发行版

暂无发行版

贡献者

全部

近期动态

加载更多
不能加载更多了
Java
1
https://gitee.com/daye_daye/job-dispatcher.git
git@gitee.com:daye_daye/job-dispatcher.git
daye_daye
job-dispatcher
job-dispatcher
master

搜索帮助