a full big data flow system involving online data collection, real time computation, data output
______ _
| ____| |
______| |__ | | _____ __
/_ _ _| __| | |/ _ \ \ /\ / /
|| ||_| | | | (_) \ V V /
|/ \/|_| |_|\___/ \_/\_/
cd piflow-core
mvn test -DskipTests -PstartServer
Since piflow-shell depends on piflow-core, so install piflow-core project first:
cd piflow-core
mvn clean install -DskipTests
Then, run mvn with following arguments:
cd ./piflow-shell
mvn clean test -PrunShell
Now, piflow-shell will be started in which you can type commands:
πFlow> SeqAsSource(1 to 1000) > DoMap[Int, Int](_ + 1) > ConsoleSink()
πFlow> res0!
type :quit
to quit the shell.
BatchFlowTest: tests batch flow building and execution https://gitee.com/bluejoe/piflow/blob/master/piflow-core/src/test/scala/cn/piflow/flow/BatchFlowTest.scala
JobManagerTest: tests job management functions, including list, kill, pause operations https://gitee.com/bluejoe/piflow/blob/master/piflow-core/src/test/scala/cn/piflow/flow/JobManagerTest.scala
DslTest: tests PiFlow DSL https://gitee.com/bluejoe/piflow/blob/master/piflow-core/src/test/scala/cn/piflow/flow/DslTest.scala
ShellRunner: starts a PiFlow shell https://gitee.com/bluejoe/piflow/blob/master/piflow-shell/src/main/scala/cn/piflow/shell/ShellRunner.scala
此处可能存在不合适展示的内容,页面不予展示。您可通过相关编辑功能自查并修改。
如您确认内容无涉及 不当用语 / 纯广告导流 / 暴力 / 低俗色情 / 侵权 / 盗版 / 虚假 / 无价值内容或违法国家有关法律法规的内容,可点击提交进行申诉,我们将尽快为您处理。
1. 开源生态
2. 协作、人、软件
3. 评估模型