a full big data flow system involving online data collection, real time computation, data output
______ _ | ____| | ______| |__ | | _____ __ /_ _ _| __| | |/ _ \ \ /\ / / || ||_| | | | (_) \ V V / |/ \/|_| |_|\___/ \_/\_/
cd piflow-core mvn test -DskipTests -PstartServer
Since piflow-shell depends on piflow-core, so install piflow-core project first:
cd piflow-core mvn clean install -DskipTests
Then, run mvn with following arguments:
cd ./piflow-shell mvn clean test -PrunShell
Now, piflow-shell will be started in which you can type commands:
πFlow> SeqAsSource(1 to 1000) > DoMap[Int, Int](_ + 1) > ConsoleSink() πFlow> res0!
:quit to quit the shell.
BatchFlowTest: tests batch flow building and execution https://gitee.com/bluejoe/piflow/blob/master/piflow-core/src/test/scala/cn/piflow/flow/BatchFlowTest.scala
JobManagerTest: tests job management functions, including list, kill, pause operations https://gitee.com/bluejoe/piflow/blob/master/piflow-core/src/test/scala/cn/piflow/flow/JobManagerTest.scala
DslTest: tests PiFlow DSL https://gitee.com/bluejoe/piflow/blob/master/piflow-core/src/test/scala/cn/piflow/flow/DslTest.scala
ShellRunner: starts a PiFlow shell https://gitee.com/bluejoe/piflow/blob/master/piflow-shell/src/main/scala/cn/piflow/shell/ShellRunner.scala