# Streamis **Repository Path**: WeBank/Streamis ## Basic Information - **Project Name**: Streamis - **Description**: Streamis 是 微众银行 联合 天翼云、仙翁科技 和 萨摩耶云 联合共建的流式应用开发管理系统。 基于 DataSphere Studio 的框架化能力，以及底层对接 Linkis 的 Flink 引擎，让用户低成本完成流式应用的开发、调试、发布和生产管理。 - **Primary Language**: Unknown - **License**: Apache-2.0 - **Default Branch**: main - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 55 - **Forks**: 17 - **Created**: 2022-03-08 - **Last Updated**: 2024-09-21 ## Categories & Tags **Categories**: erp **Tags**: None ## README # Streamis [![License](https://img.shields.io/badge/license-Apache%202-4EB1BA.svg)](https://www.apache.org/licenses/LICENSE-2.0.html) English | [中文](README-ZH.md) ## Introduction        Streamis is an jointed development project for Streaming application development and management established by WeBank, CtYun, Samoyed Financial Cloud and XianWeng Technology.        Based on the framework capabilities of [DataSphere Studio](https://github.com/WeBankFinTech/DataSphereStudio) and the underlying docking [Linkis](https://github.com/apache/incubator-linkis/blob/master/README.md) 's **Flink engine** allows users to complete the development, debugging, release and production management of streaming applications at low cost.        In the future, it is also planned to use a workflow-style graphical drag-and-drop development experience, and the streaming application will be based on the Source node, The Dimension node, Transform node, Sink node and [Visualis](https://github.com/WeBankFinTech/Visualis) nodes are connected in series to form a streaming workflow, allowing users to complete the development of streaming applications at a lower learning cost. Debug and release. ---- ## Core features #### 1. Based on DSS and DSS-Scriptis, to create a leading streaming application development management system.        With Flink as the underlying computation engine, based on the architectural design pattern of the isolation between the development center and the production center, it completely isolates development permissions and publishing permissions, and isolates the development environment and production environment to ensure high stability and high security of streaming applications.        The application development layer is organically integrated with the data application development process of DSS, providing simplier user experience.        The application execution layer integrates Linkis to provide financial-level streaming application management capabilities with high concurrency, high availability, multi-tenant isolation, and resource management. #### 2. Powerful streaming application development and debugging capabilities.        Based on DSS-Scriptis, provides streaming application development and debugging functions, and supports real-time debugging and result set display of FlinkSQL. ![development center](docs/images/开发中心.png) #### 3. Powerful streaming application production center capabilities.        Supports multi-version management, full life cycle management, monitoring alarm, checkpoint and savepoint management capabilities of streaming jobs. ![prod center](docs/images/stream_product_center_en.png)        Running information page: ![Running information](docs/images/stream_job_detail_en.png)        Configurations page： ![Configurations](docs/images/stream_job_config_en_1.png) ![Configurations](docs/images/stream_job_config_en_2.png)        For more features, please refer to: [User Manual](docs/en_US/userManual/StreamisUserManual.md). ---- ## Depended ecosystems | Depended Component | Description | Streamis compatibility | | -------------- | -------------------------------------------------------------- | --------------| | [DataSphereStudio](https://github.com/WeBankFinTech/DataSphereStudio) | Data application development management framework. With a unified UI, the workflow-like graphical drag-and-drop development experience meets the entire lifecycle of data application development from data import, desensitization cleaning, data analysis, data mining, quality inspection, visualization, scheduling to data output applications, etc. | >= DSS1.1.0 (Released) | | [Linkis](https://github.com/apache/incubator-linkis) | Apache Linkis, builds a layer of computation middleware, by using standard interfaces such as REST/WS/JDBC provided by Linkis, the upper applications can easily access the underlying engines such as MySQL/Spark/Hive/Presto/Flink, etc. | >= Linkis1.1.1 (Released),some functions need to be supported by linkis 1.1.2 | ## Demo Trial environment        In progress, stay tuned! ---- ## Download        Please go to the [Streamis Releases](https://github.com/WeBankFinTech/Streamis/releases) Page to download a compiled version or a source code package of Streamis. ---- ## Compile and install deployment please refer to [Streamis Installation and Deployment Document](docs/en_US/0.2.0/StreamisDeployment.md) for installing and deploying Streamis. ---- ## Examples and usage guidelines        Please visit to [User documentation](docs/en_US/userManual/StreamisUserManual.md), learn how to use Streamis quickly. ---- ## Features | Function Module | Description | Streamis | | :----: | :----: |-------| | UI | Integrated and convenient management interface and monitoring window | Integrated | | Installation and deployment | Deployment difficulty and third-party dependencies | One-click deployment, relying on Linkis Flink engine | | Development Center | FlinkSQL streaming application real-time development and debugging | Support, need to integrate DSS | |Production Center | Streaming Application Management Operation and Maintenance Capability | Support | | | Reuse Linkis computing governance capabilities | Support | | | Support FlinkSQL and FlinkJar package release | Support | | | Multi-version management capabilities | Support | | | Configuration and alert management capabilities | Support | | Service high availability | Multiple services,State snapshot for fault tolerance, failure does not affect the use | Application high availability | | System Management | Node and Resource Management | Support | | Permission management | Task operation permission control | Support | ---- ## Architecture ![Architecture](images/en_US/readme/architecture.png) ---- ## Contributing        Contributions are always welcomed, we need more contributors to build Streamis together. either code, or doc, or other supports that could help the community. ---- ## Communication contribution        For any questions or suggestions, please kindly submit an [issue](https://github.com/WeBankFinTech/Streamis/issues).        You can scan the QR code below to join our WeChat and QQ group to get more immediate response. ![comminicate](images/zh_CN/readme/communication.png) ---- ## License        DSS is under the Apache 2.0 license. See the [License](LICENSE) file for details.