235 Star 957 Fork 413

sxfad / porter

加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
该仓库未声明开源许可证文件(LICENSE),使用请关注具体项目描述及其代码上游依赖。
克隆/下载
README_EN.md 2.79 KB
一键复制 编辑 原始数据 按行查看 历史
zkevin 提交于 2019-07-02 16:01 . 4.0发版准备

Porter | 中文

GitHub release License

Abstract

Porter began in 2017 and provides data synchronization, but it's not just limited to data synchronization, it's widely used within the Suixingpay. Mainly provide the following features:

  • Database real-time synchronization
  • Database migrate
  • Database governance
  • Custom source and target data synchronization
  • Custom data extraction logic

Core features

  • Native support Oracle|Mysql to Jdbc relational database final consistent synchronization
  • Plugin friendly, Support for custom source consumer plugins, target loading plugins, and alarm plugins for secondary development.
  • Support for custom source, target table, field mapping
  • Support configuration file based node synchronization task configuration.
  • Support management of background synchronization task push, node, task management. Provides task running indicator monitoring, node running logs, and task abnormal alarms.
  • Support node resource limit and allocation.
  • A distributed architecture based on the Zookeeper cluster plugin. Support for custom cluster plugins.

Quick start

Compile from source

git clone https://github.com/sxfad/porter.git
cd porter
git checkout version
gradle build
Find the installation package from the build/distributions list

Configuration

configuration document

porter.id=unique id
#cluser
porter.cluster.strategy=ZOOKEEPER
porter.cluster.client.url=127.0.0.1:2181
porter.cluster.client.sessionTimeout=100000

#stastistics
porter.cluster.statistic.sourceType=KAFKA_PRODUCE
porter.cluster.statistic.servers=127.0.0.1:9200
porter.cluster.statistic.topic=your kafka topic

#standalone
porter.cluster.strategy=STANDALONE
porter.cluster.client.home=./.porter

Run

tar zxvf build/distributions/porter-boot-version.tar
porter-boot-version/bin/porter-boot

Debug

porter-boot-version/bin/porter-boot  debug port

Operating environment

porter-boot-version/bin/porter-boot --spring.profiles.active=Operating environment

Elegant close

porter-boot-version/bin/shutdown.sh

Document

Architecture

architecture_design dataflow

Screenshot

Home

	manager-boot default website: http://127.0.0.1:8081
	manager-boot default account: admin admin

Contact Us

  • QQ group:835209101
Java
1
https://gitee.com/sxfad/porter.git
git@gitee.com:sxfad/porter.git
sxfad
porter
porter
master

搜索帮助