Metrics
0
Watch 114 Star 295 Fork 120

GVPsxfad / porterJava

Sign up for free
Explore and code with more than 2 million developers,Free private repositories !:)
Sign up
Porter是一款数据同步中间件,主要用于解决同构/异构数据库之间的表级别数据同步问题. spread retract

https://open.vbill.cn

Clone or download
Loading...
README_EN.md

Porter | 中文

GitHub release License

Abstract

Porter began in 2017 and provides data synchronization, but it's not just limited to data synchronization, it's widely used within the Suixingpay. Mainly provide the following features:

  • Database real-time synchronization
  • Database migrate
  • Database governance
  • Custom source and target data synchronization
  • Custom data extraction logic

Core features

  • Native support Oracle|Mysql to Jdbc relational database final consistent synchronization
  • Plugin friendly, Support for custom source consumer plugins, target loading plugins, and alarm plugins for secondary development.
  • Support for custom source, target table, field mapping
  • Support configuration file based node synchronization task configuration.
  • Support management of background synchronization task push, node, task management. Provides task running indicator monitoring, node running logs, and task abnormal alarms.
  • Support node resource limit and allocation.
  • A distributed architecture based on the Zookeeper cluster plugin. Support for custom cluster plugins.

Quick start

Compile from source

git clone https://github.com/sxfad/porter.git
cd porter
git checkout version
gradle build
Find the installation package from the build/distributions list

Configuration

configuration document

porter.id=unique id
#cluser
porter.cluster.strategy=ZOOKEEPER
porter.cluster.client.url=127.0.0.1:2181
porter.cluster.client.sessionTimeout=100000

#stastistics
porter.cluster.statistic.sourceType=KAFKA_PRODUCE
porter.cluster.statistic.servers=127.0.0.1:9200
porter.cluster.statistic.topic=your kafka topic

#standalone
porter.cluster.strategy=STANDALONE
porter.cluster.client.home=./.porter

Run

tar zxvf build/distributions/porter-boot-version.tar
porter-boot-version/bin/porter-boot

Debug

porter-boot-version/bin/porter-boot  debug port

Operating environment

porter-boot-version/bin/porter-boot --spring.profiles.active=Operating environment

Elegant close

porter-boot-version/bin/shutdown.sh

Document

Architecture

architecture_design dataflow

Screenshot

Home

Contact Us

  • QQ group:835209101

Comments ( 20 )

You need to Sign in for post a comment

Help Search