# datax **Repository Path**: dataxGroup/datax ## Basic Information - **Project Name**: datax - **Description**: datax 数据同步的工具 - **Primary Language**: Unknown - **License**: Apache-2.0 - **Default Branch**: master - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 1 - **Forks**: 1 - **Created**: 2020-07-07 - **Last Updated**: 2025-06-06 ## Categories & Tags **Categories**: Uncategorized **Tags**: None ## README ![Datax-logo](https://gitee.com/dataxGroup/datax/tree/master/images/DataX-logo.jpg) # DataX DataX 是阿里巴巴集团内被广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、TableStore(OTS)、MaxCompute(ODPS)、DRDS 等各种异构数据源之间高效的数据同步功能。 # Features DataX本身作为数据同步框架，将不同数据源的同步抽象为从源头数据源读取数据的Reader插件，以及向目标端写入数据的Writer插件，理论上DataX框架可以支持任意数据源类型的数据同步工作。同时DataX插件体系作为一套生态系统, 每接入一套新数据源该新加入的数据源即可实现和现有的数据源互通。 # DataX详细介绍 ##### 请参考：[DataX-Introduction](https://gitee.com/dataxGroup/datax/tree/master/introduction.md) # Quick Start ##### Download [DataX下载地址](http://datax-opensource.oss-cn-hangzhou.aliyuncs.com/datax.tar.gz) ##### 请点击：[Quick Start](https://gitee.com/dataxGroup/datax/tree/master/userGuid.md) ##### docker 一键部署 [一键部署](https://gitee.com/dataxGroup/datax/tree/master/DockerFile/README.md) # Support Data Channels DataX目前已经有了比较全面的插件体系，主流的RDBMS数据库、NOSQL、大数据计算系统都已经接入，目前支持数据如下图，详情请点击：[DataX数据源参考指南](https://github.com/alibaba/DataX/wiki/DataX-all-data-channels) | 类型 | 数据源 | Reader(读) | Writer(写) |文档| | ------------ | ---------- | :-------: | :-------: |:-------: | | RDBMS 关系型数据库 | MySQL | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/mysqlreader/doc/mysqlreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/mysqlwriter/doc/mysqlwriter.md)| |             | Oracle     |     √     |     √     |[读](https://gitee.com/dataxGroup/datax/tree/master/oraclereader/doc/oraclereader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/oraclewriter/doc/oraclewriter.md)| | | SQLServer | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/sqlserverreader/doc/sqlserverreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/sqlserverwriter/doc/sqlserverwriter.md)| | | PostgreSQL | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/postgresqlreader/doc/postgresqlreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/postgresqlwriter/doc/postgresqlwriter.md)| | | DRDS | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/drdsreader/doc/drdsreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/drdswriter/doc/drdswriter.md)| | | 通用RDBMS(支持所有关系型数据库) | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/rdbmsreader/doc/rdbmsreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/rdbmswriter/doc/rdbmswriter.md)| | 阿里云数仓数据存储 | ODPS | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/odpsreader/doc/odpsreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/odpswriter/doc/odpswriter.md)| | | ADS | | √ |[写](https://gitee.com/dataxGroup/datax/tree/master/adswriter/doc/adswriter.md)| | | OSS | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/ossreader/doc/ossreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/osswriter/doc/osswriter.md)| | | OCS | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/ocsreader/doc/ocsreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/ocswriter/doc/ocswriter.md)| | NoSQL数据存储 | OTS | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/otsreader/doc/otsreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/otswriter/doc/otswriter.md)| | | Hbase0.94 | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/hbase094xreader/doc/hbase094xreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/hbase094xwriter/doc/hbase094xwriter.md)| | | Hbase1.1 | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/hbase11xreader/doc/hbase11xreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/hbase11xwriter/doc/hbase11xwriter.md)| | | Phoenix4.x | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/hbase11xsqlreader/doc/hbase11xsqlreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/hbase11xsqlwriter/doc/hbase11xsqlwriter.md)| | | Phoenix5.x | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/hbase20xsqlreader/doc/hbase20xsqlreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/hbase20xsqlwriter/doc/hbase20xsqlwriter.md)| | | MongoDB | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/mongoreader/doc/mongoreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/mongowriter/doc/mongowriter.md)| | | Hive | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/hdfsreader/doc/hdfsreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/hdfswriter/doc/hdfswriter.md)| | | Cassandra | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/cassandrareader/doc/cassandrareader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/cassandrawriter/doc/cassandrawriter.md)| | 无结构化数据存储 | TxtFile | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/txtfilereader/doc/txtfilereader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/txtfilewriter/doc/txtfilewriter.md)| | | FTP | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/ftpreader/doc/ftpreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/ftpwriter/doc/ftpwriter.md)| | | HDFS | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/hdfsreader/doc/hdfsreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/hdfswriter/doc/hdfswriter.md)| | | Elasticsearch | | √ |[写](https://gitee.com/dataxGroup/datax/tree/master/elasticsearchwriter/doc/elasticsearchwriter.md)| | 时间序列数据库 | OpenTSDB | √ | |[读](https://gitee.com/dataxGroup/datax/tree/master/opentsdbreader/doc/opentsdbreader.md)| | | TSDB | √ | √ |[读](https://gitee.com/dataxGroup/datax/tree/master/tsdbreader/doc/tsdbreader.md) 、[写](https://gitee.com/dataxGroup/datax/tree/master/tsdbwriter/doc/tsdbhttpwriter.md)| # 我要开发新的插件 请点击：[DataX插件开发宝典](https://gitee.com/dataxGroup/datax/tree/master/dataxPluginDev.md) # 项目成员 核心Contributions: 言柏 、枕水、秋奇、青砾、一斅、云时 感谢天烬、光戈、祁然、巴真、静行对DataX做出的贡献。 # License This software is free to use under the Apache License [Apache license](https://gitee.com/dataxGroup/datax/tree/master/license.txt). # 请及时提出issue给我们。请前往：[DataxIssue](https://github.com/alibaba/DataX/issues) # 开源版DataX企业用户 ![Datax-logo](https://gitee.com/dataxGroup/datax/tree/master/images/datax-enterprise-users.jpg)