# mysql-mydumper **Repository Path**: tym_hmm/mysql-mydumper ## Basic Information - **Project Name**: mysql-mydumper - **Description**: mysql mydumper数据备份恢复 - **Primary Language**: Go - **License**: GPL-3.0 - **Default Branch**: master - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 2 - **Forks**: 2 - **Created**: 2021-12-16 - **Last Updated**: 2023-07-14 ## Categories & Tags **Categories**: Uncategorized **Tags**: None ## README # go-mydumper ***go-mydumper*** 是一个多线程的MySQL备份和恢复工具，它兼容 [maxbube/mydumper](https://github.com/maxbube/mydumper). ***基于*** [xelabs/go-mydumper](https://github.com/xelabs/go-mydumper)修改 ## 构建 ``` $git clone https://gitee.com/tym_hmm/mysql-mydumper.git $cd go-mydumper $make build $./bin/mydumper -h $./bin/myloader -h ``` ## 测试 ``` $make test ``` ## 使用 ### 集成代码 ##### 获取架包 ``` go get -u gitee.com/tym_hmm/mysql-mydumper ``` ``` func TestDump(t *testing.T) { node := &config.DumpNode{ Host: "192.168.1.198", Port: 3307, User: "root", Password: "123456", DataBase: "app_data_center", Table: "data_ads", OutDir: "./dumper-sql", } err := api.NewMyDumper().SetNode(node).Handle(&DumperListener{}) if err != nil { fmt.Println(err) } } type DumperListener struct { } func (d *DumperListener) Start(time string, dataBase string, table string, rags *config.Config) { log("start => time:%s, dataBase:%s, table:%s", time, dataBase, table) } func (d *DumperListener) StartNode(time string, dataBase string, table string, args *config.Config, connection *common.Connection) { log("StartNode => time:%s, dataBase:%s, table:%s, connId:%d", time, dataBase, table, connection.ID) } func (d *DumperListener) DoneNode(time string, dataBase string, table string, args *config.Config, connection *common.Connection) { log("DoneNode => time:%s, dataBase:%s, table:%s, connId:%d", time, dataBase, table, connection.ID) } func (d *DumperListener) PendingNode(time string, dataBase string, table string, allrows uint64, allbytes uint64, rates float64) { log("PendingNode => time:%s, dataBase:%s, table:%s, allrows: %d, allBytes:%d, rate:%f", time, dataBase,table, allrows, allbytes, rates) } func (d *DumperListener) Done(time string, dataBase string, table string, args *config.Config, allrows uint64, allbytes uint64, rates float64) { log("Done => time:%s, dataBase:%s, table:%s, allrows:%d, allBytes:%d, rates:%f", time, dataBase, table, allrows, allbytes, rates) } ``` ## 打包使用 ### mydumper ``` ./bin/mydumper -h Usage: ./bin/mydumper -c conf/mydumper.ini.sample -c string config file Examples: $./bin/mydumper -c conf/mydumper.ini.sample 2017/10/25 13:12:52.933391 dumper.go:35: [INFO] dumping.database[sbtest].schema... 2017/10/25 13:12:52.937743 dumper.go:45: [INFO] dumping.table[sbtest.benchyou0].schema... 2017/10/25 13:12:52.937791 dumper.go:168: [INFO] dumping.table[sbtest.benchyou0].datas.thread[1]... 2017/10/25 13:12:52.939008 dumper.go:45: [INFO] dumping.table[sbtest.benchyou1].schema... 2017/10/25 13:12:52.939055 dumper.go:168: [INFO] dumping.table[sbtest.benchyou1].datas.thread[2]... 2017/10/25 13:12:55.611905 dumper.go:105: [INFO] dumping.table[sbtest.benchyou0].rows[633987].bytes[128MB].part[1].thread[1] 2017/10/25 13:12:55.765127 dumper.go:105: [INFO] dumping.table[sbtest.benchyou1].rows[633987].bytes[128MB].part[1].thread[2] 2017/10/25 13:12:58.146093 dumper.go:105: [INFO] dumping.table[sbtest.benchyou0].rows[1266050].bytes[256MB].part[2].thread[1] 2017/10/25 13:12:58.253219 dumper.go:105: [INFO] dumping.table[sbtest.benchyou1].rows[1266054].bytes[256MB].part[2].thread[2] ... [stripped] ... 2017/10/25 13:13:02.939278 dumper.go:182: [INFO] dumping.allbytes[1024MB].allrows[5054337].time[10.01sec].rates[102.34MB/sec]... 2017/10/25 13:13:35.496439 dumper.go:105: [INFO] dumping.table[sbtest.benchyou1].rows[11345659].bytes[2304MB].part[18].thread[2] 2017/10/25 13:13:37.627178 dumper.go:105: [INFO] dumping.table[sbtest.benchyou0].rows[11974624].bytes[2432MB].part[19].thread[1] 2017/10/25 13:13:37.753966 dumper.go:105: [INFO] dumping.table[sbtest.benchyou1].rows[11974630].bytes[2432MB].part[19].thread[2] 2017/10/25 13:13:39.453430 dumper.go:122: [INFO] dumping.table[sbtest.benchyou0].done.allrows[12486842].allbytes[2536MB].thread[1]... 2017/10/25 13:13:39.453462 dumper.go:170: [INFO] dumping.table[sbtest.benchyou0].datas.thread[1].done... 2017/10/25 13:13:39.622390 dumper.go:122: [INFO] dumping.table[sbtest.benchyou1].done.allrows[12484135].allbytes[2535MB].thread[2]... 2017/10/25 13:13:39.622423 dumper.go:170: [INFO] dumping.table[sbtest.benchyou1].datas.thread[2].done... 2017/10/25 13:13:39.622454 dumper.go:188: [INFO] dumping.all.done.cost[46.69sec].allrows[24970977].allbytes[5318557708].rate[108.63MB/s] ``` The dump files: ``` $ ls sbtest.sql/ metadata sbtest.benchyou0.00009.sql sbtest.benchyou0.00018.sql sbtest.benchyou1.00006.sql sbtest.benchyou1.00015.sql sbtest.benchyou0.00001.sql sbtest.benchyou0.00010.sql sbtest.benchyou0.00019.sql sbtest.benchyou1.00007.sql sbtest.benchyou1.00016.sql sbtest.benchyou0.00002.sql sbtest.benchyou0.00011.sql sbtest.benchyou0.00020.sql sbtest.benchyou1.00008.sql sbtest.benchyou1.00017.sql sbtest.benchyou0.00003.sql sbtest.benchyou0.00012.sql sbtest.benchyou0-schema.sql sbtest.benchyou1.00009.sql sbtest.benchyou1.00018.sql sbtest.benchyou0.00004.sql sbtest.benchyou0.00013.sql sbtest.benchyou1.00001.sql sbtest.benchyou1.00010.sql sbtest.benchyou1.00019.sql sbtest.benchyou0.00005.sql sbtest.benchyou0.00014.sql sbtest.benchyou1.00002.sql sbtest.benchyou1.00011.sql sbtest.benchyou1.00020.sql sbtest.benchyou0.00006.sql sbtest.benchyou0.00015.sql sbtest.benchyou1.00003.sql sbtest.benchyou1.00012.sql sbtest.benchyou1-schema.sql sbtest.benchyou0.00007.sql sbtest.benchyou0.00016.sql sbtest.benchyou1.00004.sql sbtest.benchyou1.00013.sql sbtest-schema-create.sql sbtest.benchyou0.00008.sql sbtest.benchyou0.00017.sql sbtest.benchyou1.00005.sql sbtest.benchyou1.00014.sql ``` ### myloader ``` $ ./bin/myloader --help Usage: ./bin/myloader -h [HOST] -P [PORT] -u [USER] -p [PASSWORD] -d [DIR] -P int TCP/IP port to connect to (default 3306) -d string Directory of the dump to import -h string The host to connect to -p string User password -t int Number of threads to use (default 16) -u string Username with privileges to run the loader Examples: $./bin/myloader -h 192.168.0.2 -P 3306 -u mock -p mock -d sbtest.sql 2017/10/25 13:04:17.396002 loader.go:75: [INFO] restoring.database[sbtest] 2017/10/25 13:04:17.458076 loader.go:99: [INFO] restoring.schema[sbtest.benchyou0] 2017/10/25 13:04:17.516236 loader.go:99: [INFO] restoring.schema[sbtest.benchyou1] 2017/10/25 13:04:17.516389 loader.go:115: [INFO] restoring.tables[benchyou0].parts[00015].thread[1] 2017/10/25 13:04:17.516456 loader.go:115: [INFO] restoring.tables[benchyou0].parts[00005].thread[2] ... [stripped] ... 2017/10/25 13:05:27.783560 loader.go:131: [INFO] restoring.tables[benchyou1].parts[00005].thread[9].done... 2017/10/25 13:05:36.133758 loader.go:181: [INFO] restoring.allbytes[4087MB].time[78.62sec].rates[51.99MB/sec]... 2017/10/25 13:05:44.759183 loader.go:131: [INFO] restoring.tables[benchyou0].parts[00001].thread[3].done... 2017/10/25 13:05:46.133728 loader.go:181: [INFO] restoring.allbytes[4216MB].time[88.62sec].rates[47.58MB/sec]... 2017/10/25 13:05:46.567156 loader.go:131: [INFO] restoring.tables[benchyou1].parts[00016].thread[6].done... 2017/10/25 13:05:50.612200 loader.go:131: [INFO] restoring.tables[benchyou0].parts[00008].thread[10].done... 2017/10/25 13:05:51.131155 loader.go:131: [INFO] restoring.tables[benchyou0].parts[00014].thread[2].done... 2017/10/25 13:05:51.185629 loader.go:131: [INFO] restoring.tables[benchyou0].parts[00011].thread[1].done... 2017/10/25 13:05:51.836354 loader.go:131: [INFO] restoring.tables[benchyou1].parts[00004].thread[0].done... 2017/10/25 13:05:52.286931 loader.go:131: [INFO] restoring.tables[benchyou1].parts[00006].thread[11].done... 2017/10/25 13:05:52.602444 loader.go:131: [INFO] restoring.tables[benchyou0].parts[00019].thread[8].done... 2017/10/25 13:05:52.602573 loader.go:187: [INFO] restoring.all.done.cost[95.09sec].allbytes[5120.00MB].rate[53.85MB/s] ``` ## License go-mydumper is released under the GPLv3. See LICENSE