mysql全量迁移opengauss过程中portal后台报错

【标题描述】:
【测试类型：SQL功能/存储功能/接口功能/工具功能/性能/并发/压力长稳/故障注入/安全/资料/编码规范】【测试版本：x.x.x】 问题描述
测试类型：工具功能   测试版本:7.0.0-RC1
【操作系统和硬件信息】(查询命令: cat /etc/system-release, uname -a):
cat /etc/system-release  
centos7
uname -a
Linux localhost.localdomain 3.10.0-1160.el7.x86_64 #1 SMP Mon Oct 19 16:18:59 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
【测试环境】(单机/1主x备x级联备):
单机
【被测功能】:
datakit迁移功能，mysql全量迁移Opengauss在线模式
【测试类型】:
功能测试
【数据库版本】(查询命令: gaussdb -V):
gaussdb (openGauss 7.0.0-RC1 build 2dd1204b) compiled at 2025-03-29 16:41:01 commit 0 last mr  debug
【预置条件】:
在mysql端准备迁移数据
【操作步骤】(请填写详细的操作步骤):
1. 在datakit新建迁移任务
2. 选择在线迁移模式

【预期输出】:
数据库正常迁移结束
【实际输出】:
后台报错，任务终止
【原因分析】:
根据Portal后台的日志报错，显示Portal中org.opengauss.portalcontroller.verify.HbaConfVerifyChain#getHbaConfModels这个方法被执行时，查询数据库select * from gs_get_hba_conf();结果报错，报错的原因是数据库中的字段和代码中获取的字段不一致，数据库中返回的列名字是"users"，而代码中获取的列明是"user"
dolphoindb=> select * from gs_get_hba_conf();
 type  |  database   | users |   address    | method
-------+-------------+-------+--------------+--------
 local | all         | all   |              | trust
 host  | all         | all   | 127.0.0.1/32 | trust
 host  | all         | all   | ::1/128      | trust
 host  | all         | all   | 0.0.0.0/0    | sha256
 host  | replication | all   | 0.0.0.0/0    | sha256

【日志信息】(请附上日志文件、截图、coredump信息):
2025-04-21 21:12:08 [main] INFO  o.o.p.u.ParamsUtils - properties = {awt.toolkit=sun.awt.X11.XToolkit, workspace.id=30, mysql.user.password=MU@@jian2235, java.specification.version=11, sun.cpu.isalist=, sun.jnu.encoding=UTF-8, java.class.path=/ops/portal/portalControl-7.0.0rc1-exec.jar, java.vm.vendor=Red Hat, Inc., sun.arch.data.model=64, path=/ops/portal/, java.vendor.url=https://www.redhat.com/, user.timezone=Asia/Shanghai, mysql.database.table=test1.test_table, os.name=Linux, java.vm.specification.version=11, sun.java.launcher=SUN_STANDARD, user.country=CN, opengauss.database.port=5432, order=verify_pre_migration, sun.boot.library.path=/usr/lib/jvm/java-11-openjdk-11.0.23.0.9-2.el7_9.x86_64/lib, sun.java.command=/ops/portal/portalControl-7.0.0rc1-exec.jar, jdk.debug=release, sun.cpu.endian=little, user.home=/home/mujianjiang, opengauss.database.name=dolphoindb, user.language=zh, is_adjustKernel_param=false, java.specification.vendor=Oracle Corporation, java.version.date=2024-04-16, java.home=/usr/lib/jvm/java-11-openjdk-11.0.23.0.9-2.el7_9.x86_64, file.separator=/, java.vm.compressedOopsMode=32-bit, line.separator=
, java.specification.name=Java Platform API Specification, java.vm.specification.vendor=Oracle Corporation, java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment, mysql.user.name=mujianjiang, opengauss.database.host=172.24.76.131, opengauss.database.iscluster=false, java.protocol.handler.pkgs=org.springframework.boot.loader, sun.management.compiler=HotSpot 64-Bit Tiered Compilers, mysql.database.name=test1, java.runtime.version=11.0.23+9-LTS, user.name=mujianjiang, opengauss.user.name=opengauss, skip=true, path.separator=:, os.version=3.10.0-1160.el7.x86_64, migration_mode=2, java.runtime.name=OpenJDK Runtime Environment, file.encoding=UTF-8, java.vm.name=OpenJDK 64-Bit Server VM, java.vendor.version=(Red_Hat-11.0.23.0.9-2.el7_9), mysql.database.port=3306, java.vendor.url.bug=https://access.redhat.com/support/cases/, java.io.tmpdir=/tmp, opengauss.user.password=MU@@jian3125, order.invoked.timestamp=1745241116774, opengauss.database.schema=test1, java.version=11.0.23, user.dir=/home/mujianjiang, os.arch=amd64, java.vm.specification.name=Java Virtual Machine Specification, java.awt.printerjob=sun.print.PSPrinterJob, rules.enable=true, sun.os.patch.level=unknown, java.library.path=/ops/portal/tools/chameleon/chameleon-7.0.0rc1:/ops/portal/tools/chameleon/chameleon-7.0.0rc1:/ops/portal/tools/chameleon/chameleon-7.0.0rc1:/ops/portal/tools/chameleon/chameleon-7.0.0rc1:/ops/portal/tools/chameleon/chameleon-7.0.0rc1:/ops/portal/tools/chameleon/chameleon-7.0.0rc1:/ops/portal/tools/chameleon/chameleon-6.0.0:/ops/portal/tools/chameleon/chameleon-6.0.0rc1:/ops/portal/tools/chameleon/chameleon-6.0.0rc1:/ops/portal/tools/chameleon/chameleon-6.0.0rc1:/ops/portal/tools/chameleon/chameleon-6.0.0rc1::/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib, java.vm.info=mixed mode, sharing, java.vendor=Red Hat, Inc., java.vm.version=11.0.23+9-LTS, java.specification.maintenance.version=2, sun.io.unicode.encoding=UnicodeLittle, java.class.version=55.0, mysql.database.host=172.24.76.131}
2025-04-21 21:12:08 [main] INFO  o.o.p.e.MigrationConfluentInstanceConfig - get MigrationConfluentInstanceConfig from system param = MigrationConfluentInstanceConfig(id=null, zookeeperPort=null, kafkaPort=null, zkIp=null, kafkaIp=null, installDir=null, bindPortalId=null, zkIpPort=null, kafkaIpPort=null, schemaRegistryIpPort=null, schemaRegistryIp=null, schemaRegistryPort=null, bindPortalHost=null, thirdPartySoftwareConfigType=null)
2025-04-21 21:12:08 [main] INFO  o.o.p.u.KafkaUtils - no need change param
2025-04-21 21:12:08 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/portal.portId.lock already exists.
2025-04-21 21:12:08 [main] INFO  o.o.p.u.ParamsUtils - global log level param is empty
2025-04-21 21:12:08 [main] INFO  o.o.p.c.m.VerifyCommandReceiver - start execute command=verify pre migration
2025-04-21 21:12:09 [main] INFO  o.o.p.c.m.VerifyCommandReceiver - migration_mode is 2
2025-04-21 21:12:09 [main] INFO  o.o.p.e.MigrationConfluentInstanceConfig - get MigrationConfluentInstanceConfig from system param = MigrationConfluentInstanceConfig(id=null, zookeeperPort=null, kafkaPort=null, zkIp=null, kafkaIp=null, installDir=null, bindPortalId=null, zkIpPort=null, kafkaIpPort=null, schemaRegistryIpPort=null, schemaRegistryIp=null, schemaRegistryPort=null, bindPortalHost=null, thirdPartySoftwareConfigType=null)
2025-04-21 21:12:09 [main] ERROR o.o.p.t.Plan - Start methond=runSchemaRegistry failed.
2025-04-21 21:12:10 [main] INFO  o.o.p.v.FullPermissionVerifyChain - permissionMap is {repl_client_priv=Y, select_priv=Y, reload_priv=Y, lock_tables_priv=Y}
2025-04-21 21:12:10 [main] INFO  o.o.p.v.FullPermissionVerifyChain - permissionStr is 1
2025-04-21 21:12:10 [main] INFO  o.o.p.v.FullPermissionVerifyChain - permissionMap is {repl_slave_priv=Y, repl_client_priv=Y, select_priv=Y}
2025-04-21 21:12:10 [main] INFO  o.o.p.v.FullPermissionVerifyChain - permissionStr is 1
2025-04-21 21:12:10 [main] INFO  o.o.p.v.IncrementParameterVerifyChain - parameter log_bin is ON
2025-04-21 21:12:10 [main] INFO  o.o.p.v.IncrementParameterVerifyChain - parameter binlog_format is ROW
2025-04-21 21:12:10 [main] INFO  o.o.p.v.IncrementParameterVerifyChain - parameter binlog_row_image is FULL
2025-04-21 21:12:10 [main] INFO  o.o.p.v.FullPermissionVerifyChain - permissionMap is {delete_priv=Y, update_priv=Y, insert_priv=Y, select_priv=Y}
2025-04-21 21:12:10 [main] INFO  o.o.p.v.FullPermissionVerifyChain - permissionStr is 1
2025-04-21 21:12:10 [main] INFO  o.o.p.v.ReverseParameterVerifyChain - parameter wal_level is logical
2025-04-21 21:12:10 [main] INFO  o.o.p.v.LowerParameterVerifyChain - mysql lower_case_table_names is 0
2025-04-21 21:12:10 [main] INFO  o.o.p.v.LowerParameterVerifyChain - openGauss lower_case_table_names is 0
2025-04-21 21:12:10 [main] INFO  o.o.p.v.BdatabaseVerifyChain - openGauss sql_compatibility is B
2025-04-21 21:12:10 [main] INFO  o.o.p.v.DatabaseEncryptionVerifyChain - mysql version is 8.0.41
2025-04-21 21:12:10 [main] INFO  o.o.p.v.DatabaseEncryptionVerifyChain - mysql @@default_authentication_plugin is mysql_native_password
2025-04-21 21:12:10 [main] INFO  o.o.p.v.ReplicationNumberVerifyChain - pg_get_replication_slots number is 0
2025-04-21 21:12:10 [main] INFO  o.o.p.v.ReplicationNumberVerifyChain - max_replication_slots number is 8
2025-04-21 21:12:10 [main] INFO  o.o.p.v.HbaConfVerifyChain - openGauss version is 7.0.0-RC1.
2025-04-21 21:12:10 [main] ERROR o.o.p.v.HbaConfVerifyChain - Failed to get hba config. Error: 
org.opengauss.util.PSQLException: ResultSet 中找不到栏位名称 user。
	at org.opengauss.jdbc.PgResultSet.findColumn(PgResultSet.java:2721) ~[opengauss-jdbc-3.0.0.jar!/:?]
	at org.opengauss.jdbc.PgResultSet.getString(PgResultSet.java:2591) ~[opengauss-jdbc-3.0.0.jar!/:?]
	at org.opengauss.portalcontroller.verify.HbaConfVerifyChain.getHbaConfModels(HbaConfVerifyChain.java:137) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.HbaConfVerifyChain.doVerify(HbaConfVerifyChain.java:92) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.HbaConfVerifyChain.verify(HbaConfVerifyChain.java:60) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.AbstractPreMigrationVerifyChain.transfer(AbstractPreMigrationVerifyChain.java:55) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.EnableSlotLogVerifyChain.verify(EnableSlotLogVerifyChain.java:43) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.AbstractPreMigrationVerifyChain.transfer(AbstractPreMigrationVerifyChain.java:55) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.ReplicationNumberVerifyChain.verify(ReplicationNumberVerifyChain.java:75) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.AbstractPreMigrationVerifyChain.transfer(AbstractPreMigrationVerifyChain.java:55) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.DatabaseEncryptionVerifyChain.verify(DatabaseEncryptionVerifyChain.java:67) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.AbstractPreMigrationVerifyChain.transfer(AbstractPreMigrationVerifyChain.java:55) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.BdatabaseVerifyChain.verify(BdatabaseVerifyChain.java:63) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.AbstractPreMigrationVerifyChain.transfer(AbstractPreMigrationVerifyChain.java:55) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.LowerParameterVerifyChain.verify(LowerParameterVerifyChain.java:75) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.AbstractPreMigrationVerifyChain.transfer(AbstractPreMigrationVerifyChain.java:55) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.ReverseParameterVerifyChain.verify(ReverseParameterVerifyChain.java:46) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.AbstractPreMigrationVerifyChain.transfer(AbstractPreMigrationVerifyChain.java:55) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.ReversePermissionVerifyChain.verify(ReversePermissionVerifyChain.java:53) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.AbstractPreMigrationVerifyChain.transfer(AbstractPreMigrationVerifyChain.java:55) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.IncrementParameterVerifyChain.verify(IncrementParameterVerifyChain.java:45) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.AbstractPreMigrationVerifyChain.transfer(AbstractPreMigrationVerifyChain.java:55) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.IncrementPermissionVerifyChain.verify(IncrementPermissionVerifyChain.java:45) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.AbstractPreMigrationVerifyChain.transfer(AbstractPreMigrationVerifyChain.java:55) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.FullPermissionVerifyChain.verify(FullPermissionVerifyChain.java:59) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.AbstractPreMigrationVerifyChain.transfer(AbstractPreMigrationVerifyChain.java:55) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.DatabaseConnectVerifyChain.verify(DatabaseConnectVerifyChain.java:43) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.AbstractPreMigrationVerifyChain.transfer(AbstractPreMigrationVerifyChain.java:55) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.verify.CommonServiceVerifyChain.verify(CommonServiceVerifyChain.java:40) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.command.mysql.VerifyCommandReceiver.action(VerifyCommandReceiver.java:66) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.command.ConcreteCommand.execute(ConcreteCommand.java:24) ~[classes!/:7.0.0rc1]
	at org.opengauss.portalcontroller.PortalControl.main(PortalControl.java:192) ~[classes!/:7.0.0rc1]
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.base/java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
	at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:49) ~[portalControl-7.0.0rc1-exec.jar:7.0.0rc1]
	at org.springframework.boot.loader.Launcher.launch(Launcher.java:108) ~[portalControl-7.0.0rc1-exec.jar:7.0.0rc1]
	at org.springframework.boot.loader.Launcher.launch(Launcher.java:58) ~[portalControl-7.0.0rc1-exec.jar:7.0.0rc1]
	at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:88) ~[portalControl-7.0.0rc1-exec.jar:7.0.0rc1]
2025-04-21 21:12:10 [main] ERROR o.o.p.u.LogViewUtils - Error message: verify migration failed. failed.
2025-04-21 21:12:10 [main] INFO  o.o.p.c.m.VerifyCommandReceiver - execute command=verify pre migration end
2025-04-21 21:16:57 [main] INFO  o.o.p.u.KafkaUtils - KafkaAppender has been removed from root logger.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.KafkaUtils - KafkaAppender has been stopped.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.ParamsUtils - properties = {awt.toolkit=sun.awt.X11.XToolkit, workspace.id=30, java.specification.version=11, sun.cpu.isalist=, sun.jnu.encoding=UTF-8, java.class.path=/ops/portal/portalControl-7.0.0rc1-exec.jar, java.vm.vendor=Red Hat, Inc., sun.arch.data.model=64, path=/ops/portal/, java.vendor.url=https://www.redhat.com/, user.timezone=Asia/Shanghai, os.name=Linux, java.vm.specification.version=11, sun.java.launcher=SUN_STANDARD, user.country=CN, order=stop_plan, sun.boot.library.path=/usr/lib/jvm/java-11-openjdk-11.0.23.0.9-2.el7_9.x86_64/lib, sun.java.command=/ops/portal/portalControl-7.0.0rc1-exec.jar, jdk.debug=release, sun.cpu.endian=little, user.home=/home/mujianjiang, user.language=zh, java.specification.vendor=Oracle Corporation, java.version.date=2024-04-16, java.home=/usr/lib/jvm/java-11-openjdk-11.0.23.0.9-2.el7_9.x86_64, file.separator=/, java.vm.compressedOopsMode=32-bit, line.separator=
, java.specification.name=Java Platform API Specification, java.vm.specification.vendor=Oracle Corporation, java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment, java.protocol.handler.pkgs=org.springframework.boot.loader, sun.management.compiler=HotSpot 64-Bit Tiered Compilers, java.runtime.version=11.0.23+9-LTS, user.name=mujianjiang, skip=true, path.separator=:, os.version=3.10.0-1160.el7.x86_64, java.runtime.name=OpenJDK Runtime Environment, file.encoding=UTF-8, java.vm.name=OpenJDK 64-Bit Server VM, java.vendor.version=(Red_Hat-11.0.23.0.9-2.el7_9), java.vendor.url.bug=https://access.redhat.com/support/cases/, java.io.tmpdir=/tmp, order.invoked.timestamp=1745241407131, java.version=11.0.23, user.dir=/home/mujianjiang, os.arch=amd64, java.vm.specification.name=Java Virtual Machine Specification, java.awt.printerjob=sun.print.PSPrinterJob, sun.os.patch.level=unknown, java.library.path=/ops/portal/tools/chameleon/chameleon-7.0.0rc1:/ops/portal/tools/chameleon/chameleon-7.0.0rc1:/ops/portal/tools/chameleon/chameleon-7.0.0rc1:/ops/portal/tools/chameleon/chameleon-7.0.0rc1:/ops/portal/tools/chameleon/chameleon-7.0.0rc1:/ops/portal/tools/chameleon/chameleon-7.0.0rc1:/ops/portal/tools/chameleon/chameleon-6.0.0:/ops/portal/tools/chameleon/chameleon-6.0.0rc1:/ops/portal/tools/chameleon/chameleon-6.0.0rc1:/ops/portal/tools/chameleon/chameleon-6.0.0rc1:/ops/portal/tools/chameleon/chameleon-6.0.0rc1::/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib, java.vm.info=mixed mode, sharing, java.vendor=Red Hat, Inc., java.vm.version=11.0.23+9-LTS, java.specification.maintenance.version=2, sun.io.unicode.encoding=UnicodeLittle, java.class.version=55.0}
2025-04-21 21:16:57 [main] INFO  o.o.p.e.MigrationConfluentInstanceConfig - get MigrationConfluentInstanceConfig from system param = MigrationConfluentInstanceConfig(id=null, zookeeperPort=null, kafkaPort=null, zkIp=null, kafkaIp=null, installDir=null, bindPortalId=null, zkIpPort=null, kafkaIpPort=null, schemaRegistryIpPort=null, schemaRegistryIp=null, schemaRegistryPort=null, bindPortalHost=null, thirdPartySoftwareConfigType=null)
2025-04-21 21:16:57 [main] INFO  o.o.p.u.KafkaUtils - no need change param
2025-04-21 21:16:57 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/portal.portId.lock already exists.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/workspace/30 already exists.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/workspace/30/tmp/ already exists.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/workspace/30/logs already exists.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/workspace/30/status/ already exists.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/workspace/30/status/incremental/ already exists.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/workspace/30/status/portal.txt already exists.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/workspace/30/status/full_migration.txt already exists.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/workspace/30/status/incremental_migration.txt already exists.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/workspace/30/status/reverse_migration.txt already exists.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/workspace/30/logs/debezium/ already exists.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.FileUtils - File /ops/portal/workspace/30/logs/datacheck/ already exists.
2025-04-21 21:16:57 [main] INFO  o.o.p.u.ParamsUtils - global log level param is empty

【测试代码】:
无

openGauss/openGauss-migration-portal

内容风险标识

评论 (2)

openGauss/openGauss-migration-portal .gitee-modal { width: 500px !important; }

内容风险标识