【测试类型：存储功能】【测试版本：6.0.0】【可靠性】极致RTO，执行tpcc过程中，备机异常FATAL后stop

【标题描述】: 执行tpcc过程中，备机异常panic后stop
【测试类型：SQL功能】【测试版本：6.0.0】 极致RTO，执行tpcc过程中，备机异常panic后stop

【操作系统和硬件信息】(查询命令: cat /etc/system-release, uname -a):
Kylin Linux Advanced Server release V10 (Sword)

【测试环境】(单机/1主x备x级联备):
一主两备

【被测功能】:
tpcc功能

【测试类型】:
功能测试

【数据库版本】(查询命令: gaussdb -V):
gaussdb (openGauss 6.0.0 build 211dba76) compiled at 2024-07-12 11:04:17 commit 0 last mr

【预置条件】:
1. 一主两备功能正常
2. enable_default_ustore_table = on

【操作步骤】(请填写详细的操作步骤):
1. tpcc建仓
2. 极致RTO配置
gs_guc set -N all -I all -c "replication_type=1" &&
gs_guc set -N all -I all -c "recovery_parse_workers=4" &&
gs_guc set -N all -I all -c "recovery_redo_workers=4" &&
gs_guc set -N all -I all -c "hot_standby=off" 
gs_om -t stop && gs_om -t start
3. tpcc执行
4. 查询主备状态
gs_om -t status --detail

【预期输出】:
1. tpcc建仓,成功
2. 极致RTO配置，成功
3. tpcc执行，成功
4. 查询主备状态，正常

【实际输出】:
1. tpcc建仓,成功
2. 极致RTO配置，成功
3. tpcc执行，成功
4. 查询主备状态，备机异常

【原因分析】:
1. 这个问题的根因
2. 问题推断过程
3. 还有哪些原因可能造成类似现象
4. 该问题是否有临时规避措施
5. 问题解决方案
6. 预计修复问题时间

【日志信息】(请附上日志文件、截图、coredump信息):
![输入图片说明](https://foruda.gitee.com/images/1720775691085827356/420b4f5e_8568116.png "屏幕截图")
 **未产生core，直接panic，pg日志如下：**

```
2024-07-12 15:02:27.490 6690d4ed.6154 [unknown] 281465858011072 dn_6002 0 dn_6001_6002_6003 XX001  0 [BACKEND] FATAL:  corrupted item pointer: 1114
2024-07-12 15:02:27.491 6690d4ed.6154 [unknown] 281465858011072 dn_6002 0 dn_6001_6002_6003 XX001  0 [BACKEND] CONTEXT:  xlog redo at lsn 1/F3048A0, XLOG_UHEAP_CLEAN: remxid 0. XLZ_CLEAN_CONTAINS_OFFSET. offnum 46, spcreq 4. ndeleted: 0, ndead: 0, nunused: 0, flags: 3.
2024-07-12 15:02:27.491 6690d4ed.6154 [unknown] 281465858011072 dn_6002 0 dn_6001_6002_6003 XX001  0 [BACKEND] BACKTRACELOG:  tid[144276]'s backtrace:
        /data/relia_app/relia0711/cluster/app/bin/gaussdb(+0xd83a18) [0xaaaae3676a18]
        /data/relia_app/relia0711/cluster/app/bin/gaussdb(_Z9errfinishiz+0x4a4) [0xaaaae3669a14]
        /data/relia_app/relia0711/cluster/app/bin/gaussdb(_Z24UPageRepairFragmentationP12RelationDataitmPbb+0x600) [0xaaaae4100650]
        /data/relia_app/relia0711/cluster/app/bin/gaussdb(_Z26UHeapXlogCleanOperatorPageP14RedoBufferInfoPvS1_m+0xf4) [0xaaaae410cc44]
        /data/relia_app/relia0711/cluster/app/bin/gaussdb(_Z18UHeapRedoDataBlockP13XLogBlockHeadP18XLogBlockDataParseP14RedoBufferInfo+0x1e4) [0xaaaae410ce84]
        /data/relia_app/relia0711/cluster/app/bin/gaussdb(_Z26XLogBlockRedoForExtremeRTOP17XLogRecParseStateP14RedoBufferInfobR12RedoTimeCostS4_+0x28c) [0xaaaae40bef1c]
        /data/relia_app/relia0711/cluster/app/bin/gaussdb(_ZN11extreme_rto18RedoPageWorkerMainEv+0x4e8) [0xaaaae3f8fe28]
        /data/relia_app/relia0711/cluster/app/bin/gaussdb(_ZN11extreme_rto12RedoMainLoopEv+0x208) [0xaaaae3f93ae8]
        /data/relia_app/relia0711/cluster/app/bin/gaussdb(_ZN11extreme_rto22ParallelRedoThreadMainEv+0x26c) [0xaaaae3f93d60]
        /data/relia_app/relia0711/cluster/app/bin/gaussdb(_Z17GaussDbThreadMainIL15knl_thread_role22EEiP14knl_thread_arg+0x400) [0xaaaae3ba4990]
        /data/relia_app/relia0711/cluster/app/bin/gaussdb(+0x1285dc0) [0xaaaae3b78dc0]
        /usr/lib64/libpthread.so.0(+0x87ac) [0xffffa90027ac]
        /usr/lib64/libc.so.6(+0xd60fc) [0xffffa8f4a0fc]
        Use addr2line to get pretty function name and line

2024-07-12 15:02:27.491 6690d4ea.1 [unknown] 281473514876944 [unknown] 0 dn_6001_6002_6003 DB010  0 [REDO] LOG:  page worker thread 281465858011072 exit, state 2
2024-07-12 15:02:27.491  [postmaster][reaper][281473514876944] LOG: aborting  due to page redo process failure
2024-07-12 15:02:27.492 6690d4ea.1 [unknown] 281473514876944 [unknown] 0 dn_6001_6002_6003 00000  0 [BACKEND] LOG:  page redo process (ThreadId 281465858011072) was terminated by signal 1: Hangup
2024-07-12 15:02:27.492  [postmaster][reaper][281473514876944] LOG: terminating any other active server processes
2024-07-12 15:02:27.492  [postmaster][reaper][281473514876944] LOG: page redo process (ThreadId 281465858011072) exited with exit code 0
2024-07-12 15:02:27.492  [postmaster][reaper][281473514876944] LOG: the server process exits
```

【测试代码】:

openGauss/openGauss-server

内容风险标识

评论 (4)

openGauss/openGauss-server .gitee-modal { width: 500px !important; }

内容风险标识