【openEuler 22.03-LTS-SP2】【arm】【飞腾2500】ltp执行用例cpuhotplug04导致机器卡住/文件系统损坏

【环境信息】
软件信息：
1） OS版本及分支：Kylin HostOS V10 
2） 内核信息：基于openEuler-22.03-LTS-SP2的内核源码编译的5.10内核
3） 配置信息：arch/arm64/configs/openeuler_defconfig
4） 软件组件：ltp-20230516
用例路径：/opt/ltp
执行结果存放路径：/opt/ltp/results/LTP-RUN-ON-*.log
【问题复现步骤】
具体操作步骤：
1.在ltp的官网下载ltp-20230516
2.cd ltp；./configure；make；make install
3.export PATH=/opt/ltp/testcases/bin/:$PATH
4.cpuhotplug04.sh -l 1 
【预期结果】
用例执行成功
【实际结果】
用例执行导致机器卡住，有回显，但是网络不通，系统异常输出。
【附件信息】
[  776.931832][  T552] Eff. affinity 62 of IRQ 147 contains only offline CPUs after offlining CPU 93
[  776.940662][  T552] Eff. affinity 63 of IRQ 148 contains only offline CPUs after offlining CPU 93
[  776.949621][ T6549] CPU93: shutdown
[  776.959583][ T6549] psci: CPU93 killed (polled 8 ms)

S2500 login: 
S2500 login: root
密码： 
上次登录：Mon Nov 27 15:14:49 from 10.41.121.118

Authorized users only. All activities may be monitored and reported.

[  946.790608][ T6546] sd 0:2:1:0: [sdb] tag#338 CDB: Read(16) 88 00 00 00 00 00 ad a5 a8 00 00 00 00 20 00 00
[  949.350594][ T6546] sd 0:2:1:0: [sdb] tag#182 CDB: Write(16) 8a 00 00 00 00 00 ad e2 3b 08 00 00 01 e8 00 00
[  949.360396][ T6546] sd 0:2:1:0: [sdb] tag#181 CDB: Write(16) 8a 00 00 00 00 00 97 74 bc 10 00 00 00 10 00 00

[  967.526597][ T6546] sd 0:2:1:0: [sdb] tag#73 CDB: Write(16) 8a 00 00 00 00 00 be 56 ae 00 00 00 02 00 00 00
[  973.658587][  T780] INFO: task kworker/u256:0:7 blocked for more than 120 seconds.
[  973.666132][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  973.672209][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  973.680708][  T780] task:kworker/u256:0  state:D stack:    0 pid:    7 ppid:     2 flags:0x00000008
[  973.689752][  T780] Workqueue: netns cleanup_net
[  973.694374][  T780] Call trace:
[  973.697528][  T780]  __switch_to+0x7c/0xbc
[  973.701626][  T780]  __schedule+0x344/0x744
[  973.705812][  T780]  schedule+0x50/0xdc
[  973.709646][  T780]  percpu_rwsem_wait+0xd4/0x1e4
[  973.714346][  T780]  __percpu_down_read+0x4c/0xc0
[  973.719053][  T780]  cpus_read_lock+0x5c/0x70
[  973.723408][  T780]  flush_all_backlogs+0x4c/0x1a0
[  973.728201][  T780]  unregister_netdevice_many+0x1a0/0x4c0
[  973.733672][  T780]  default_device_exit_batch+0x158/0x190
[  973.739152][  T780]  ops_exit_list+0x70/0x84
[  973.743423][  T780]  cleanup_net+0x184/0x2e0
[  973.747691][  T780]  process_one_work+0x1d4/0x4bc
[  973.752395][  T780]  worker_thread+0x158/0x410
[  973.756833][  T780]  kthread+0x108/0x13c
[  973.760759][  T780]  ret_from_fork+0x10/0x18
[  973.765071][  T780] INFO: task kworker/0:1:21 blocked for more than 120 seconds.
[  973.772447][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  973.778528][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  973.787029][  T780] task:kworker/0:1     state:D stack:    0 pid:   21 ppid:     2 flags:0x00000008
[  973.796059][  T780] Workqueue: events vmstat_shepherd
[  973.801106][  T780] Call trace:
[  973.804251][  T780]  __switch_to+0x7c/0xbc
[  973.808348][  T780]  __schedule+0x344/0x744
[  973.812527][  T780]  schedule+0x50/0xdc
[  973.816368][  T780]  percpu_rwsem_wait+0xd4/0x1e4
[  973.821064][  T780]  __percpu_down_read+0x4c/0xc0
[  973.825763][  T780]  cpus_read_lock+0x5c/0x70
[  973.830112][  T780]  vmstat_shepherd+0x3c/0x110
[  973.834638][  T780]  process_one_work+0x1d4/0x4bc
[  973.839335][  T780]  worker_thread+0x158/0x410
[  973.843774][  T780]  kthread+0x108/0x13c
[  973.847693][  T780]  ret_from_fork+0x10/0x18
[  973.852152][  T780] INFO: task kworker/94:1:659 blocked for more than 121 seconds.
[  973.859700][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  973.865777][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  973.874274][  T780] task:kworker/94:1    state:D stack:    0 pid:  659 ppid:     2 flags:0x00000008
[  973.883299][  T780] Workqueue: events cpuset_hotplug_workfn
[  973.888863][  T780] Call trace:
[  973.892004][  T780]  __switch_to+0x7c/0xbc
[  973.896099][  T780]  __schedule+0x344/0x744
[  973.900279][  T780]  schedule+0x50/0xdc
[  973.904111][  T780]  percpu_rwsem_wait+0xd4/0x1e4
[  973.908808][  T780]  __percpu_down_read+0x4c/0xc0
[  973.913504][  T780]  cpus_read_lock+0x5c/0x70
[  973.917858][  T780]  cpuset_hotplug_workfn+0x2ec/0x590
[  973.922986][  T780]  process_one_work+0x1d4/0x4bc
[  973.927679][  T780]  worker_thread+0x158/0x410
[  973.932116][  T780]  kthread+0x108/0x13c
[  973.936034][  T780]  ret_from_fork+0x10/0x18
[  973.940319][  T780] INFO: task kworker/u272:0:739 blocked for more than 121 seconds.
[  973.948050][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  973.954130][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  973.962629][  T780] task:kworker/u272:0  state:D stack:    0 pid:  739 ppid:     2 flags:0x00000008
[  973.971654][  T780] Workqueue: writeback wb_workfn (flush-253:0)
[  973.977648][  T780] Call trace:
[  973.980788][  T780]  __switch_to+0x7c/0xbc
[  973.984882][  T780]  __schedule+0x344/0x744
[  973.989059][  T780]  schedule+0x50/0xdc
[  973.992891][  T780]  io_schedule+0x44/0x64
[  973.996984][  T780]  rq_qos_wait+0xb8/0x13c
[  974.001162][  T780]  wbt_wait+0xa0/0x140
[  974.005081][  T780]  __rq_qos_throttle+0x38/0x50
[  974.009696][  T780]  blk_mq_submit_bio+0xf0/0x5a0
[  974.014392][  T780]  __submit_bio_noacct+0x248/0x280
[  974.019348][  T780]  submit_bio_noacct+0x4c/0xb0
[  974.023958][  T780]  submit_bio+0x50/0x150
[  974.028050][  T780]  iomap_submit_ioend+0x68/0xb0
[  974.032746][  T780]  iomap_writepages+0x48/0x60
[  974.037514][  T780]  xfs_vm_writepages+0xf0/0x150 [xfs]
[  974.042736][  T780]  do_writepages+0x5c/0xfc
[  974.047001][  T780]  __writeback_single_inode+0x4c/0x330
[  974.052304][  T780]  writeback_sb_inodes+0x22c/0x620
[  974.057261][  T780]  __writeback_inodes_wb+0x54/0xf0
[  974.062219][  T780]  wb_writeback+0x360/0x470
[  974.066578][  T780]  wb_check_old_data_flush+0xd8/0xf0
[  974.071710][  T780]  wb_do_writeback+0xa8/0x1e0
[  974.076233][  T780]  wb_workfn+0x80/0x1e0
[  974.080241][  T780]  process_one_work+0x1d4/0x4bc
[  974.084936][  T780]  worker_thread+0x158/0x410
[  974.089374][  T780]  kthread+0x108/0x13c
[  974.093294][  T780]  ret_from_fork+0x10/0x18
[  974.097635][  T780] INFO: task kworker/0:2:4544 blocked for more than 121 seconds.
[  974.105190][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  974.111269][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  974.119767][  T780] task:kworker/0:2     state:D stack:    0 pid: 4544 ppid:     2 flags:0x00000008
[  974.128798][  T780] Workqueue: events netstamp_clear
[  974.133754][  T780] Call trace:
[  974.136895][  T780]  __switch_to+0x7c/0xbc
[  974.140988][  T780]  __schedule+0x344/0x744
[  974.145167][  T780]  schedule+0x50/0xdc
[  974.149001][  T780]  percpu_rwsem_wait+0xd4/0x1e4
[  974.153698][  T780]  __percpu_down_read+0x4c/0xc0
[  974.158395][  T780]  cpus_read_lock+0x5c/0x70
[  974.162746][  T780]  static_key_enable+0x20/0x40
[  974.167357][  T780]  netstamp_clear+0x5c/0xac
[  974.171708][  T780]  process_one_work+0x1d4/0x4bc
[  974.176405][  T780]  worker_thread+0x158/0x410
[  974.180842][  T780]  kthread+0x108/0x13c
[  974.184759][  T780]  ret_from_fork+0x10/0x18
[  974.189026][  T780] INFO: task xfsaild/dm-0:4572 blocked for more than 121 seconds.
[  974.196658][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  974.202735][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  974.211232][  T780] task:xfsaild/dm-0    state:D stack:    0 pid: 4572 ppid:     2 flags:0x00000008
[  974.220250][  T780] Call trace:
[  974.223391][  T780]  __switch_to+0x7c/0xbc
[  974.227483][  T780]  __schedule+0x344/0x744
[  974.231661][  T780]  schedule+0x50/0xdc
[  974.235494][  T780]  io_schedule+0x44/0x64
[  974.239585][  T780]  rq_qos_wait+0xb8/0x13c
[  974.243764][  T780]  wbt_wait+0xa0/0x140
[  974.247691][  T780]  __rq_qos_throttle+0x38/0x50
[  974.252303][  T780]  blk_mq_submit_bio+0xf0/0x5a0
[  974.257001][  T780]  __submit_bio_noacct+0x248/0x280
[  974.261957][  T780]  submit_bio_noacct+0x4c/0xb0
[  974.266570][  T780]  submit_bio+0x50/0x150
[  974.270857][  T780]  xfs_buf_ioapply_map+0x1e0/0x2a0 [xfs]
[  974.276397][  T780]  _xfs_buf_ioapply+0xd0/0x180 [xfs]
[  974.281575][  T780]  __xfs_buf_submit+0xf4/0x270 [xfs]
[  974.286748][  T780]  xfs_buf_delwri_submit_buffers+0x128/0x270 [xfs]
[  974.293133][  T780]  xfs_buf_delwri_submit_nowait+0x1c/0x30 [xfs]
[  974.299260][  T780]  xfsaild_push+0x1ac/0x7f4 [xfs]
[  974.304177][  T780]  xfsaild+0x11c/0x280 [xfs]
[  974.308625][  T780]  kthread+0x108/0x13c
[  974.312546][  T780]  ret_from_fork+0x10/0x18
[  974.316859][  T780] INFO: task auditd:5865 blocked for more than 121 seconds.
[  974.323986][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  974.330065][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  974.338563][  T780] task:auditd          state:D stack:    0 pid: 5865 ppid:     1 flags:0x00000800
[  974.347589][  T780] Call trace:
[  974.350731][  T780]  __switch_to+0x7c/0xbc
[  974.354824][  T780]  __schedule+0x344/0x744
[  974.359002][  T780]  schedule+0x50/0xdc
[  974.362835][  T780]  io_schedule+0x44/0x64
[  974.366930][  T780]  wait_on_page_bit+0x1f8/0x3f0
[  974.371630][  T780]  wait_on_page_writeback+0x64/0xf0
[  974.376671][  T780]  write_cache_pages+0x150/0x4c4
[  974.381453][  T780]  iomap_writepages+0x34/0x60
[  974.386071][  T780]  xfs_vm_writepages+0xf0/0x150 [xfs]
[  974.391285][  T780]  do_writepages+0x5c/0xfc
[  974.395550][  T780]  __filemap_fdatawrite_range+0xd8/0x17c
[  974.401023][  T780]  file_write_and_wait_range+0x64/0xd0
[  974.406375][  T780]  xfs_file_fsync+0x60/0x210 [xfs]
[  974.411330][  T780]  vfs_fsync_range+0x3c/0x90
[  974.415768][  T780]  __arm64_sys_fsync+0x44/0x80
[  974.420377][  T780]  invoke_syscall+0x50/0x11c
[  974.424814][  T780]  el0_svc_common.constprop.0+0x158/0x164
[  974.430380][  T780]  do_el0_svc+0x2c/0xac
[  974.434385][  T780]  el0_svc+0x20/0x30
[  974.438128][  T780]  el0_sync_handler+0xb0/0xb4
[  974.442651][  T780]  el0_sync+0x160/0x180
[  974.446681][  T780] INFO: task cpuhotplug04.sh:6549 blocked for more than 121 seconds.
[  974.454578][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  974.460657][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  974.469153][  T780] task:cpuhotplug04.sh state:D stack:    0 pid: 6549 ppid:  6479 flags:0x00000200
[  974.478172][  T780] Call trace:
[  974.481314][  T780]  __switch_to+0x7c/0xbc
[  974.485406][  T780]  __schedule+0x344/0x744
[  974.489588][  T780]  schedule+0x50/0xdc
[  974.493421][  T780]  schedule_timeout+0x2c8/0x324
[  974.498119][  T780]  wait_for_common+0xf0/0x290
[  974.502644][  T780]  wait_for_completion+0x20/0x30
[  974.507426][  T780]  cpuhp_kick_ap+0x70/0x120
[  974.511776][  T780]  cpuhp_kick_ap_work+0x58/0x190
[  974.516560][  T780]  _cpu_down+0x178/0x2b0
[  974.520653][  T780]  cpu_device_down+0x4c/0x74
[  974.525093][  T780]  cpu_subsys_offline+0x18/0x2c
[  974.529790][  T780]  device_offline+0xfc/0x130
[  974.534227][  T780]  online_store+0x68/0xe0
[  974.538405][  T780]  dev_attr_store+0x20/0x34
[  974.542758][  T780]  sysfs_kf_write+0x4c/0x5c
[  974.547111][  T780]  kernfs_fop_write_iter+0x130/0x1c0
[  974.552242][  T780]  new_sync_write+0xec/0x18c
[  974.556678][  T780]  vfs_write+0x214/0x2ac
[  974.560771][  T780]  ksys_write+0x70/0xfc
[  974.564775][  T780]  __arm64_sys_write+0x24/0x30
[  974.569386][  T780]  invoke_syscall+0x50/0x11c
[  974.573822][  T780]  el0_svc_common.constprop.0+0x158/0x164
[  974.579381][  T780]  do_el0_svc+0x2c/0xac
[  974.583386][  T780]  el0_svc+0x20/0x30
[  974.587131][  T780]  el0_sync_handler+0xb0/0xb4
[  974.591653][  T780]  el0_sync+0x160/0x180
[  974.595660][  T780] INFO: task sshd:6803 blocked for more than 121 seconds.
[  974.602608][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  974.608690][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  974.617187][  T780] task:sshd            state:D stack:    0 pid: 6803 ppid:  5930 flags:0x00000200
[  974.626205][  T780] Call trace:
[  974.629347][  T780]  __switch_to+0x7c/0xbc
[  974.633440][  T780]  __schedule+0x344/0x744
[  974.637619][  T780]  schedule+0x50/0xdc
[  974.641454][  T780]  schedule_preempt_disabled+0x18/0x24
[  974.646756][  T780]  __mutex_lock.constprop.0+0x1e0/0x6b0
[  974.652144][  T780]  __mutex_lock_slowpath+0x1c/0x30
[  974.657100][  T780]  mutex_lock+0x64/0x70
[  974.661105][  T780]  __netlink_dump_start+0x7c/0x2c0
[  974.666064][  T780]  rtnetlink_rcv_msg+0x26c/0x360
[  974.670850][  T780]  netlink_rcv_skb+0x64/0x130
[  974.675376][  T780]  rtnetlink_rcv+0x20/0x30
[  974.679640][  T780]  netlink_unicast_kernel+0x60/0x130
[  974.684769][  T780]  netlink_unicast+0x110/0x1a4
[  974.689377][  T780]  netlink_sendmsg+0x39c/0x440
[  974.693986][  T780]  sock_sendmsg+0x48/0x70
[  974.698163][  T780]  __sys_sendto+0x120/0x14c
[  974.702515][  T780]  __arm64_sys_sendto+0x30/0x40
[  974.707210][  T780]  invoke_syscall+0x50/0x11c
[  974.711646][  T780]  el0_svc_common.constprop.0+0x158/0x164
[  974.717206][  T780]  do_el0_svc+0x2c/0xac
[  974.721209][  T780]  el0_svc+0x20/0x30
[  974.724954][  T780]  el0_sync_handler+0xb0/0xb4
[  974.729477][  T780]  el0_sync+0x160/0x180
[  974.733490][  T780] INFO: task bash:6890 blocked for more than 121 seconds.
[  974.740439][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  974.746517][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  974.755014][  T780] task:bash            state:D stack:    0 pid: 6890 ppid:  6807 flags:0x00000200
[  974.764033][  T780] Call trace:
[  974.767173][  T780]  __switch_to+0x7c/0xbc
[  974.771265][  T780]  __schedule+0x344/0x744
[  974.775445][  T780]  schedule+0x50/0xdc
[  974.779276][  T780]  schedule_timeout+0x2c8/0x324
[  974.783974][  T780]  wait_for_common+0xf0/0x290
[  974.788498][  T780]  wait_for_completion+0x20/0x30
[  974.793387][  T780]  xfs_buf_iowait+0x4c/0x140 [xfs]
[  974.798395][  T780]  __xfs_buf_submit+0x1d4/0x270 [xfs]
[  974.803651][  T780]  xfs_buf_read_map+0x12c/0x2d0 [xfs]
[  974.808911][  T780]  xfs_trans_read_buf_map+0x178/0x3e0 [xfs]
[  974.814703][  T780]  xfs_imap_to_bp+0x6c/0xc0 [xfs]
[  974.819621][  T780]  xfs_iget_cache_miss+0xb8/0x3b4 [xfs]
[  974.825054][  T780]  xfs_iget+0x1ac/0x380 [xfs]
[  974.829623][  T780]  xfs_lookup+0x10c/0x130 [xfs]
[  974.834361][  T780]  xfs_vn_lookup+0x84/0xb0 [xfs]
[  974.839147][  T780]  __lookup_slow+0x90/0x1b4
[  974.843502][  T780]  walk_component+0x118/0x1d0
[  974.848030][  T780]  path_lookupat+0x80/0x1a4
[  974.852386][  T780]  filename_lookup+0x9c/0x1a0
[  974.856914][  T780]  user_path_at_empty+0x50/0x6c
[  974.861613][  T780]  vfs_statx+0x90/0x164
[  974.865619][  T780]  __se_sys_newfstatat+0x3c/0x80
[  974.870404][  T780]  __arm64_sys_newfstatat+0x24/0x30
[  974.875448][  T780]  invoke_syscall+0x50/0x11c
[  974.879885][  T780]  el0_svc_common.constprop.0+0x158/0x164
[  974.885447][  T780]  do_el0_svc+0x2c/0xac
[  974.889453][  T780]  el0_svc+0x20/0x30
[  974.893201][  T780]  el0_sync_handler+0xb0/0xb4
[  974.897727][  T780]  el0_sync+0x160/0x180

文件系统损坏后，所有的命令无法执行：
[ 1273.609991][  T732] Eff. affinity 64 of IRQ 183 contains only offline CPUs after offlining CPU 121
[ 1273.618908][  T732] Eff. affinity 64 of IRQ 184 contains only offline CPUs after offlining CPU 121
[ 1273.627826][  T732] Eff. affinity 64 of IRQ 185 contains only offline CPUs after offlining CPU 121
[ 1273.636838][  T769] dm-0: writeback error on inode 1208026263, offset 1806336, sector 841076352
[ 1273.636849][  T769] dm-0: writeback error on inode 1208026263, offset 1810432, sector 841076360
[ 1273.636879][ T6682] CPU121: shutdown
[ 1273.645533][ T1614] XFS (dm-0): log I/O error -5
[ 1273.645537][ T1614] XFS (dm-0): Filesystem has been shut down due to log error (0x2).
[ 1273.645538][ T1614] XFS (dm-0): Please unmount the filesystem and rectify the problem(s).
[ 1273.645768][ T1614] XFS (dm-0): log I/O error -5
[ 1273.660540][ T6682] psci: CPU121 killed (polled 0 ms)
[ 1273.662389][ T1614] XFS (dm-0): log I/O error -5
[ 1273.692607][ T1614] XFS (dm-0): log I/O error -5
[ 1273.697222][ T1614] XFS (dm-0): log I/O error -5
[ 1273.701836][ T1614] XFS (dm-0): log I/O error -5
[ 1273.706605][  T769] dm-0: writeback error on inode 1744878199, offset 4554752, sector 1217351360
[ 1273.706663][  T769] dm-0: writeback error on inode 1744878199, offset 4558848, sector 1217351368
[ 1273.715437][  T769] dm-0: writeback error on inode 2415951784, offset 0, sector 1679895472

GVP openEuler/kernel
关闭

内容风险标识

评论 (2)

GVPopenEuler/kernel关闭

内容风险标识