【openEuler 22.03-LTS-SP2】【arm】【飞腾2500】ltp执行用例cpuhotplug04导致机器卡住/文件系统损坏

【环境信息】
软件信息：
1） OS版本及分支：Kylin HostOS V10 
2） 内核信息：基于openEuler-22.03-LTS-SP2的内核源码编译的5.10内核
3） 配置信息：arch/arm64/configs/openeuler_defconfig
4） 软件组件：ltp-20230516
用例路径：/opt/ltp
执行结果存放路径：/opt/ltp/results/LTP-RUN-ON-*.log
【问题复现步骤】
具体操作步骤：
1.在ltp的官网下载ltp-20230516
2.cd ltp；./configure；make；make install
3.export PATH=/opt/ltp/testcases/bin/:$PATH
4.cpuhotplug04.sh -l 1 
【预期结果】
用例执行成功
【实际结果】
用例执行导致机器卡住，有回显，但是网络不通，系统异常输出。
【附件信息】
[  776.931832][  T552] Eff. affinity 62 of IRQ 147 contains only offline CPUs after offlining CPU 93
[  776.940662][  T552] Eff. affinity 63 of IRQ 148 contains only offline CPUs after offlining CPU 93
[  776.949621][ T6549] CPU93: shutdown
[  776.959583][ T6549] psci: CPU93 killed (polled 8 ms)

S2500 login: 
S2500 login: root
密码： 
上次登录：Mon Nov 27 15:14:49 from 10.41.121.118

Authorized users only. All activities may be monitored and reported.

[  946.790608][ T6546] sd 0:2:1:0: [sdb] tag#338 CDB: Read(16) 88 00 00 00 00 00 ad a5 a8 00 00 00 00 20 00 00
[  949.350594][ T6546] sd 0:2:1:0: [sdb] tag#182 CDB: Write(16) 8a 00 00 00 00 00 ad e2 3b 08 00 00 01 e8 00 00
[  949.360396][ T6546] sd 0:2:1:0: [sdb] tag#181 CDB: Write(16) 8a 00 00 00 00 00 97 74 bc 10 00 00 00 10 00 00

[  967.526597][ T6546] sd 0:2:1:0: [sdb] tag#73 CDB: Write(16) 8a 00 00 00 00 00 be 56 ae 00 00 00 02 00 00 00
[  973.658587][  T780] INFO: task kworker/u256:0:7 blocked for more than 120 seconds.
[  973.666132][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  973.672209][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  973.680708][  T780] task:kworker/u256:0  state:D stack:    0 pid:    7 ppid:     2 flags:0x00000008
[  973.689752][  T780] Workqueue: netns cleanup_net
[  973.694374][  T780] Call trace:
[  973.697528][  T780]  __switch_to+0x7c/0xbc
[  973.701626][  T780]  __schedule+0x344/0x744
[  973.705812][  T780]  schedule+0x50/0xdc
[  973.709646][  T780]  percpu_rwsem_wait+0xd4/0x1e4
[  973.714346][  T780]  __percpu_down_read+0x4c/0xc0
[  973.719053][  T780]  cpus_read_lock+0x5c/0x70
[  973.723408][  T780]  flush_all_backlogs+0x4c/0x1a0
[  973.728201][  T780]  unregister_netdevice_many+0x1a0/0x4c0
[  973.733672][  T780]  default_device_exit_batch+0x158/0x190
[  973.739152][  T780]  ops_exit_list+0x70/0x84
[  973.743423][  T780]  cleanup_net+0x184/0x2e0
[  973.747691][  T780]  process_one_work+0x1d4/0x4bc
[  973.752395][  T780]  worker_thread+0x158/0x410
[  973.756833][  T780]  kthread+0x108/0x13c
[  973.760759][  T780]  ret_from_fork+0x10/0x18
[  973.765071][  T780] INFO: task kworker/0:1:21 blocked for more than 120 seconds.
[  973.772447][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  973.778528][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  973.787029][  T780] task:kworker/0:1     state:D stack:    0 pid:   21 ppid:     2 flags:0x00000008
[  973.796059][  T780] Workqueue: events vmstat_shepherd
[  973.801106][  T780] Call trace:
[  973.804251][  T780]  __switch_to+0x7c/0xbc
[  973.808348][  T780]  __schedule+0x344/0x744
[  973.812527][  T780]  schedule+0x50/0xdc
[  973.816368][  T780]  percpu_rwsem_wait+0xd4/0x1e4
[  973.821064][  T780]  __percpu_down_read+0x4c/0xc0
[  973.825763][  T780]  cpus_read_lock+0x5c/0x70
[  973.830112][  T780]  vmstat_shepherd+0x3c/0x110
[  973.834638][  T780]  process_one_work+0x1d4/0x4bc
[  973.839335][  T780]  worker_thread+0x158/0x410
[  973.843774][  T780]  kthread+0x108/0x13c
[  973.847693][  T780]  ret_from_fork+0x10/0x18
[  973.852152][  T780] INFO: task kworker/94:1:659 blocked for more than 121 seconds.
[  973.859700][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  973.865777][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  973.874274][  T780] task:kworker/94:1    state:D stack:    0 pid:  659 ppid:     2 flags:0x00000008
[  973.883299][  T780] Workqueue: events cpuset_hotplug_workfn
[  973.888863][  T780] Call trace:
[  973.892004][  T780]  __switch_to+0x7c/0xbc
[  973.896099][  T780]  __schedule+0x344/0x744
[  973.900279][  T780]  schedule+0x50/0xdc
[  973.904111][  T780]  percpu_rwsem_wait+0xd4/0x1e4
[  973.908808][  T780]  __percpu_down_read+0x4c/0xc0
[  973.913504][  T780]  cpus_read_lock+0x5c/0x70
[  973.917858][  T780]  cpuset_hotplug_workfn+0x2ec/0x590
[  973.922986][  T780]  process_one_work+0x1d4/0x4bc
[  973.927679][  T780]  worker_thread+0x158/0x410
[  973.932116][  T780]  kthread+0x108/0x13c
[  973.936034][  T780]  ret_from_fork+0x10/0x18
[  973.940319][  T780] INFO: task kworker/u272:0:739 blocked for more than 121 seconds.
[  973.948050][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  973.954130][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  973.962629][  T780] task:kworker/u272:0  state:D stack:    0 pid:  739 ppid:     2 flags:0x00000008
[  973.971654][  T780] Workqueue: writeback wb_workfn (flush-253:0)
[  973.977648][  T780] Call trace:
[  973.980788][  T780]  __switch_to+0x7c/0xbc
[  973.984882][  T780]  __schedule+0x344/0x744
[  973.989059][  T780]  schedule+0x50/0xdc
[  973.992891][  T780]  io_schedule+0x44/0x64
[  973.996984][  T780]  rq_qos_wait+0xb8/0x13c
[  974.001162][  T780]  wbt_wait+0xa0/0x140
[  974.005081][  T780]  __rq_qos_throttle+0x38/0x50
[  974.009696][  T780]  blk_mq_submit_bio+0xf0/0x5a0
[  974.014392][  T780]  __submit_bio_noacct+0x248/0x280
[  974.019348][  T780]  submit_bio_noacct+0x4c/0xb0
[  974.023958][  T780]  submit_bio+0x50/0x150
[  974.028050][  T780]  iomap_submit_ioend+0x68/0xb0
[  974.032746][  T780]  iomap_writepages+0x48/0x60
[  974.037514][  T780]  xfs_vm_writepages+0xf0/0x150 [xfs]
[  974.042736][  T780]  do_writepages+0x5c/0xfc
[  974.047001][  T780]  __writeback_single_inode+0x4c/0x330
[  974.052304][  T780]  writeback_sb_inodes+0x22c/0x620
[  974.057261][  T780]  __writeback_inodes_wb+0x54/0xf0
[  974.062219][  T780]  wb_writeback+0x360/0x470
[  974.066578][  T780]  wb_check_old_data_flush+0xd8/0xf0
[  974.071710][  T780]  wb_do_writeback+0xa8/0x1e0
[  974.076233][  T780]  wb_workfn+0x80/0x1e0
[  974.080241][  T780]  process_one_work+0x1d4/0x4bc
[  974.084936][  T780]  worker_thread+0x158/0x410
[  974.089374][  T780]  kthread+0x108/0x13c
[  974.093294][  T780]  ret_from_fork+0x10/0x18
[  974.097635][  T780] INFO: task kworker/0:2:4544 blocked for more than 121 seconds.
[  974.105190][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  974.111269][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  974.119767][  T780] task:kworker/0:2     state:D stack:    0 pid: 4544 ppid:     2 flags:0x00000008
[  974.128798][  T780] Workqueue: events netstamp_clear
[  974.133754][  T780] Call trace:
[  974.136895][  T780]  __switch_to+0x7c/0xbc
[  974.140988][  T780]  __schedule+0x344/0x744
[  974.145167][  T780]  schedule+0x50/0xdc
[  974.149001][  T780]  percpu_rwsem_wait+0xd4/0x1e4
[  974.153698][  T780]  __percpu_down_read+0x4c/0xc0
[  974.158395][  T780]  cpus_read_lock+0x5c/0x70
[  974.162746][  T780]  static_key_enable+0x20/0x40
[  974.167357][  T780]  netstamp_clear+0x5c/0xac
[  974.171708][  T780]  process_one_work+0x1d4/0x4bc
[  974.176405][  T780]  worker_thread+0x158/0x410
[  974.180842][  T780]  kthread+0x108/0x13c
[  974.184759][  T780]  ret_from_fork+0x10/0x18
[  974.189026][  T780] INFO: task xfsaild/dm-0:4572 blocked for more than 121 seconds.
[  974.196658][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  974.202735][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  974.211232][  T780] task:xfsaild/dm-0    state:D stack:    0 pid: 4572 ppid:     2 flags:0x00000008
[  974.220250][  T780] Call trace:
[  974.223391][  T780]  __switch_to+0x7c/0xbc
[  974.227483][  T780]  __schedule+0x344/0x744
[  974.231661][  T780]  schedule+0x50/0xdc
[  974.235494][  T780]  io_schedule+0x44/0x64
[  974.239585][  T780]  rq_qos_wait+0xb8/0x13c
[  974.243764][  T780]  wbt_wait+0xa0/0x140
[  974.247691][  T780]  __rq_qos_throttle+0x38/0x50
[  974.252303][  T780]  blk_mq_submit_bio+0xf0/0x5a0
[  974.257001][  T780]  __submit_bio_noacct+0x248/0x280
[  974.261957][  T780]  submit_bio_noacct+0x4c/0xb0
[  974.266570][  T780]  submit_bio+0x50/0x150
[  974.270857][  T780]  xfs_buf_ioapply_map+0x1e0/0x2a0 [xfs]
[  974.276397][  T780]  _xfs_buf_ioapply+0xd0/0x180 [xfs]
[  974.281575][  T780]  __xfs_buf_submit+0xf4/0x270 [xfs]
[  974.286748][  T780]  xfs_buf_delwri_submit_buffers+0x128/0x270 [xfs]
[  974.293133][  T780]  xfs_buf_delwri_submit_nowait+0x1c/0x30 [xfs]
[  974.299260][  T780]  xfsaild_push+0x1ac/0x7f4 [xfs]
[  974.304177][  T780]  xfsaild+0x11c/0x280 [xfs]
[  974.308625][  T780]  kthread+0x108/0x13c
[  974.312546][  T780]  ret_from_fork+0x10/0x18
[  974.316859][  T780] INFO: task auditd:5865 blocked for more than 121 seconds.
[  974.323986][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  974.330065][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  974.338563][  T780] task:auditd          state:D stack:    0 pid: 5865 ppid:     1 flags:0x00000800
[  974.347589][  T780] Call trace:
[  974.350731][  T780]  __switch_to+0x7c/0xbc
[  974.354824][  T780]  __schedule+0x344/0x744
[  974.359002][  T780]  schedule+0x50/0xdc
[  974.362835][  T780]  io_schedule+0x44/0x64
[  974.366930][  T780]  wait_on_page_bit+0x1f8/0x3f0
[  974.371630][  T780]  wait_on_page_writeback+0x64/0xf0
[  974.376671][  T780]  write_cache_pages+0x150/0x4c4
[  974.381453][  T780]  iomap_writepages+0x34/0x60
[  974.386071][  T780]  xfs_vm_writepages+0xf0/0x150 [xfs]
[  974.391285][  T780]  do_writepages+0x5c/0xfc
[  974.395550][  T780]  __filemap_fdatawrite_range+0xd8/0x17c
[  974.401023][  T780]  file_write_and_wait_range+0x64/0xd0
[  974.406375][  T780]  xfs_file_fsync+0x60/0x210 [xfs]
[  974.411330][  T780]  vfs_fsync_range+0x3c/0x90
[  974.415768][  T780]  __arm64_sys_fsync+0x44/0x80
[  974.420377][  T780]  invoke_syscall+0x50/0x11c
[  974.424814][  T780]  el0_svc_common.constprop.0+0x158/0x164
[  974.430380][  T780]  do_el0_svc+0x2c/0xac
[  974.434385][  T780]  el0_svc+0x20/0x30
[  974.438128][  T780]  el0_sync_handler+0xb0/0xb4
[  974.442651][  T780]  el0_sync+0x160/0x180
[  974.446681][  T780] INFO: task cpuhotplug04.sh:6549 blocked for more than 121 seconds.
[  974.454578][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  974.460657][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  974.469153][  T780] task:cpuhotplug04.sh state:D stack:    0 pid: 6549 ppid:  6479 flags:0x00000200
[  974.478172][  T780] Call trace:
[  974.481314][  T780]  __switch_to+0x7c/0xbc
[  974.485406][  T780]  __schedule+0x344/0x744
[  974.489588][  T780]  schedule+0x50/0xdc
[  974.493421][  T780]  schedule_timeout+0x2c8/0x324
[  974.498119][  T780]  wait_for_common+0xf0/0x290
[  974.502644][  T780]  wait_for_completion+0x20/0x30
[  974.507426][  T780]  cpuhp_kick_ap+0x70/0x120
[  974.511776][  T780]  cpuhp_kick_ap_work+0x58/0x190
[  974.516560][  T780]  _cpu_down+0x178/0x2b0
[  974.520653][  T780]  cpu_device_down+0x4c/0x74
[  974.525093][  T780]  cpu_subsys_offline+0x18/0x2c
[  974.529790][  T780]  device_offline+0xfc/0x130
[  974.534227][  T780]  online_store+0x68/0xe0
[  974.538405][  T780]  dev_attr_store+0x20/0x34
[  974.542758][  T780]  sysfs_kf_write+0x4c/0x5c
[  974.547111][  T780]  kernfs_fop_write_iter+0x130/0x1c0
[  974.552242][  T780]  new_sync_write+0xec/0x18c
[  974.556678][  T780]  vfs_write+0x214/0x2ac
[  974.560771][  T780]  ksys_write+0x70/0xfc
[  974.564775][  T780]  __arm64_sys_write+0x24/0x30
[  974.569386][  T780]  invoke_syscall+0x50/0x11c
[  974.573822][  T780]  el0_svc_common.constprop.0+0x158/0x164
[  974.579381][  T780]  do_el0_svc+0x2c/0xac
[  974.583386][  T780]  el0_svc+0x20/0x30
[  974.587131][  T780]  el0_sync_handler+0xb0/0xb4
[  974.591653][  T780]  el0_sync+0x160/0x180
[  974.595660][  T780] INFO: task sshd:6803 blocked for more than 121 seconds.
[  974.602608][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  974.608690][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  974.617187][  T780] task:sshd            state:D stack:    0 pid: 6803 ppid:  5930 flags:0x00000200
[  974.626205][  T780] Call trace:
[  974.629347][  T780]  __switch_to+0x7c/0xbc
[  974.633440][  T780]  __schedule+0x344/0x744
[  974.637619][  T780]  schedule+0x50/0xdc
[  974.641454][  T780]  schedule_preempt_disabled+0x18/0x24
[  974.646756][  T780]  __mutex_lock.constprop.0+0x1e0/0x6b0
[  974.652144][  T780]  __mutex_lock_slowpath+0x1c/0x30
[  974.657100][  T780]  mutex_lock+0x64/0x70
[  974.661105][  T780]  __netlink_dump_start+0x7c/0x2c0
[  974.666064][  T780]  rtnetlink_rcv_msg+0x26c/0x360
[  974.670850][  T780]  netlink_rcv_skb+0x64/0x130
[  974.675376][  T780]  rtnetlink_rcv+0x20/0x30
[  974.679640][  T780]  netlink_unicast_kernel+0x60/0x130
[  974.684769][  T780]  netlink_unicast+0x110/0x1a4
[  974.689377][  T780]  netlink_sendmsg+0x39c/0x440
[  974.693986][  T780]  sock_sendmsg+0x48/0x70
[  974.698163][  T780]  __sys_sendto+0x120/0x14c
[  974.702515][  T780]  __arm64_sys_sendto+0x30/0x40
[  974.707210][  T780]  invoke_syscall+0x50/0x11c
[  974.711646][  T780]  el0_svc_common.constprop.0+0x158/0x164
[  974.717206][  T780]  do_el0_svc+0x2c/0xac
[  974.721209][  T780]  el0_svc+0x20/0x30
[  974.724954][  T780]  el0_sync_handler+0xb0/0xb4
[  974.729477][  T780]  el0_sync+0x160/0x180
[  974.733490][  T780] INFO: task bash:6890 blocked for more than 121 seconds.
[  974.740439][  T780]       Not tainted 5.10.0euler-2203-lts-sp2 #9
[  974.746517][  T780] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  974.755014][  T780] task:bash            state:D stack:    0 pid: 6890 ppid:  6807 flags:0x00000200
[  974.764033][  T780] Call trace:
[  974.767173][  T780]  __switch_to+0x7c/0xbc
[  974.771265][  T780]  __schedule+0x344/0x744
[  974.775445][  T780]  schedule+0x50/0xdc
[  974.779276][  T780]  schedule_timeout+0x2c8/0x324
[  974.783974][  T780]  wait_for_common+0xf0/0x290
[  974.788498][  T780]  wait_for_completion+0x20/0x30
[  974.793387][  T780]  xfs_buf_iowait+0x4c/0x140 [xfs]
[  974.798395][  T780]  __xfs_buf_submit+0x1d4/0x270 [xfs]
[  974.803651][  T780]  xfs_buf_read_map+0x12c/0x2d0 [xfs]
[  974.808911][  T780]  xfs_trans_read_buf_map+0x178/0x3e0 [xfs]
[  974.814703][  T780]  xfs_imap_to_bp+0x6c/0xc0 [xfs]
[  974.819621][  T780]  xfs_iget_cache_miss+0xb8/0x3b4 [xfs]
[  974.825054][  T780]  xfs_iget+0x1ac/0x380 [xfs]
[  974.829623][  T780]  xfs_lookup+0x10c/0x130 [xfs]
[  974.834361][  T780]  xfs_vn_lookup+0x84/0xb0 [xfs]
[  974.839147][  T780]  __lookup_slow+0x90/0x1b4
[  974.843502][  T780]  walk_component+0x118/0x1d0
[  974.848030][  T780]  path_lookupat+0x80/0x1a4
[  974.852386][  T780]  filename_lookup+0x9c/0x1a0
[  974.856914][  T780]  user_path_at_empty+0x50/0x6c
[  974.861613][  T780]  vfs_statx+0x90/0x164
[  974.865619][  T780]  __se_sys_newfstatat+0x3c/0x80
[  974.870404][  T780]  __arm64_sys_newfstatat+0x24/0x30
[  974.875448][  T780]  invoke_syscall+0x50/0x11c
[  974.879885][  T780]  el0_svc_common.constprop.0+0x158/0x164
[  974.885447][  T780]  do_el0_svc+0x2c/0xac
[  974.889453][  T780]  el0_svc+0x20/0x30
[  974.893201][  T780]  el0_sync_handler+0xb0/0xb4
[  974.897727][  T780]  el0_sync+0x160/0x180

文件系统损坏后，所有的命令无法执行：
[ 1273.609991][  T732] Eff. affinity 64 of IRQ 183 contains only offline CPUs after offlining CPU 121
[ 1273.618908][  T732] Eff. affinity 64 of IRQ 184 contains only offline CPUs after offlining CPU 121
[ 1273.627826][  T732] Eff. affinity 64 of IRQ 185 contains only offline CPUs after offlining CPU 121
[ 1273.636838][  T769] dm-0: writeback error on inode 1208026263, offset 1806336, sector 841076352
[ 1273.636849][  T769] dm-0: writeback error on inode 1208026263, offset 1810432, sector 841076360
[ 1273.636879][ T6682] CPU121: shutdown
[ 1273.645533][ T1614] XFS (dm-0): log I/O error -5
[ 1273.645537][ T1614] XFS (dm-0): Filesystem has been shut down due to log error (0x2).
[ 1273.645538][ T1614] XFS (dm-0): Please unmount the filesystem and rectify the problem(s).
[ 1273.645768][ T1614] XFS (dm-0): log I/O error -5
[ 1273.660540][ T6682] psci: CPU121 killed (polled 0 ms)
[ 1273.662389][ T1614] XFS (dm-0): log I/O error -5
[ 1273.692607][ T1614] XFS (dm-0): log I/O error -5
[ 1273.697222][ T1614] XFS (dm-0): log I/O error -5
[ 1273.701836][ T1614] XFS (dm-0): log I/O error -5
[ 1273.706605][  T769] dm-0: writeback error on inode 1744878199, offset 4554752, sector 1217351360
[ 1273.706663][  T769] dm-0: writeback error on inode 1744878199, offset 4558848, sector 1217351368
[ 1273.715437][  T769] dm-0: writeback error on inode 2415951784, offset 0, sector 1679895472

Hi cuiyudong123, welcome to the openEuler Community.
I'm the Bot here serving you. You can find the instructions on how to interact with me at Here.
If you have any questions, please contact the SIG: Kernel, and any of the maintainers.

GVP openEuler/kernel

内容风险标识

评论 (2)

GVPopenEuler/kernel

内容风险标识