docker镜像升级的掉电场景，kubeos-temp等残留资源未清理干净，导致重试升级失败

【问题复现步骤】
配置docker镜像进行升级，在升级过程中reboot节点

【预期结果】
节点掉电后恢复，并被master节点再次下发升级任务，再次升级成功

【实际结果】
master节点再次下发升级任务后，由于上一次残留的kubeos-temp容器未清理干净，导致再次升级失败：
```
Aug 23 14:12:03 node4 os-agent[543]: time="2022-08-23T14:12:03Z" level=info msg="start pull rnd-dockerhub.huawei.com/official/kubeos_euleros_arm64_2209lts_test_dc_1:1.0"
Aug 23 14:12:05 node4 os-agent[543]: time="2022-08-23T14:12:05Z" level=error msg="update error Error response from daemon: Conflict. The container name \"/kubeos-temp\" is already in use by container \"859121515aad7043203385c7c8b02bc5992b9686408858f2a43ddb39c301e0b1\". You have to remove (or rename) that container to be able to reuse that name."
Aug 23 14:12:15 node4 os-agent[543]: time="2022-08-23T14:12:15Z" level=info msg="start to update to KubeOS EulerOS_ARM64_2209LTS_test_dc_1"
Aug 23 14:12:15 node4 os-agent[543]: time="2022-08-23T14:12:15Z" level=info msg="start pull rnd-dockerhub.huawei.com/official/kubeos_euleros_arm64_2209lts_test_dc_1:1.0"
Aug 23 14:12:15 node4 os-agent[543]: time="2022-08-23T14:12:15Z" level=error msg="update error Error response from daemon: Conflict. The container name \"/kubeos-temp\" is already in use by container \"859121515aad7043203385c7c8b02bc5992b9686408858f2a43ddb39c301e0b1\". You have to remove (or rename) that container to be able to reuse that name."
ZAug 23 14:12:35 node4 os-agent[543]: time="2022-08-23T14:12:35Z" level=info msg="start to update to KubeOS EulerOS_ARM64_2209LTS_test_dc_1"
Aug 23 14:12:35 node4 os-agent[543]: time="2022-08-23T14:12:35Z" level=info msg="start pull rnd-dockerhub.huawei.com/official/kubeos_euleros_arm64_2209lts_test_dc_1:1.0"
Aug 23 14:12:36 node4 os-agent[543]: time="2022-08-23T14:12:36Z" level=error msg="update error Error response from daemon: Conflict. The container name \"/kubeos-temp\" is already in use by container \"859121515aad7043203385c7c8b02bc5992b9686408858f2a43ddb39c301e0b1\". You have to remove (or rename) that container to be able to reuse that name."
Aug 23 14:13:17 node4 os-agent[543]: time="2022-08-23T14:13:17Z" level=info msg="start to update to KubeOS EulerOS_ARM64_2209LTS_test_dc_1"
Aug 23 14:13:17 node4 os-agent[543]: time="2022-08-23T14:13:17Z" level=info msg="start pull rnd-dockerhub.huawei.com/official/kubeos_euleros_arm64_2209lts_test_dc_1:1.0"
Aug 23 14:13:17 node4 os-agent[543]: time="2022-08-23T14:13:17Z" level=error msg="update error Error response from daemon: Conflict. The container name \"/kubeos-temp\" is already in use by container \"859121515aad7043203385c7c8b02bc5992b9686408858f2a43ddb39c301e0b1\". You have to remove (or rename) that container to be able to reuse that name."
^C^C
[root@node4 ~]# docker images
REPOSITORY                                                                 TAG                 IMAGE ID            CREATED             SIZE
rnd-dockerhub.huawei.com/official/kubeos_euleros_arm64_2209lts_test_dc_2   1.0                 7352a5e8dace        2 hours ago         1.4GB
rnd-dockerhub.huawei.com/official/kubeos_euleros_arm64_2209lts_test_dc_1   1.0                 41c772a94300        2 hours ago         1.4GB
rnd-dockerhub.huawei.com/official/proxy_2209_test_aarch64                  1.0                 534fda5abd11        2 hours ago         339MB
calico/node                                                                v3.19.1             dd6d43d932df        15 months ago       116MB
calico/cni                                                                 v3.19.1             af1a713b9155        15 months ago       137MB
k8s.gcr.io/kube-proxy                                                      v1.20.2             788e63d07298        19 months ago       116MB
calico/pod2daemon-flexvol                                                  v3.19.1             f490e49f9222        21 months ago       9.41MB
k8s.gcr.io/pause                                                           3.2                 2a060e2e7101        2 years ago         484kB
[root@node4 ~]# docker ps -a 
CONTAINER ID        IMAGE                                                                          COMMAND                  CREATED             STATUS                       PORTS               NAMES
522aaa4054ac        534fda5abd11                                                                   "/proxy"                 2 minutes ago       Up 2 minutes                                     k8s_proxy_upgrade-proxy-bvp9s_upgrade-system_04206308-a0c6-456a-9991-b328164398b5_18
35196bd1055d        dd6d43d932df                                                                   "start_runit"            2 minutes ago       Up 2 minutes                                     k8s_calico-node_calico-node-j4rrf_kube-system_ca146d3e-c399-4a8a-a7f3-26db5b6bb0bc_26
9b86f66d5a9d        534fda5abd11                                                                   "/proxy"                 3 minutes ago       Exited (1) 2 minutes ago                         k8s_proxy_upgrade-proxy-bvp9s_upgrade-system_04206308-a0c6-456a-9991-b328164398b5_17
96c71f7a70a1        dd6d43d932df                                                                   "start_runit"            3 minutes ago       Created                                          k8s_calico-node_calico-node-j4rrf_kube-system_ca146d3e-c399-4a8a-a7f3-26db5b6bb0bc_25
4e7084a99b75        k8s.gcr.io/pause:3.2                                                           "/pause"                 3 minutes ago       Up 3 minutes                                     k8s_POD_upgrade-proxy-bvp9s_upgrade-system_04206308-a0c6-456a-9991-b328164398b5_6
aaa05aa6702f        f490e49f9222                                                                   "/usr/local/bin/flex…"   4 minutes ago       Exited (0) 4 minutes ago                         k8s_flexvol-driver_calico-node-j4rrf_kube-system_ca146d3e-c399-4a8a-a7f3-26db5b6bb0bc_0
524f4b3d240f        af1a713b9155                                                                   "/opt/cni/bin/install"   4 minutes ago       Exited (0) 4 minutes ago                         k8s_install-cni_calico-node-j4rrf_kube-system_ca146d3e-c399-4a8a-a7f3-26db5b6bb0bc_0
65c376c87e4d        788e63d07298                                                                   "/usr/local/bin/kube…"   4 minutes ago       Up 4 minutes                                     k8s_kube-proxy_kube-proxy-cj67t_kube-system_c3e4ba12-c588-4cff-94b3-7df2ae112688_8
f268173425ef        af1a713b9155                                                                   "/opt/cni/bin/calico…"   4 minutes ago       Exited (0) 4 minutes ago                         k8s_upgrade-ipam_calico-node-j4rrf_kube-system_ca146d3e-c399-4a8a-a7f3-26db5b6bb0bc_8
5a9522d4ffac        k8s.gcr.io/pause:3.2                                                           "/pause"                 4 minutes ago       Up 4 minutes                                     k8s_POD_calico-node-j4rrf_kube-system_ca146d3e-c399-4a8a-a7f3-26db5b6bb0bc_8
fabfee8e246a        k8s.gcr.io/pause:3.2                                                           "/pause"                 4 minutes ago       Up 4 minutes                                     k8s_POD_kube-proxy-cj67t_kube-system_c3e4ba12-c588-4cff-94b3-7df2ae112688_8
859121515aad        rnd-dockerhub.huawei.com/official/kubeos_euleros_arm64_2209lts_test_dc_1:1.0   "/bin/sh"                5 minutes ago       Created                                          kubeos-temp
565058494a3d        788e63d07298                                                                   "/usr/local/bin/kube…"   13 minutes ago      Exited (255) 4 minutes ago                       k8s_kube-proxy_kube-proxy-cj67t_kube-system_c3e4ba12-c588-4cff-94b3-7df2ae112688_7
b3dac428204b        k8s.gcr.io/pause:3.2                                                           "/pause"                 13 minutes ago      Exited (255) 4 minutes ago                       k8s_POD_kube-proxy-cj67t_kube-system_c3e4ba12-c588-4cff-94b3-7df2ae112688_7
[root@node4 ~]# 
```

建议排查升级流程中所有资源创建的步骤，确保正式升级前已完成残留资源的清理

src-openEuler/KubeOS
关闭

内容风险标识

评论 (1)

src-openEuler/KubeOS关闭 .gitee-modal { width: 500px !important; }

内容风险标识