npu-exporter启动找不到hccn_tool

我的yaml
```
---
apiVersion: apps/v1
kind: DaemonSet
metadata:
  name: npu-exporter
  namespace: kube-system
spec:
  selector:
    matchLabels:
      app: npu-exporter
  template:
    metadata:
      annotations:
        seccomp.security.alpha.kubernetes.io/pod: runtime/default
      labels:
        app: npu-exporter
    spec:
      nodeSelector:
        node-role.kubernetes.io/productName: huawei.com
        node-role.kubernetes.io/deviceType: Ascend310P
      containers:
      - name: npu-exporter
        image: 10.102.17.2/sys/ascend-npu-exporter:v5.0.RC3
        resources:
          requests:
              memory: 1000Mi
              cpu: 1000m
          limits:
              memory: 1000Mi
              cpu: 1000m
        imagePullPolicy: Always
        command: [ "/bin/bash", "-c", "--"]
        # pair firstly
        args: [ "umask 027;npu-exporter -port=8082 -ip=0.0.0.0  -updateTime=5
                 -logFile=/var/log/mindx-dl/npu-exporter/npu-exporter.log -logLevel=0 -containerMode=docker" ]
        securityContext:
          privileged: true
          readOnlyRootFilesystem: true
          runAsUser: 0
          runAsGroup: 0
        ports:
          - name: http
            containerPort: 8082
            protocol: TCP
        volumeMounts:
          - name: log-npu-exporter
            mountPath: /var/log/mindx-dl/npu-exporter
          - name: localtime
            mountPath: /etc/localtime
            readOnly: true
          - name: ascend-driver
            mountPath: /usr/local/Ascend/driver
            readOnly: true
          - name: ascend-dcmi
            mountPath: /usr/local/dcmi
            readOnly: true
          - name: sys
            mountPath: /sys
            readOnly: true
          - name: docker-shim  # delete when only use containerd or isula
            mountPath: /var/run/dockershim.sock
            readOnly: true
          - name: docker  # delete when only use containerd or isula
            mountPath: /var/run/docker
            readOnly: true
          - name: cri-dockerd  # reserve when k8s version is 1.24+ and the container runtime is docker
            mountPath: /var/run/cri-dockerd.sock
            readOnly: true
          - name: containerd  # delete when only use isula
            mountPath: /run/containerd
            readOnly: true
          - name: isulad  # delete when use containerd or docker
            mountPath: /run/isulad.sock
            readOnly: true
          - name: tmp
            mountPath: /tmp
      volumes:
        - name: log-npu-exporter
          hostPath:
            path: /var/log/mindx-dl/npu-exporter
            type: Directory
        - name: localtime
          hostPath:
            path: /etc/localtime
        - name: ascend-driver
          hostPath:
            path: /usr/local/Ascend/driver
        - name: ascend-dcmi
          hostPath:
            path: /usr/local/dcmi
        - name: sys
          hostPath:
            path: /sys
        - name: docker-shim # delete when only use containerd or isula
          hostPath:
            path: /var/run/dockershim.sock
        - name: docker  # delete when only use containerd or isula
          hostPath:
            path: /var/run/docker
        - name: cri-dockerd # reserve when k8s version is 1.24+ and the container runtime is docker
          hostPath:
            path: /var/run/cri-dockerd.sock
        - name: containerd  # delete when only use isula
          hostPath:
            path: /run/containerd
        - name: isulad  # delete when use containerd or docker
          hostPath:
            path: /run/isulad.sock
        - name: tmp
          hostPath:
            path: /tmp

```
错误日志
```
kubectl logs npu-exporter-8t85m -n kube-system
[INFO]     2024/08/13 15:53:02.898325 1       hwlog/api.go:108    npu-exporter.log's logger init success
[INFO]     2024/08/13 15:53:02.898565 1       npu-exporter/main.go:205    listen on: 0.0.0.0
[INFO]     2024/08/13 15:53:02.898616 1       npu-exporter/main.go:325    npu exporter starting and the version is v5.0.RC3_linux-x86_64
[WARN]     2024/08/13 15:53:03.218254 1       npu-exporter/main.go:339    enable unsafe http server
[WARN]     2024/08/13 15:53:08.219019 10      container/runtime_ops.go:150    failed to get OCI connection
[WARN]     2024/08/13 15:53:08.219101 10      container/runtime_ops.go:152    use backup address to try again
[INFO]     2024/08/13 15:53:08.219662 10      collector/npu_collector.go:240    Starting update cache every 5 seconds
[INFO]     2024/08/13 15:53:08.251820 38      collector/npu_collector.go:308    update cache,key is npu-exporter-containers-devices
[ERROR]    2024/08/13 15:53:08.252079 37      hccn/hccn_tool.go:221    get npu interface status failed, fork/exec /usr/local/Ascend/driver/tools/hccn_tool: no such file or directory
[ERROR]    2024/08/13 15:53:08.259782 37      hccn/hccn_tool.go:221    get npu interface status failed, fork/exec /usr/local/Ascend/driver/tools/hccn_tool: no such file or directory
[ERROR]    2024/08/13 15:53:08.267577 37      hccn/hccn_tool.go:221    get npu interface status failed, fork/exec /usr/local/Ascend/driver/tools/hccn_tool: no such file or directory
[ERROR]    2024/08/13 15:53:08.275601 37      hccn/hccn_tool.go:221    get npu interface status failed, fork/exec /usr/local/Ascend/driver/tools/hccn_tool: no such file or directory
[INFO]     2024/08/13 15:53:08.275630 37      collector/npu_collector.go:285    update cache,key is npu-exporter-network-info
[INFO]     2024/08/13 15:53:08.573334 36      collector/npu_collector.go:264    update cache,key is npu-exporter-npu-list
[INFO]     2024/08/13 15:53:13.240922 38      collector/npu_collector.go:308    update cache,key is npu-exporter-containers-devices
[ERROR]    2024/08/13 15:53:13.249472 37      hccn/hccn_tool.go:221    get npu interface status failed, fork/exec /usr/local/Ascend/driver/tools/hccn_tool: no such file or directory
[ERROR]    2024/08/13 15:53:13.257303 37      hccn/hccn_tool.go:221    get npu interface status failed, fork/exec /usr/local/Ascend/driver/tools/hccn_tool: no such file or directory
[ERROR]    2024/08/13 15:53:13.265322 37      hccn/hccn_tool.go:221    get npu interface status failed, fork/exec /usr/local/Ascend/driver/tools/hccn_tool: no such file or directory
[ERROR]    2024/08/13 15:53:13.272898 37      hccn/hccn_tool.go:221    get npu interface status failed, fork/exec /usr/local/Ascend/driver/tools/hccn_tool: no such file or directory
[INFO]     2024/08/13 15:53:13.272928 37      collector/npu_collector.go:285    update cache,key is npu-exporter-network-info
[INFO]     2024/08/13 15:53:13.569896 36      collector/npu_collector.go:264    update cache,key is npu-exporter-npu-list
[INFO]     2024/08/13 15:53:18.233317 38      collector/npu_collector.go:308    update cache,key is npu-exporter-containers-devices
[ERROR]    2024/08/13 15:53:18.246591 37      hccn/hccn_tool.go:221    get npu interface status failed, fork/exec /usr/local/Ascend/driver/tools/hccn_tool: no such file or directory
[ERROR]    2024/08/13 15:53:18.254970 37      hccn/hccn_tool.go:221    get npu interface status failed, fork/exec /usr/local/Ascend/driver/tools/hccn_tool: no such file or directory
[ERROR]    2024/08/13 15:53:18.263827 37      hccn/hccn_tool.go:221    get npu interface status failed, fork/exec /usr/local/Ascend/driver/tools/hccn_tool: no such file or directory
[ERROR]    2024/08/13 15:53:18.271911 37      hccn/hccn_tool.go:221    get npu interface status failed, fork/exec /usr/local/Ascend/driver/tools/hccn_tool: no such file or directory
[INFO]     2024/08/13 15:53:18.271938 37      collector/npu_collector.go:285    update cache,key is npu-exporter-network-info
[INFO]     2024/08/13 15:53:18.569092 36      collector/npu_collector.go:264    update cache,key is npu-exporter-npu-list
```

Ascend/ascend-npu-exporter
暂停

内容风险标识

评论 (3)

Ascend/ascend-npu-exporter暂停 .gitee-modal { width: 500px !important; }

内容风险标识