fix issue: ai检查算法缺少disk参数 · Pull Request !65 · openEuler/sysSentry

issue：ai检查算法缺少disk参数
，https://gitee.com/src-openeuler/sysSentry/issues/IATHWL

设计文档：

![输入图片说明](https://foruda.gitee.com/images/1728456901632715613/9d1b01d9_14904829.png "屏幕截图")

开发自验证：

情况一：未显式指定disk参数，则默认启用系统所有磁盘。

配置：

```
[common]
absolute_threshold=40
slow_io_detect_frequency=1
log_level=info
# disk=default
;disk=sda,sdb,sdc
;disk=sda,sdb,sdc,default
;disk=sda ,as,default

[algorithm]
train_data_duration=24
train_update_duration=2
algorithm_type=n_sigma
boxplot_parameter=1.5
n_sigma_parameter=3

[sliding_window]
sliding_window_type=not_continuous
window_size=30
window_minimum_threshold=6
```

日志：

```
/root/anaconda3/bin/python /home/hyz/ai_block_io2/ai_block_io.py 
2024-10-09 11:50:16,990 - WARNING - [config_parser.py:92] - config of disk not found, the default value will be used.
2024-10-09 11:50:16,992 - INFO - [ai_block_io.py:58] - ai_block_io plug has found disks: ['sdf', 'sde', 'sdd', 'sdb', 'sdc', 'sda', 'nvme1n1', 'nvme0n1']
2024-10-09 11:50:16,992 - WARNING - [ai_block_io.py:64] - you not specify any disk or use default, so ai_block_io will enable all available disk.
2024-10-09 11:50:16,993 - INFO - [ai_block_io.py:78] - start to detection follow disk and it's metric: [disk: sdf, stage: bio, io_access_type: read,metric: latency, disk: sdf, stage: bio, io_access_type: write,metric: latency, disk: sde, stage: bio, io_access_type: read,metric: latency, disk: sde, stage: bio, io_access_type: write,metric: latency, disk: sdd, stage: bio, io_access_type: read,metric: latency, disk: sdd, stage: bio, io_access_type: write,metric: latency, disk: sdb, stage: bio, io_access_type: read,metric: latency, disk: sdb, stage: bio, io_access_type: write,metric: latency, disk: sdc, stage: bio, io_access_type: read,metric: latency, disk: sdc, stage: bio, io_access_type: write,metric: latency, disk: sda, stage: bio, io_access_type: read,metric: latency, disk: sda, stage: bio, io_access_type: write,metric: latency, disk: nvme1n1, stage: bio, io_access_type: read,metric: latency, disk: nvme1n1, stage: bio, io_access_type: write,metric: latency, disk: nvme0n1, stage: bio, io_access_type: read,metric: latency, disk: nvme0n1, stage: bio, io_access_type: write,metric: latency]
2024-10-09 11:50:16,993 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdf, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,993 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdf, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,993 - INFO - [ai_block_io.py:104] - add detector: disk_name: sde, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,993 - INFO - [ai_block_io.py:104] - add detector: disk_name: sde, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,993 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdd, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,993 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdd, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,993 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdb, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,993 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdb, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,993 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdc, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,993 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdc, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,993 - INFO - [ai_block_io.py:104] - add detector: disk_name: sda, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,994 - INFO - [ai_block_io.py:104] - add detector: disk_name: sda, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,994 - INFO - [ai_block_io.py:104] - add detector: disk_name: nvme1n1, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,994 - INFO - [ai_block_io.py:104] - add detector: disk_name: nvme1n1, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,994 - INFO - [ai_block_io.py:104] - add detector: disk_name: nvme0n1, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:16,994 - INFO - [ai_block_io.py:104] - add detector: disk_name: nvme0n1, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:21,090 - INFO - [ai_block_io.py:40] - receive signal: 2
2024-10-09 11:50:21,091 - ERROR - [result.py:96] - sentryctl: client connect error
2024-10-09 11:50:21,091 - INFO - [alarm_report.py:28] - Report ai_block_io FAIL: receive signal: 2

Process finished with exit code 2

```

情况二：使用default参数，启用系统所有磁盘。

配置：

```
[common]
absolute_threshold=40
slow_io_detect_frequency=1
log_level=info
 disk=default
;disk=sda,sdb,sdc
;disk=sda,sdb,sdc,default
;disk=sda ,as,default

[algorithm]
train_data_duration=24
train_update_duration=2
algorithm_type=n_sigma
boxplot_parameter=1.5
n_sigma_parameter=3

[sliding_window]
sliding_window_type=not_continuous
window_size=30
window_minimum_threshold=6
```

日志：

```
/root/anaconda3/bin/python /home/hyz/ai_block_io2/ai_block_io.py 
2024-10-09 11:50:47,492 - WARNING - [config_parser.py:92] - config of disk not found, the default value will be used.
2024-10-09 11:50:47,493 - INFO - [ai_block_io.py:58] - ai_block_io plug has found disks: ['sdf', 'sde', 'sdd', 'sdb', 'sdc', 'sda', 'nvme1n1', 'nvme0n1']
2024-10-09 11:50:47,493 - WARNING - [ai_block_io.py:64] - you not specify any disk or use default, so ai_block_io will enable all available disk.
2024-10-09 11:50:47,493 - INFO - [ai_block_io.py:78] - start to detection follow disk and it's metric: [disk: sdf, stage: bio, io_access_type: read,metric: latency, disk: sdf, stage: bio, io_access_type: write,metric: latency, disk: sde, stage: bio, io_access_type: read,metric: latency, disk: sde, stage: bio, io_access_type: write,metric: latency, disk: sdd, stage: bio, io_access_type: read,metric: latency, disk: sdd, stage: bio, io_access_type: write,metric: latency, disk: sdb, stage: bio, io_access_type: read,metric: latency, disk: sdb, stage: bio, io_access_type: write,metric: latency, disk: sdc, stage: bio, io_access_type: read,metric: latency, disk: sdc, stage: bio, io_access_type: write,metric: latency, disk: sda, stage: bio, io_access_type: read,metric: latency, disk: sda, stage: bio, io_access_type: write,metric: latency, disk: nvme1n1, stage: bio, io_access_type: read,metric: latency, disk: nvme1n1, stage: bio, io_access_type: write,metric: latency, disk: nvme0n1, stage: bio, io_access_type: read,metric: latency, disk: nvme0n1, stage: bio, io_access_type: write,metric: latency]
2024-10-09 11:50:47,493 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdf, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,493 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdf, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,493 - INFO - [ai_block_io.py:104] - add detector: disk_name: sde, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,493 - INFO - [ai_block_io.py:104] - add detector: disk_name: sde, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,493 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdd, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,493 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdd, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,493 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdb, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,493 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdb, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,493 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdc, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,494 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdc, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,494 - INFO - [ai_block_io.py:104] - add detector: disk_name: sda, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,494 - INFO - [ai_block_io.py:104] - add detector: disk_name: sda, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,494 - INFO - [ai_block_io.py:104] - add detector: disk_name: nvme1n1, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,494 - INFO - [ai_block_io.py:104] - add detector: disk_name: nvme1n1, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,494 - INFO - [ai_block_io.py:104] - add detector: disk_name: nvme0n1, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:47,494 - INFO - [ai_block_io.py:104] - add detector: disk_name: nvme0n1, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:50:51,005 - INFO - [ai_block_io.py:40] - receive signal: 2
2024-10-09 11:50:51,006 - ERROR - [result.py:96] - sentryctl: client connect error
2024-10-09 11:50:51,006 - INFO - [alarm_report.py:28] - Report ai_block_io FAIL: receive signal: 2

Process finished with exit code 2

```

情况三：指定多块磁盘，并用逗号分隔，启用多块磁盘中存在的磁盘。

配置：

```
[common]
absolute_threshold=40
slow_io_detect_frequency=1
log_level=info
; disk=default
disk=sda,sdb,sdc
;disk=sda,sdb,sdc,default
;disk=sda ,as,default

[algorithm]
train_data_duration=24
train_update_duration=2
algorithm_type=n_sigma
boxplot_parameter=1.5
n_sigma_parameter=3

[sliding_window]
sliding_window_type=not_continuous
window_size=30
window_minimum_threshold=6
```

日志：

```
/root/anaconda3/bin/python /home/hyz/ai_block_io2/ai_block_io.py 
2024-10-09 11:51:21,360 - INFO - [ai_block_io.py:58] - ai_block_io plug has found disks: ['sdf', 'sde', 'sdd', 'sdb', 'sdc', 'sda', 'nvme1n1', 'nvme0n1']
2024-10-09 11:51:21,360 - INFO - [ai_block_io.py:78] - start to detection follow disk and it's metric: [disk: sda, stage: bio, io_access_type: read,metric: latency, disk: sda, stage: bio, io_access_type: write,metric: latency, disk: sdb, stage: bio, io_access_type: read,metric: latency, disk: sdb, stage: bio, io_access_type: write,metric: latency, disk: sdc, stage: bio, io_access_type: read,metric: latency, disk: sdc, stage: bio, io_access_type: write,metric: latency]
2024-10-09 11:51:21,360 - INFO - [ai_block_io.py:104] - add detector: disk_name: sda, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:51:21,360 - INFO - [ai_block_io.py:104] - add detector: disk_name: sda, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:51:21,360 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdb, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:51:21,360 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdb, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:51:21,360 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdc, stage_name: bio, io_type_name: read, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:51:21,360 - INFO - [ai_block_io.py:104] - add detector: disk_name: sdc, stage_name: bio, io_type_name: write, metric_name: latency, threshold_type: [NSigmaThreshold, param is: 3.0], sliding_window_type: [NotContinuousSlidingWindow, window size: 30, threshold: 6]
2024-10-09 11:51:24,859 - INFO - [ai_block_io.py:40] - receive signal: 2
2024-10-09 11:51:24,860 - ERROR - [result.py:96] - sentryctl: client connect error
2024-10-09 11:51:24,860 - INFO - [alarm_report.py:28] - Report ai_block_io FAIL: receive signal: 2

Process finished with exit code 2

```

情况四：指定多块磁盘，并存在不存在的磁盘，则启用多块磁盘中存在的磁盘，并忽略不存在的磁盘。

配置：

```
[common]
absolute_threshold=40
slow_io_detect_frequency=1
log_level=info
; disk=default
;disk=sda,sdb,sdc
;disk=sda,sdb,sdc,default
disk=sda ,as,default

[algorithm]
train_data_duration=24
train_update_duration=2
algorithm_type=n_sigma
boxplot_parameter=1.5
n_sigma_parameter=3

[sliding_window]
sliding_window_type=not_continuous
window_size=30
window_minimum_threshold=6
```

日志：

```
/root/anaconda3/bin/python /home/hyz/ai_block_io2/ai_block_io.py 
2024-10-09 11:52:13,870 - INFO - [ai_block_io.py:58] - ai_block_io plug has found disks: ['sdf', 'sde', 'sdd', 'sdb', 'sdc', 'sda', 'nvme1n1', 'nvme0n1']
2024-10-09 11:52:13,870 - WARNING - [ai_block_io.py:77] - disk：[sda ] not in available disk list, so it will be ignored.
2024-10-09 11:52:13,870 - WARNING - [ai_block_io.py:77] - disk：[as] not in available disk list, so it will be ignored.
2024-10-09 11:52:13,870 - WARNING - [ai_block_io.py:77] - disk：[default] not in available disk list, so it will be ignored.
2024-10-09 11:52:13,870 - INFO - [ai_block_io.py:78] - start to detection follow disk and it's metric: []
2024-10-09 11:52:15,035 - INFO - [ai_block_io.py:40] - receive signal: 2
2024-10-09 11:52:15,036 - ERROR - [result.py:96] - sentryctl: client connect error
2024-10-09 11:52:15,036 - INFO - [alarm_report.py:28] - Report ai_block_io FAIL: receive signal: 2

Process finished with exit code 2

```

情况五：显式指定disk参数，但未指定value值，则不启用任何磁盘。
配置：

```
[common]
absolute_threshold=40
slow_io_detect_frequency=1
log_level=info
disk=

[algorithm]
train_data_duration=24
train_update_duration=2
algorithm_type=n_sigma
boxplot_parameter=1.5
n_sigma_parameter=3

[sliding_window]
sliding_window_type=not_continuous
window_size=30
window_minimum_threshold=6
```

日志：

```
/root/anaconda3/bin/python /home/hyz/ai_block_io2/ai_block_io.py 
2024-10-09 14:20:58,242 - WARNING - [config_parser.py:97] - you don't specify any disk.
2024-10-09 14:20:58,244 - INFO - [ai_block_io.py:58] - ai_block_io plug has found disks: ['sdf', 'sde', 'sdd', 'sdb', 'sdc', 'sda', 'nvme1n1', 'nvme0n1']
2024-10-09 14:20:58,244 - WARNING - [ai_block_io.py:69] - please attention: conf file not specify any disk to detection, so it will not start ai block io.
2024-10-09 14:20:58,244 - INFO - [ai_block_io.py:77] - start to detection follow disk and it's metric: []
2024-10-09 14:21:01,745 - INFO - [ai_block_io.py:40] - receive signal: 2
2024-10-09 14:21:01,747 - ERROR - [result.py:96] - sentryctl: client connect error
2024-10-09 14:21:01,747 - INFO - [alarm_report.py:28] - Report ai_block_io FAIL: receive signal: 2

Process finished with exit code 2

```

以上五种情况验证符合设计。

类型	指派人员	状态
审查	openeuler-ci-bot	已完成 (0/0人)
测试	openeuler-ci-bot	已完成 (0/0人)

openEuler/sysSentry .gitee-modal { width: 500px !important; }

搜索帮助

openEuler/sysSentry