Sign in
Sign up
Explore
Enterprise
Education
Search
Help
Terms of use
About Us
Explore
Enterprise
Education
Gitee Premium
Gitee AI
AI teammates
Sign in
Sign up
Fetch the repository succeeded.
description of repo status
Donate
Please sign in before you donate.
Cancel
Sign in
Scan WeChat QR to Pay
Cancel
Complete
Prompt
Switch to Alipay.
OK
Cancel
Watch
Unwatch
Watching
Releases Only
Ignoring
15
Star
11
Fork
109
src-openEuler
/
systemd
Closed
Code
Issues
9
Pull Requests
2
Wiki
Insights
Pipelines
Service
JavaDoc
PHPDoc
Quality Analysis
Jenkins for Gitee
Tencent CloudBase
Tencent Cloud Serverless
悬镜安全
Aliyun SAE
Codeblitz
SBOM
DevLens
Don’t show this again
Update failed. Please try again later!
Remove this flag
Content Risk Flag
This task is identified by
as the content contains sensitive information such as code security bugs, privacy leaks, etc., so it is only accessible to contributors of this repository.
同时创建140+systemd的服务的时候systemd卡主,多个服务启动失败
Done
#IAFI5I
Bug
sweetbreeze
Opened this issue
2024-07-25 14:32
**【标题描述】能够简要描述问题:说明什么场景下,做了什么操作,出现什么问题(尽量使用正向表达方式)** **一、缺陷信息** **内核信息:5.10.0-136.69.0.149.oe2203sp1.x86_64 **缺陷归属组件:systemd **缺陷归属的版本:systemd 249 (v249-64.oe2203sp1) **缺陷简述:systemctl 并行 start 142个service服务时卡住; - 如果有特殊组网,请提供网络拓扑信息 systemd服务: [Unit] Description=XXX daemon osd.%i After=network-online.target local-fs.target time-sync.target ceph-mon.target hik_fw.service Wants=network-online.target local-fs.target time-sync.target PartOf=ceph-osd.target [Service] LimitNOFILE=1048576 LimitNPROC=1048576 ExecStart=/usr/bin/daemon -f --cluster ${CLUSTER} --id %i --setuser ceph --setgroup ceph ExecStartPre=/usr/lib/ceph/test-prestart.sh --cluster ${CLUSTER} --id %i ExecStartPost=/usr/lib/ceph/test_coredump.sh -set %i ExecReload=/bin/kill -HUP $MAINPID ProtectHome=read-only ProtectSystem=full PrivateTmp=true #TasksMax=infinity Restart=always StartLimitInterval=20min StartLimitBurst=3 RestartSec=30s Nice=-20 [Install] WantedBy=ceph-osd.target 【问题复现步骤】: 1、CEPH在创建OSD的时候,脚本中会先执行systemctl reset-failed,然后并发创建140个OSD,每创建一个OSD新建一个进程,每个进程执行如下3条命令,并发开启进程创建OSD,每个并发进程超时时间是12分钟 a、systemctl reset-failed ceph-osd@.service ; b、systemctl disable ceph-osd@.service; c、systemctl start ceph-osd@.service 现像:问题必现 3次必现 (1)/usr/bin/systemd-tty-ask-password-agent --watch卡住 报错Failed to allocate directory watch: Too many open files (2)ExecStartPre=/usr/lib/ceph/ceph-osd-prestart.sh --cluster ${CLUSTER} --id %i 已执行完毕,但是systemd报start-pre timeout,但是实际进程中的pre的脚本已经执行完毕 (3)systemd同时并发142个服务是top查看 cpu 占用率100% (4)NetworkManager rsyslog polkit等dbus或notify类型服务有重启或变成inacivte 2、基于上面的1 ,继续修改,同样报错 将 systemctl start ceph-osd@.service 修改为 systemctl --no-ask-password start ceph-osd@.service (1)报错Failed to allocate directory watch: Too many open files消失 (2)同样ExecStartPre=/usr/lib/ceph/ceph-osd-prestart.sh --cluster ${CLUSTER} --id %i 已执行完毕,但是systemd报start-pre timeout (3)systemd同时并发142个服务是top查看 cpu 占用率100% (4)NetworkManager rsyslog polkit等dbus或notify类型服务有重启或变成inacivte仍然存在 3、基于上面的2 在创建OSD的脚本中,将全局systemctl reset-failed 去掉,原来每创建一个OSD需要执行 a、systemctl reset-failed ceph-osd@.service; b、systemctl disable ceph-osd@.service; c、systemctl start ceph-osd@.service 在这个实验中,去掉b systemctl disable ceph-osd@.service; 现象: 仍有失败 报错信息: 同样发现同样ExecStartPre=/usr/lib/ceph/ceph-osd-prestart.sh --cluster ${CLUSTER} --id %i 已执行完毕,但是systemd报 timeout Jul 25 14:24:31 node1 systemd[1]: [73517.567195] Failed to start Ceph object storage daemon osd.100. Jul 25 14:24:31 node1 systemd[1]: [73517.570330] ceph-osd@101.service: Failed with result 'timeout'. Jul 25 14:24:31 node1 systemd[1]: [73517.572295] Failed to start Ceph object storage daemon osd.101. Jul 25 14:24:31 node1 systemd[1]: [73517.574146] ceph-osd@103.service: Failed with result 'timeout'. Jul 25 14:24:31 node1 systemd[1]: [73517.584671] Failed to start Ceph object storage daemon osd.103. Jul 25 14:24:31 node1 systemd[1]: [73517.586701] ceph-osd@102.service: start-pre operation timed out. Terminating. Jul 25 14:24:31 node1 systemd[1]: [73517.588865] ceph-osd@104.service: Failed with result 'timeout'. Jul 25 14:24:31 node1 systemd[1]: [73517.597246] Failed to start Ceph object storage daemon osd.104. Jul 25 14:24:31 node1 systemd[1]: [73517.598634] ceph-osd@105.service: start-pre operation timed out. Terminating. Jul 25 14:24:31 node1 systemd[1]: [73517.599141] ceph-osd@106.service: start-pre operation timed out. Terminating. (3)systemd同时并发142个服务是top查看 cpu 占用率100%
**【标题描述】能够简要描述问题:说明什么场景下,做了什么操作,出现什么问题(尽量使用正向表达方式)** **一、缺陷信息** **内核信息:5.10.0-136.69.0.149.oe2203sp1.x86_64 **缺陷归属组件:systemd **缺陷归属的版本:systemd 249 (v249-64.oe2203sp1) **缺陷简述:systemctl 并行 start 142个service服务时卡住; - 如果有特殊组网,请提供网络拓扑信息 systemd服务: [Unit] Description=XXX daemon osd.%i After=network-online.target local-fs.target time-sync.target ceph-mon.target hik_fw.service Wants=network-online.target local-fs.target time-sync.target PartOf=ceph-osd.target [Service] LimitNOFILE=1048576 LimitNPROC=1048576 ExecStart=/usr/bin/daemon -f --cluster ${CLUSTER} --id %i --setuser ceph --setgroup ceph ExecStartPre=/usr/lib/ceph/test-prestart.sh --cluster ${CLUSTER} --id %i ExecStartPost=/usr/lib/ceph/test_coredump.sh -set %i ExecReload=/bin/kill -HUP $MAINPID ProtectHome=read-only ProtectSystem=full PrivateTmp=true #TasksMax=infinity Restart=always StartLimitInterval=20min StartLimitBurst=3 RestartSec=30s Nice=-20 [Install] WantedBy=ceph-osd.target 【问题复现步骤】: 1、CEPH在创建OSD的时候,脚本中会先执行systemctl reset-failed,然后并发创建140个OSD,每创建一个OSD新建一个进程,每个进程执行如下3条命令,并发开启进程创建OSD,每个并发进程超时时间是12分钟 a、systemctl reset-failed ceph-osd@.service ; b、systemctl disable ceph-osd@.service; c、systemctl start ceph-osd@.service 现像:问题必现 3次必现 (1)/usr/bin/systemd-tty-ask-password-agent --watch卡住 报错Failed to allocate directory watch: Too many open files (2)ExecStartPre=/usr/lib/ceph/ceph-osd-prestart.sh --cluster ${CLUSTER} --id %i 已执行完毕,但是systemd报start-pre timeout,但是实际进程中的pre的脚本已经执行完毕 (3)systemd同时并发142个服务是top查看 cpu 占用率100% (4)NetworkManager rsyslog polkit等dbus或notify类型服务有重启或变成inacivte 2、基于上面的1 ,继续修改,同样报错 将 systemctl start ceph-osd@.service 修改为 systemctl --no-ask-password start ceph-osd@.service (1)报错Failed to allocate directory watch: Too many open files消失 (2)同样ExecStartPre=/usr/lib/ceph/ceph-osd-prestart.sh --cluster ${CLUSTER} --id %i 已执行完毕,但是systemd报start-pre timeout (3)systemd同时并发142个服务是top查看 cpu 占用率100% (4)NetworkManager rsyslog polkit等dbus或notify类型服务有重启或变成inacivte仍然存在 3、基于上面的2 在创建OSD的脚本中,将全局systemctl reset-failed 去掉,原来每创建一个OSD需要执行 a、systemctl reset-failed ceph-osd@.service; b、systemctl disable ceph-osd@.service; c、systemctl start ceph-osd@.service 在这个实验中,去掉b systemctl disable ceph-osd@.service; 现象: 仍有失败 报错信息: 同样发现同样ExecStartPre=/usr/lib/ceph/ceph-osd-prestart.sh --cluster ${CLUSTER} --id %i 已执行完毕,但是systemd报 timeout Jul 25 14:24:31 node1 systemd[1]: [73517.567195] Failed to start Ceph object storage daemon osd.100. Jul 25 14:24:31 node1 systemd[1]: [73517.570330] ceph-osd@101.service: Failed with result 'timeout'. Jul 25 14:24:31 node1 systemd[1]: [73517.572295] Failed to start Ceph object storage daemon osd.101. Jul 25 14:24:31 node1 systemd[1]: [73517.574146] ceph-osd@103.service: Failed with result 'timeout'. Jul 25 14:24:31 node1 systemd[1]: [73517.584671] Failed to start Ceph object storage daemon osd.103. Jul 25 14:24:31 node1 systemd[1]: [73517.586701] ceph-osd@102.service: start-pre operation timed out. Terminating. Jul 25 14:24:31 node1 systemd[1]: [73517.588865] ceph-osd@104.service: Failed with result 'timeout'. Jul 25 14:24:31 node1 systemd[1]: [73517.597246] Failed to start Ceph object storage daemon osd.104. Jul 25 14:24:31 node1 systemd[1]: [73517.598634] ceph-osd@105.service: start-pre operation timed out. Terminating. Jul 25 14:24:31 node1 systemd[1]: [73517.599141] ceph-osd@106.service: start-pre operation timed out. Terminating. (3)systemd同时并发142个服务是top查看 cpu 占用率100%
Comments (
2
)
Sign in
to comment
Status
Done
Backlog
已挂起
Fixing
Confirmed
Done
Accepted
Canceled
Assignees
Not set
胡宇彪
huyubiao
Assignee
Collaborator
+Assign
+Mention
Labels
sig/Base-service
Not set
Projects
Unprojected
Unprojected
Milestones
No related milestones
No related milestones
Pull Requests
None yet
None yet
Successfully merging a pull request will close this issue.
Branches
No related branch
Branches (
-
)
Tags (
-
)
Planed to start   -   Planed to end
-
Top level
Not Top
Top Level: High
Top Level: Medium
Top Level: Low
Priority
Not specified
Serious
Main
Secondary
Unimportant
Duration
(hours)
参与者(3)
1
https://gitee.com/src-openeuler/systemd.git
git@gitee.com:src-openeuler/systemd.git
src-openeuler
systemd
systemd
Going to Help Center
Search
Git 命令在线学习
如何在 Gitee 导入 GitHub 仓库
Git 仓库基础操作
企业版和社区版功能对比
SSH 公钥设置
如何处理代码冲突
仓库体积过大,如何减小?
如何找回被删除的仓库数据
Gitee 产品配额说明
GitHub仓库快速导入Gitee及同步更新
什么是 Release(发行版)
将 PHP 项目自动发布到 packagist.org
Comment
Repository Report
Back to the top
Login prompt
This operation requires login to the code cloud account. Please log in before operating.
Go to login
No account. Register