[MS][GPU][host device]process not exit after train failed

| name       | about	                             | labels   |
| ---------- | ------------------------------------- | -------- |
| Bug Report | Use this template for reporting a bug | kind/bug |

<!--  Thanks for sending an issue!  Here are some tips for you:

1) If this is your first time, please read our contributor guidelines: https://gitee.com/mindspore/mindspore/blob/master/CONTRIBUTING.md

2) If you want to get the answer quickly, please add label `mindspore-assistant`
to the issue, we will find it and answer you as soon as possible.
-->

## Environment
- **Hardware Environment(`Ascend`/`GPU`/`CPU`)**: 
> Uncomment only one ` /device <>` line, hit enter to put that in a new line, and remove leading whitespaces from that line:
>
> /device gpu

- **Software Environment**:
-- MindSpore version (source or binary): commit_id__ = ''[sha1]:c6aa54ee,[branch]:(HEAD->master,origin/master,origin/HEAD)''
-- Python version (e.g., Python 3.7.5):
-- OS platform and distribution (e.g., Linux Ubuntu 16.04):
-- GCC/Compiler version (if compiled from source):

## Related testcase
test_wide_deep_host_device_gpu_8p
## Steps to reproduce the issue
1. train gpu host device
2. chek log and process

## Describe the current behavior
process not exit
## Describe the expected behavior
process exit normal after train failed
## Related log / screenshot

## Special notes for this issue
8卡训练失败后，进程不退出

GVP MindSpore/mindspore

内容风险标识

评论 (11)

GVPMindSpore/mindspore

内容风险标识