[feature][demo] PyNative Dispatch by Tenosr.device · Pull Request !90459 · MindSpore/mindspore

1. add composite op
2. refactor
3. Add tensor dispatcher for pyboost
---
<!--  Thanks for sending a pull request!  Here are some tips for you:

1) If this is your first time, please read our contributor guidelines: https://gitee.com/mindspore/mindspore/blob/master/CONTRIBUTING.md

2) If you want to contribute your code but don't know who will review and merge, please add label `mindspore-assistant` to the pull request, we will find and do it as soon as possible.
-->

**What type of PR is this?**

/kind feature

---

**What does this PR do / why do we need it**:

动态图支持按Tensor.device dispatch.
1. 根据输入Tensor获取Device。
2. 按Device分发到不同的硬件后端，执行对应的算子。
3. pyboost调用functions之前，做一层adapter，用于算子composite实现。例如：rand = empty + inplace_norm。

---

**Which issue(s) this PR fixes**:

Fixes #ID00JI

---

**Test Plan and Test result：What scenarios were tested, and what were the verification results（Function, performance, reliability, etc.）**：

验证算子正向：mint接口/Tensor接口/aclop接口
验证反向：验证自动微分流程是否正确dispatch
验证Device：CPU/Ascend/GPU

```python
    test_pynative_device_dispatch_cpu_forward()
    test_pynative_device_dispatch_ascend_forward()
    test_pynative_device_dispatch_cpu_to_ascend_chain_ops()
    test_pynative_device_dispatch_cpu_backward()
    test_pynative_device_dispatch_ascend_backward()
    test_pynative_device_dispatch_parameter_on_ascend()
    test_pynative_device_dispatch_broadcast_cpu()
    test_pynative_device_dispatch_broadcast_ascend()
    #test_pynative_device_dispatch_mixed_device_error()
    test_pynative_device_dispatch_grad_scalar_output_ascend()
    test_pynative_device_dispatch_dtype_cast_between_devices()
    test_pynative_device_dispatch_assign_cpu()
    #test_pynative_device_dispatch_assign_ascend()
    test_pynative_device_dispatch_assign_in_cell_ascend_forward_backward()
    #test_pynative_device_dispatch_assign_mixed_device_error()
    test_pynative_device_dispatch_view_reshape_cpu()
    test_pynative_device_dispatch_view_reshape_ascend()
    test_pynative_device_dispatch_view_slice_cpu()
    test_pynative_device_dispatch_view_slice_ascend()
    test_pynative_device_dispatch_view_expand_dims_cpu()
    test_pynative_device_dispatch_view_expand_dims_ascend()
    test_pynative_device_dispatch_view_flatten_cpu()
    test_pynative_device_dispatch_view_flatten_ascend()
    test_pynative_device_dispatch_view_transpose_cpu()
    test_pynative_device_dispatch_view_transpose_ascend()
    test_pynative_device_dispatch_view_reshape_backward_ascend()
    test_pynative_device_dispatch_view_flatten_backward_ascend()
    #test_pynative_device_dispatch_view_mixed_device_error()
    test_pynative_device_dispatch_getitem_cpu()
    test_pynative_device_dispatch_getitem_ascend()
    test_pynative_device_dispatch_setitem_cpu()
    test_pynative_device_dispatch_setitem_ascend()
    test_pynative_device_dispatch_setitem_broadcast_cpu()
    test_pynative_device_dispatch_setitem_broadcast_ascend()
    test_pynative_device_dispatch_getitem_view_backward_ascend()
    #test_pynative_device_dispatch_setitem_mixed_device_error()
    #test_pynative_device_dispatch_getitem_mixed_device_usage_error()
    test_pynative_tensor_hook_on_cpu()
    test_pynative_tensor_hook_on_ascend()
    #test_pynative_tensor_hook_mixed_device_error()
    test_pynative_cell_forward_hook_like_cpu()
    test_pynative_cell_forward_hook_like_ascend()
    test_pynative_cell_bprop_hook_cpu()
    test_pynative_cell_bprop_hook_ascend()
    #test_pynative_cell_bprop_mixed_device_error()
```

![输入图片说明](https://foruda.gitee.com/images/1763470274455569318/1bbf4c41_6574868.png "屏幕截图")

---

**Self-checklist**:（**请自检，在[ ]内打上x，我们将检视你的完成情况，否则会导致pr无法合入**）

+ - [x] **设计**：PR对应的方案是否已经经过Maintainer评审，方案检视意见是否均已答复并完成方案修改
+ - [x] **测试**：PR中的代码是否已有UT/ST测试用例进行充分的覆盖，新增测试用例是否随本PR一并上库或已经上库
+ - [x] **验证**：PR描述信息中是否已包含对该PR对应的Feature、Refactor、Bugfix的预期目标达成情况的详细验证结果描述
+ - [ ] **接口**：是否涉及对外接口变更，相应变更已得到接口评审组织的通过，API对应的注释信息已经刷新正确
+ - [ ] **文档**：是否涉及官网文档修改，如果涉及请及时提交资料到Doc仓

类型	指派人员	状态
审查	@liangchenghui 由 CODEOWNERS 文件第 73 行指派为审查者 @YuJianfeng 由 CODEOWNERS 文件第 66 行指派为审查者 @chujinjin 由 CODEOWNERS 文件第 196 行指派为审查者 @limingqi107 由 CODEOWNERS 文件第 50 行指派为审查者	已完成 (4/4人)
审查	zhangyinxia	已完成 (0/0人)

GVP MindSpore/mindspore

发现个问题

GVPMindSpore/mindspore

搜索帮助

GVP MindSpore/mindspore