[refactor][v1][r0.4.0]adapt pin_mem in pynative · Pull Request !1006 · MindSpore/vllm-mindspore

1. adapt pin_mem in pynative
---
<!--  Thanks for sending a pull request!  Here are some tips for you:

1) If this is your first time, please read our contributor guidelines: https://gitee.com/mindspore/mindspore/blob/master/CONTRIBUTING.md

2) If you want to contribute your code but don't know who will review and merge, please add label `mindspore-assistant` to the pull request, we will find and do it as soon as possible.
-->

**What type of PR is this?**

/kind refactor

**What does this PR do / why do we need it**:
1、PyNative异步执行中当异步拷贝的对象不是pin_mem时会回退到同步拷贝，导致断流，影响推理执行性能。需要主动调用pin_mem，进行加速。

优化前
![输入图片说明](https://foruda.gitee.com/images/1760147087746693002/77a8af2c_7725520.png "屏幕截图")
![输入图片说明](https://foruda.gitee.com/images/1760147096405969966/505935cb_7725520.png "屏幕截图")
优化后
![输入图片说明](https://foruda.gitee.com/images/1760147071807351640/e3e0c71e_7725520.png "屏幕截图")
![输入图片说明](https://foruda.gitee.com/images/1760147108598222648/18b39d18_7725520.png "屏幕截图")

2、pin_memory()框架优化，当tensor已经是pin_memory时不会重新拷贝，直接返回。

影响范围：涉及dp和lora，以及mf后端v1流程；

**Which issue(s) this PR fixes**:

Fixes #ID1BBV

**Code review checklist [【代码检视checklist说明】](https://gitee.com/mindspore/community/blob/master/security/code_review_checklist_mechanism.md)**:

+ - [ ] 是否进行返回值校验 (禁止使用void屏蔽安全函数、自研函数返回值，C++标准库函数确认无问题可以屏蔽)
+ - [ ] 是否遵守 ***SOLID原则 / 迪米特法则***
+ - [ ] 是否具备UT测试用例看护 && 测试用例为有效用例 (若新特性无测试用例看护请说明原因)
+ - [ ] 是否为对外接口变更
+ - [ ] 是否涉及官网文档修改

MindSpore/vllm-mindspore .gitee-modal { width: 500px !important; }

搜索帮助

MindSpore/vllm-mindspore