同步操作将从 Mr.Huang/MiniGPT-4 强制同步,此操作会覆盖自 Fork 仓库以来所做的任何修改,且无法恢复!!!
确定后同步将在后台操作,完成时将刷新页面,请耐心等待。
Vicuna is an open-source LLAMA-based LLM that has a performance close to ChatGPT. We currently use the v0 version of Vicuna-13B.
To prepare Vicuna’s weight, first download Vicuna’s delta weight from https://huggingface.co/lmsys/vicuna-13b-delta-v0. In case you have git-lfs installed (https://git-lfs.com), this can be done by
git lfs install
git clone https://huggingface.co/lmsys/vicuna-13b-delta-v0 # more powerful, need at least 24G gpu memory
# or
git clone https://huggingface.co/lmsys/vicuna-7b-delta-v0 # smaller, need 12G gpu memory
Note that this is not directly the working weight, but the difference between the working weight and the original weight of LLAMA-13B. (Due to LLAMA’s rules, we cannot distribute the weight of LLAMA.)
Then, you need to obtain the original LLAMA-7B or LLAMA-13B weights in the HuggingFace format either following the instruction provided by HuggingFace here or from the Internet.
When these two weights are ready, we can use tools from Vicuna’s team to create the real working weight. First, Install their library that is compatible with v0 Vicuna by
pip install git+https://github.com/lm-sys/FastChat.git@v0.1.10
Then, run the following command to create the final working weight
python -m fastchat.model.apply_delta --base /path/to/llama-13bOR7b-hf/ --target /path/to/save/working/vicuna/weight/ --delta /path/to/vicuna-13bOR7b-delta-v0/
Now you are good to go!
此处可能存在不合适展示的内容,页面不予展示。您可通过相关编辑功能自查并修改。
如您确认内容无涉及 不当用语 / 纯广告导流 / 暴力 / 低俗色情 / 侵权 / 盗版 / 虚假 / 无价值内容或违法国家有关法律法规的内容,可点击提交进行申诉,我们将尽快为您处理。