代码拉取完成，页面将自动刷新
Document version: V1.6 Release date: 2024-8-15
该项目为K230虚拟数字人（MetaHuman）POC开源工程，本工程基于K230融合了人体动作捕捉（motion capture，简称mocap）、人体3D mesh模型（SMPL模型）等技术。本应用可以实现人像联动，即K230摄取真人动作，通过模型inference（在K230）和post-process，再将结果传输给blender，驱动动漫character与真人联动。
实时、无延迟
支持在k230小核端实时与blender通讯
支持在k230大核端快速运行模型
动作精准捕捉
支持在k230大核端模型正确推理，传输至blender，并精准驱动character
1、Blender (version 3.4)
2、k230
【Attention】Define the demo directory as $Meta_Human.
【First of All】
################ download.sh ##############
#!/bin/bash
for file in blender_tools_v1.0.zip central_control_v1.0.zip k230_board run_sh.zip Tftpd64.zip ;
do
wget https://ai.b-bug.org/k230/downloads/fancy_poc/meta_human/$file || wget https://kendryte-download.canaan-creative.com/k230/downloads/fancy_poc/meta_human/$file;
done
for file in onboard_v2.9.0.zip
do
wget https://ai.b-bug.org/k230/downloads/fancy_poc/meta_human/k230_board/$file || wget https://kendryte-download.canaan-creative.com/k230/downloads/fancy_poc/meta_human/k230_board/$file;
done
### 下载之后，请自行解压 ###
1) Enter blender_tools and double click "canaan_k230.blend"
If get the "red background", please refer to 【Error Lists】-1 to solve it.
2) Do these operations as follow:
Edit > Preferences > Install
"addon_CK230.zip" in blender_tools/addons .
Enable "3D View:CharacterDriven-Canaan-K230".
Close the "Blender Preferences".
If get an error that "No module named cv2", please refer to 【Error Lists】-2 to solve it.
Double click tftpd64.exe in Tftpd64.
"Current Directory" can be the parant directory of "onboard".
在小核上，
cd ~
vi run1.sh
### run1.sh ###
ifconfig eth0 192.168.1.22
telnet 192.168.1.22
### run1.sh ###
sh run1.sh
1) Compress the folder of "onboard" and upload onto K230
2) Decompress in K230
需要注意的是，onboard包括上板所需的文件，其目录结构如下：
|--onboard
| |--http.sh
| |--meta_human_256.kmodel
| |--meta_human_320.kmodel
| |--meta_human_384.kmodel
| |--meta_human_isp.sh
## meta_human_isp.sh ##
./meta_human.elf meta_human_256.kmodel 256 0
## http.sh ##
./http 256 10000000
## 在k230 docker环境中在src/reference/ai_poc目录下执行./build_app.sh，即可在 k230_bin得到编译后的 meta_human.elf以及http,将其拷贝到k230上onboard文件夹下。
应用实例支持不同输入分辨率的模型，以下以256为例。如需更改，运行时请在电脑服务端、k230的大小核分别指定输入尺寸。
1) Enter central_control >> input "cmd" as follow >> click "Enter" on keyboard >> input the run script "central_control.exe --input_size 256"
## central_control.exe --input_size 256
2) Click on the button "PLAY" in Blender.
3) run the scripts on k230
[k230-big-core] ./meta_human_isp.sh
[k230-small-core] ./http.sh
####### vi meta_human_isp.sh #######
./meta_human.elf meta_human_256.kmodel 256 0
####### vi http.sh #######
./http 256 10000000
注意： 先启动大核命令，在大核命令启动后会打印大小核通信的地址。如下图。退出时，k230大核按'q'->'enter'退出，k230小核按'q'->'enter'退出，pc服务端按'ctrl'+'c'退出，blender按'esc'退出状态。
【Error Lists】
1、Blender 背景图“红屏”
[Solution]
Right click on "red background" and "Delete".
Do as follow
"Add >> Image >> Background"
to select an image as background.
Then scale up the background to get the proper location.
2、No module named 'cv2' in blender
When an error happens that no module named 'cv2' in blender, please do as follow:
1）Right click "cmd", run as administrator;
2）cd D:\Blender\3.4\python （blender installation dir）
3）.\bin\python.exe -m pip install opencv-python --target .\lib\site-packages
此处可能存在不合适展示的内容，页面不予展示。您可通过相关编辑功能自查并修改。
如您确认内容无涉及 不当用语 / 纯广告导流 / 暴力 / 低俗色情 / 侵权 / 盗版 / 虚假 / 无价值内容或违法国家有关法律法规的内容，可点击提交进行申诉，我们将尽快为您处理。
马建仓 AI 助手