2 Star 2 Fork 0

liyonghai2/litealigndata

加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
文件
该仓库未声明开源许可证文件(LICENSE),使用请关注具体项目描述及其代码上游依赖。
克隆/下载
README 2.77 KB
一键复制 编辑 原始数据 按行查看 历史
liyonghai2 提交于 3个月前 . IBJPS0:submodule to README
litealigndata is a lightweight data process tool what would help user to customize data,
while users just need to provide seedfiles. As continuous expansion, it can customize
any data combination methods,as well as handle any format seedfiles.
build it on UNIX/LINUX, following steps:
[dependence]
1. preInstall
sudo apt install make -y
sudo apt-get install pkg-config
2. gcc/g++
spport for building parquet(arrow) on ubuntu as below steps. you could using scl
Manager if work on centos.
sudo apt-get install gcc-8 g++-8
sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-7 10
sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-8 20
sudo update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-7 10
sudo update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-8 20
sudo update-alternatives --display g++
sudo update-alternatives --display gcc
[build & usage]
1. get it either git clone or download from related website
git clone https://gitee.com/liyonghai2/litealigndata.git --recursive
2. cd litealigndata
3. build
build litealigndata
./build_all.sh
4. litealigndata-package.tar.bz2 in current folder will generation once complete build
5. tar -xvf litealigndata-package.tar.bz2
6. cd litealigndata-package
used following steps on UNIX/LINUX
1. get help about litealigndata tool
./litealigndata -h
2. configuration xml
please Ref XML_introduction document
3. generation FILE Mode
./litealigndata -f Example/Example.xml
4. if you need random shuffle line in character FILE
./litealigndata -r *
5. generation STREAM Mode
server:
./litealigndata -f Example/Example.xml -s
clinet:
cd tools/
./litealigndataClient 127.0.0.1 8008
and then type below commd
get
[clean]
./clean_all.sh
[others]
1.增加子模块
git submodule add <remote repo url> <local repo url>
在当前目录上生成.gitmodules
主库中增加子模块
git add . git commit -m ""
git push origin dev:dev
2.1.主仓库更新子模块中仓库中的修改
子模块仓库中增加文件
git status
git add .
git commit -m ""
git push
主仓库
cd moduleA
git checkout master
git pull
cd ..
git add .
git commit -m ""
git push
2.2 子模块中更新主仓库中仓库中的修改
主仓库
cd ModuleA
...
git add .
git commit -m ""
git push
cd ..
git add .
git commit -m ""
git push
3. setup global name, email
git config --global user.name "liyonghai2" &&
git config --global user.email "*@189.cn"
Loading...
马建仓 AI 助手
尝试更多
代码解读
代码找茬
代码优化
1
https://gitee.com/liyonghai2/litealigndata.git
git@gitee.com:liyonghai2/litealigndata.git
liyonghai2
litealigndata
litealigndata
master

搜索帮助