1 Star 2 Fork 0

liyonghai2/litealigndata

加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
该仓库未声明开源许可证文件(LICENSE),使用请关注具体项目描述及其代码上游依赖。
克隆/下载
贡献代码
同步代码
取消
提示: 由于 Git 不支持空文件夾,创建文件夹后会生成空的 .keep 文件
Loading...
README
litealigndata is a lightweight data process tool what would help user to customize data, 
while users just need to provide seedfiles. As continuous expansion, it can customize 
any data combination methods,as well as handle any format seedfiles.

build it on UNIX/LINUX, following steps:

[dependence]

1. preInstall
   sudo apt install make -y
   sudo apt-get install pkg-config

2. gcc/g++
   spport for building parquet(arrow) on ubuntu as below steps. you could using scl 
   Manager if work on centos.

   sudo apt-get install  gcc-8  g++-8
   sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-7 10
   sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-8 20
   sudo update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-7 10
   sudo update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-8 20
   sudo update-alternatives --display g++
   sudo update-alternatives --display gcc

[build & usage]

1.  get it either git clone or download from related website

2.  cd litealigndata 

3.  build
    build litealigndata
        ./build_all.sh
4.  litealigndata-package.tar.bz2 in current folder will generation once complete build

5.  tar -xvf litealigndata-package.tar.bz2

6.  cd litealigndata-package


used following steps on UNIX/LINUX

1.  get help about litealigndata tool

    ./litealigndata -h


2.  configuration xml

    please Ref XML_introduction document

3.  generation FILE Mode

    ./litealigndata -f Example/Example.xml

4.  if you need random shuffle line in character FILE

    ./litealigndata -r *

5.  generation STREAM Mode

    server:
        ./litealigndata -f Example/Example.xml -s

    clinet:
        cd tools/
        ./litealigndataClient 127.0.0.1 8008
        and then type below commd
        get

[clean]
    ./clean_all.sh 

[others]

空文件

简介

litealigndata is a lightweight data process tool what would help user to customize data 展开 收起
C++ 等 4 种语言
取消

发行版 (1)

全部

贡献者

全部

近期动态

加载更多
不能加载更多了
马建仓 AI 助手
尝试更多
代码解读
代码找茬
代码优化
1
https://gitee.com/liyonghai2/litealigndata.git
git@gitee.com:liyonghai2/litealigndata.git
liyonghai2
litealigndata
litealigndata
master

搜索帮助