# LogosDataSpiderTools

**Repository Path**: sunzhe123/LogosDataSpiderTools

## Basic Information

- **Project Name**: LogosDataSpiderTools
- **Description**: No description available
- **Primary Language**: Python
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2020-05-07
- **Last Updated**: 2020-12-18

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

## LogosData数据规范工具 Beat v0.0.10

### 安装命令
    pip install git+https://gitee.com/sunzhe123/LogosDataSpiderTools.git

### 功能介绍
- 自动校验数据类型
- 自动填充空字段数值为""
- 自动将数据对象转为有序列表

### LgShop - 店铺模型验证 范例代码（模型验证）
    from LogosDataSpiderTools import LgShop
    *****
    # 创建Shop对象
    shop = LgShop(dpid=shop_id, url=shop_url, dpmc=shop_name, zybz='0', qydpbz='1', spbj=itemdesc_rank,
              sppf=itemdesc_score, wlbj=delivery_rank, wlpf=delivery_score, fwbj=service_rank,
              fwpf=service_score, cjsj=cjsj, dpzt='0', yhid=user_id)
    
    # 将Shop对象转为有序列表
    data = shop.list()
## 数据文件备份
### 提交备份工单地址
    https://jinshuju.net/f/mtOBR3
### s3_backupfile - 亚马逊备份数据 代码范例（自动上传）
    from LogosDataSpiderTools import s3_backupfile

    s3_backupfile(aws_access_key_id='XXXXXX',
                  aws_secret_access_key='XXXXXXX',
                  file_path=r'D:\南哲科技\淘宝全站店铺数据\taobao_tmall_yuanshishuju.zip', bucket_name='dianshangstorage',
                  s3_path='taobao/shop/taobao_tmall_yuanshishuju111.zip12321321')