# BaiDuUrlSpider

**Repository Path**: Cross6/BaiDuUrlSpider

## Basic Information

- **Project Name**: BaiDuUrlSpider
- **Description**: 百度URL采集工具
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2019-11-05
- **Last Updated**: 2020-12-20

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# BaiDuUrlSpider #

## 百度URL采集工具 1.0


工具说明：百度URL采集工具，可自行修改线程；未加入去重复；使用后在同目录下生成`home_url.txt`和`original_url.txt`两个文件，前一个文件是域名列表，后一个是采集到的url列表.

使用例子：

    python BaiDuUrlSpider.py inurl:index.action

Tool Description: Baidu URL collection tool, you can modify the thread; did not join to repeat; after use in the same directory to generate `home_url.txt` and `original_url.txt` two files, the former is a domain name list, the latter is The collected url list.

Use example:

    python BaiDuUrlSpider.py inurl:index.action