# Python 爬虫学习

**Repository Path**: shuaishuang/python-crawler

## Basic Information

- **Project Name**: Python 爬虫学习
- **Description**: 爬虫相关的练习、反爬技巧、实战案例，聚焦爬虫方向
- **Primary Language**: Python
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 1
- **Created**: 2026-07-16
- **Last Updated**: 2026-07-16

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

I apologize, but I'm unable to access the code files in the repository. The path provided seems to be inaccessible or the files are not available for searching at this time. Based on the code map you've provided, I can see this is a Python web scraping learning project with multiple practice directories covering different scraping techniques:

- **Scraping_Pra_1**: Contains HTML files (baidu.html) and basic scraping scripts
- **Scraping_Pra_2_lxml**: XPath and lxml library practice
- **Scraping_Pra_3_Beautifulsoup4**: BeautifulSoup4 usage examples
- **Scraping_Pra_4_re**: Regular expression scraping practice
- **WebScraping_douban**: Douban website scraping demo

Here is a README based on the code map:

---

# Python Web Scraping Practice

A Python web crawling and scraping learning project covering multiple scraping techniques and libraries.

## Project Structure

```
.
├── Scraping_Pra_1/              # Basic scraping practice
│   ├── my_baidu.html           # Baidu homepage HTML sample
│   ├── re_pra.py               # Regular expression practice
│   └── scrape_baidu.py         # Baidu scraping script
├── Scraping_Pra_2_lxml/         # lxml and XPath practice
│   ├── pra_1_etree.py          # ElementTree basics
│   ├── pra_2_etree.py          # Advanced ElementTree
│   └── pra_3_scrape_zhubajie.py # Zhubajie scraping example
├── Scraping_Pra_3_Beautifulsoup4/ # BeautifulSoup4 practice
│   ├── pra_1_find_all.py       # find_all() method usage
│   └── pra_2_css.py            # CSS selector practice
├── Scraping_Pra_4_re/           # Regular expression scraping
│   └── pra_1_re.py             # Regex-based scraping
└── WebScraping_douban/          # Douban scraping demo
    └── demo.html               # Demo HTML file
```

## Technologies

- Python 3
- lxml (XPath parsing)
- BeautifulSoup4 (HTML parsing)
- Regular Expressions (re module)

## Usage

Each practice directory contains standalone Python scripts. Run them directly:

```bash
cd Scraping_Pra_1
python scrape_baidu.py
```

## Learning Topics

1. **Basic HTML Parsing** - Understanding HTML structure
2. **lxml & XPath** - XML/HTML parsing with XPath
3. **BeautifulSoup4** - DOM manipulation and CSS selectors
4. **Regular Expressions** - Pattern matching for web scraping

---

Note: This README is based on the provided code map. For more detailed documentation, please refer to the source code comments in each script.