# Spider **Repository Path**: iroan/Spider ## Basic Information - **Project Name**: Spider - **Description**: Python爬虫练习 - **Primary Language**: Unknown - **License**: MIT - **Default Branch**: master - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 0 - **Forks**: 0 - **Created**: 2018-02-21 - **Last Updated**: 2020-12-19 ## Categories & Tags **Categories**: Uncategorized **Tags**: None ## README # urllib2_use_examples 1. urlopen+read > urlopen_read.py 1. Request +urlopen+read > Request_urlopen_read.py 1. 使用Request可以添加HTTP请求的请求头信息,构建一个完整的请求 1. Handler+build_opener+open > Handler_build_opener_open.py urlopen()方法不支持代理、cookie等其他的HTTP/HTTPS高级功能,可以使用: 1. Handler+build_opener来自定义Handler 1. ProxyHandler+build_opener+open支持代理 1. cookielib+HTTPCookieProcessor > cookielib_HTTPCookieProcessor.py # 环境 >python 2.7 >beautifulsoup4 4.6.0