# awesome-web-scraping

**Repository Path**: hallc/awesome-web-scraping

## Basic Information

- **Project Name**: awesome-web-scraping
- **Description**: List of libraries, tools and APIs for web scraping and data processing.
- **Primary Language**: Unknown
- **License**: CC-BY-4.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2020-02-03
- **Last Updated**: 2024-05-29

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Awesome Web Scraping

The list of tools, programming libraries and web services used in web scraping.

## Programming Libraries

* [Python](http://github.com/lorien/web-scraping/blob/master/python.md)
* [PHP](http://github.com/lorien/web-scraping/blob/master/php.md)
* [Ruby](http://github.com/lorien/web-scraping/blob/master/ruby.md)
* [JavaScript](http://github.com/lorien/web-scraping/blob/master/javascript.md)
* [Go](http://github.com/lorien/web-scraping/blob/master/golang.md)

## Web Services
* [Proxy Services](http://github.com/lorien/web-scraping/blob/master/proxy_services.md)
* [Captcha Solving Services](https://github.com/lorien/awesome-web-scraping/blob/master/captcha_solving_services.md)
* [Web Scraping Services](http://github.com/lorien/web-scraping/blob/master/web_services.md)

## Other Things

* [Console tools](http://github.com/lorien/web-scraping/blob/master/console_tools.md)
* [Books](http://github.com/lorien/web-scraping/blob/master/books.md)

## Other Lists

* [HeadlessBrowsers](https://github.com/dhamaniasad/HeadlessBrowsers) - a list of (almost) all headless web browsers in existence

## About awesome-web-scraping

Make this list better! Your contributions are always welcome! See [contributing how-to](https://github.com/lorien/web-scraping/blob/master/CONTRIBUTING.md). To add new language to Programming Libraries section use [new_language_template](http://github.com/lorien/web-scraping/blob/master/new_language_template.md) as starting point.

Feel free to share feedback in telegram chats about web scraping: [@grablab](https://t.me/grablab) (English) and [@grablab_ru](https://t.me/grablab_ru) (Russian)

The list is based initially on some data from these sources [awesome-python](https://github.com/vinta/awesome-python), [awesome-php](https://github.com/ziadoz/awesome-php), [awesome-ruby](https://github.com/markets/awesome-ruby), [ruby-nlp](https://github.com/diasks2/ruby-nlp), [awesome-javascript](https://github.com/sorrycc/awesome-javascript)