# python-fxxk-spider

**Repository Path**: xixihahas/python-fxxk-spider

## Basic Information

- **Project Name**: python-fxxk-spider
- **Description**: python-各项目爬虫
- **Primary Language**: Python
- **License**: Apache-2.0
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 1
- **Forks**: 0
- **Created**: 2024-04-25
- **Last Updated**: 2024-09-13

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# python-fxxk-spider

这里收集各种免费的 Python 爬虫项目资源，长期更新，欢迎大家 star、提 issue。

**爬虫项目可能会因爬取对象发生变化，无法直接进行爬取，如果遇到不能直接使用的项目，大家需要根据具体情况做相应修改。**

## 收录项目

* [百合网爬虫](https://github.com/ujiaqi/crawler-baihe)
* [高德地图爬虫](https://github.com/fagan2888/amap_data)
* [VIP音乐爬虫](https://github.com/weitw/vipMusic)
* [小米应用商店爬虫](https://github.com/DropsDevopsOrg/ECommerceCrawlers/tree/master/OthertCrawler/0x15xiaomiappshop)
* [汽车之家爬虫](https://github.com/StuPeter/AutoHome_spider)
* [ebay爬虫](https://github.com/Like-jian/ebay_spider)
* [谷歌图片通用爬虫](https://github.com/Vaskka/GoogleCommonSpider)
* [维基百科爬虫](https://github.com/LMFrank/CrawlerProject/tree/master/Wikipedia)
* [百度百科爬虫](https://github.com/lzcdev/BaiDuBaiKeSpider)
* [饿了么商家信息爬虫](https://github.com/brandonchow1997/Ele-Spider)
* [美团APP爬虫](https://github.com/Miscf/meiTuan)
* [豆瓣读书爬虫](https://github.com/lanbing510/DouBanSpider)
* [B站用户爬虫](https://github.com/airingursb/bilibili-user)
* [前程无忧爬虫](https://github.com/chenjiandongx/51job-spider)
* [你好污啊爬虫](https://github.com/sy-records/speech_spiders/tree/master/nihaowu)
* [mm131爬虫](https://github.com/qwertyuiop6/mm131)
* [知乎爬虫](https://mp.weixin.qq.com/s/WRKC9WVMMSqER0STGjIwbg)
* [漫画喵爬虫](https://github.com/miaoerduo/cartoon-cat)
* [马蜂窝爬虫](https://github.com/eternal-flame-AD/mafengwo)
* [公众号文章爬虫](https://mp.weixin.qq.com/s/hbZUWjob1U06ugIKojdHqw)
* [爱奇艺视频弹幕爬虫](https://mp.weixin.qq.com/s/1DDkqehBEZQdQ4JKG67GfQ)
* [京东爬虫](https://github.com/taizilongxu/scrapy_jingdong)
* [链家网爬虫](https://github.com/lanbing510/LianJiaSpider)
* [中国知网爬虫](https://github.com/yanzhou/CnkiSpider)
* [乌云爬虫](https://github.com/hanc00l/wooyun_public)
* [QQ群爬虫](https://github.com/caspartse/QQ-Groups-Spider)
* [新浪微博爬虫](https://github.com/nghuyong/WeiboSpider)
* [新浪微博评论爬虫](https://mp.weixin.qq.com/s/kLOXj6oRG_OwL19HwHc_oA)
* [hao123网站爬虫](https://github.com/simapple/spider)
* [百度云盘爬虫](https://github.com/k1995/BaiduyunSpider)
* [爬虫代理IP池](https://github.com/jhao104/proxy_pool)
* [博客园爬虫](https://github.com/DropsDevopsOrg/ECommerceCrawlers/tree/master/cnblog)
* [朋友圈爬虫](https://github.com/Northxw/Python3_WebSpider/tree/master/05-Moments)
* [网易客户端内容爬虫](https://github.com/leyle/163spider)
* [机票爬虫（去哪儿和携程网）](https://github.com/fankcoder/findtrip)
* [QQ空间爬虫](https://github.com/LiuXingMing/QQSpider)
* [王者荣耀爬虫](https://mp.weixin.qq.com/s/Zuid_b1mEzf_qulAYtCjig)
* [猫眼TOP100爬虫](https://github.com/Northxw/Python3_WebSpider/tree/master/03-MaoYan_Top100)
* [股票数据（沪深）爬虫](https://github.com/benitoro/stockholm)
* [英雄联盟皮肤爬虫](https://mp.weixin.qq.com/s/g4CGeBBMuPQ5eob_9M345g)
* [抖音视频爬虫](https://mp.weixin.qq.com/s/DF7_b_F1iHUqPnOqYV3uYA)
* [简书爬虫](https://github.com/Northxw/Python3_WebSpider/tree/master/12-Crack_Jianshu)
* [Boss直聘爬虫](https://github.com/xianyunyh/spider_job)
* [闲鱼最新商品爬虫](https://github.com/DropsDevopsOrg/ECommerceCrawlers/tree/master/XianyuCrawler)
* [抖音推荐列表爬虫](https://github.com/cnbattle/douyin)
* [QQ音乐歌曲爬虫](https://mp.weixin.qq.com/s/EIp8kM440Bilc0uK6kCWNA)
* [网易云音乐个人喜爱歌单爬虫](https://mp.weixin.qq.com/s/ZR-8IOyz5fj2NUTmALmRpg)
* [酷我音乐爬虫](https://mp.weixin.qq.com/s/GsVi9WfIN1u8w3Z_Fy0oeQ)
* [相亲软件评论区爬虫](https://mp.weixin.qq.com/s/DjTa_n7sOWSxDGwLTKtdug)
* [腾讯视频爬虫](https://github.com/yangrq1018/vqq-douban-film)
* [去哪浪景区爬虫](https://mp.weixin.qq.com/s/E3YwBLrYXXiAylQXAzMjWw)
* [超全爬虫工具箱](https://github.com/kangvcar/InfoSpider)
* [ZOL手机壁纸爬虫](https://github.com/chenjiandongx/wallpaper)
* [Zcool+CNU爬虫](https://github.com/lonsty/scraper)
* [中国大陆高校列表爬虫](https://github.com/codeudan/crawler-china-mainland-universities)
* [自如爬虫](https://github.com/dengqiangxi/ziroom_crawler)
* [爱奇艺弹幕爬虫](https://mp.weixin.qq.com/s/1DDkqehBEZQdQ4JKG67GfQ)
* [心灵毒鸡汤爬虫](https://github.com/sy-records/speech_spiders/tree/master/chicken-soup)
* [雪球股票爬虫](https://github.com/decaywood/XueQiuSuperSpider)
* [Youtube字幕爬虫](https://github.com/qwertyuiop6/get_youtube_subtitle)
* [贝壳网租房信息爬虫](https://www.cnblogs.com/technology178/p/11087251.html)
* [拉勾爬虫](https://github.com/JustForFunnnn/webspider)
* [模拟登陆各大网站](https://github.com/Kr1s77/awesome-python-login-model)
* [淘宝商品爬虫](https://mp.weixin.qq.com/s/q7pGNkQr7xKmnaJPkfYvuQ)
* [微信发消息提醒女友](https://github.com/shengqiangzhang/examples-of-web-crawlers/tree/master/4.%E6%AF%8F%E5%A4%A9%E4%B8%8D%E5%90%8C%E6%97%B6%E9%97%B4%E6%AE%B5%E9%80%9A%E8%BF%87%E5%BE%AE%E4%BF%A1%E5%8F%91%E6%B6%88%E6%81%AF%E6%8F%90%E9%86%92%E5%A5%B3%E5%8F%8B)
* [天猫商品数据爬虫](https://github.com/shengqiangzhang/examples-of-web-crawlers/tree/master/2.%E5%A4%A9%E7%8C%AB%E5%95%86%E5%93%81%E6%95%B0%E6%8D%AE%E7%88%AC%E8%99%AB(%E5%B7%B2%E6%A8%A1%E6%8B%9F%E7%99%BB%E5%BD%95))
* [淘宝已买到的宝贝数据爬虫](https://github.com/shengqiangzhang/examples-of-web-crawlers/tree/master/3.%E6%B7%98%E5%AE%9D%E5%B7%B2%E4%B9%B0%E5%88%B0%E7%9A%84%E5%AE%9D%E8%B4%9D%E6%95%B0%E6%8D%AE%E7%88%AC%E8%99%AB(%E5%B7%B2%E6%A8%A1%E6%8B%9F%E7%99%BB%E5%BD%95))
* [5K唯美壁纸爬虫](https://github.com/shengqiangzhang/examples-of-web-crawlers/tree/master/5.%E7%88%AC%E5%8F%965K%E5%88%86%E8%BE%A8%E7%8E%87%E8%B6%85%E6%B8%85%E5%94%AF%E7%BE%8E%E5%A3%81%E7%BA%B8)
* [爬取豆瓣排行榜电影数据](https://github.com/shengqiangzhang/examples-of-web-crawlers/tree/master/6.%E7%88%AC%E5%8F%96%E8%B1%86%E7%93%A3%E6%8E%92%E8%A1%8C%E6%A6%9C%E7%94%B5%E5%BD%B1%E6%95%B0%E6%8D%AE(%E5%90%ABGUI%E7%95%8C%E9%9D%A2%E7%89%88))
* [天天基金网爬虫](https://github.com/shengqiangzhang/examples-of-web-crawlers/tree/master/7.%E7%88%AC%E5%8F%96%E5%A4%A9%E5%A4%A9%E5%9F%BA%E9%87%91%E7%BD%91%E6%89%80%E6%9C%89%E5%9F%BA%E9%87%91%E6%95%B0%E6%8D%AE)
* [QQ个人记录爬虫](https://github.com/shengqiangzhang/examples-of-web-crawlers/tree/master/9.%E4%B8%80%E9%94%AE%E7%94%9F%E6%88%90QQ%E4%B8%AA%E4%BA%BA%E5%8E%86%E5%8F%B2%E6%8A%A5%E5%91%8A)
* [Chrome历史记录爬虫](https://github.com/shengqiangzhang/examples-of-web-crawlers/tree/master/11.%E4%B8%80%E9%94%AE%E5%88%86%E6%9E%90%E4%BD%A0%E7%9A%84%E4%B8%8A%E7%BD%91%E8%A1%8C%E4%B8%BA(web%E9%A1%B5%E9%9D%A2%E5%8F%AF%E8%A7%86%E5%8C%96))
* [微信读书爬虫](https://github.com/shengqiangzhang/examples-of-web-crawlers/tree/master/12.%E4%B8%80%E9%94%AE%E5%AF%BC%E5%87%BA%E5%BE%AE%E4%BF%A1%E8%AF%BB%E4%B9%A6%E7%9A%84%E4%B9%A6%E7%B1%8D%E5%92%8C%E7%AC%94%E8%AE%B0)
* [链家网和贝壳网房价爬虫](https://github.com/jumper2014/lianjia-beike-spider)
* [淘宝、天猫商品爬虫](https://github.com/shjia/taobao_spider)
* [girl13爬虫](https://github.com/xuelangcxy/girlCrawler)
* [E绅士爬虫](https://github.com/shuiqukeyou/E-HentaiCrawler)
* [Github用户及仓库分析爬虫](https://github.com/chenjiandongx/Github-spider)
* [leetcode爬虫](https://github.com/bonfy/leetcode)
* [Linkedin爬虫](https://github.com/LiuXingMing/LinkedinSpider)
* [1688爬虫](https://github.com/Carmenliukang/1688_crawler-image_search_products)
* [DHT网络磁力种子爬虫](https://github.com/chenjiandongx/magnet-dht)
* [国家统计用区划代码和城乡划分代码爬虫](https://github.com/dta0502/NBSPRC-spider)
* [Instagram爬虫](https://github.com/xTEddie/Scrapstagram)
* [今日头条/网易/腾讯新闻爬虫](https://github.com/lzjqsdd/NewsSpider)
* [JK爬虫](https://github.com/topiccrawler/jkcrawler)
* [煎蛋妹爬虫](https://github.com/Tony-Chiong/jandan_spider)
* [Tmall文胸爬虫](https://github.com/chenjiandongx/cup-size)
* [天眼查爬虫](https://github.com/maoyuching/tycCrawl)
* [企查查企业信息爬虫](https://github.com/zhaoboy9692/qccspider)
* [马蜂窝用户足迹爬虫](https://github.com/eternal-flame-AD/mafengwo)
* [炉石传说爬虫](https://github.com/youfou/hsdata)
* [漫画喵爬虫](https://github.com/miaoerduo/cartoon-cat)
* [MM131图片爬虫](https://github.com/qwertyuiop6/mm131)
* [百度xjj图片爬虫](https://mp.weixin.qq.com/s/xZrKdbOfHFWOOx6ygczrrA)
* [Stackoverflow问答爬虫](https://github.com/chenjiandongx/stackoverflow-spider)
* [tumblr爬虫](https://github.com/facert/tumblr_spider)
* [百度贴吧爬虫](https://github.com/ankanch/tieba-zhuaqu)
* [pixabay图片网站爬虫](https://github.com/LUCY78765580/Python-web-scraping/blob/master/pixabay.py)
* [pexels图片网站爬虫](https://www.zhihu.com/question/58151047)
* [info爬虫](https://github.com/LUCY78765580/Python-web-scraping/blob/master/BoLiBei.py)
* [APP爬虫](https://github.com/LUCY78765580/Python-web-scraping/tree/master/TouTiao)
* [12306智能刷票订票](https://github.com/testerSunshine/12306)
* [12306购票助手](https://github.com/pjialin/py12306)
* [爬取皮皮虾/糗事百科/百思不得姐爬虫](https://github.com/Jiang-Fallen/JInfoSpider)
* [基于搜狗微信的公众号爬虫](https://github.com/chyroc/WechatSogou)
* [暗网中文网监控爬虫](https://github.com/s045pd/DarkNet_ChineseTrading)
* [电影天堂爬虫](https://github.com/FWC1994/Python-Crawler)
* [网络爬虫实践集合](https://github.com/Northxw/Python3_WebSpider)
* [小红书笔记爬虫](https://github.com/OrangeySeven/RedbookSpider)
* [小红书微信小程序爬虫](https://github.com/SoneyChan7/xhs-spider)
* [抖音/快手/小红书短视频爬虫](https://github.com/sunchao199606/ksv-crawler)
* [微信小程序爬虫](https://github.com/zhangxin1982/Wechat-MiniProgram-Spider)
* [拼多多爬虫](https://github.com/SZFsir/pddSpider)
* [电商爬虫系统：京东/当当/一号店/国美爬虫]()
* [知乎/V2EX/微博/贴吧/IT之家/豆瓣/虎扑/天涯/GitHub等网站热门头条的多线程爬虫](https://github.com/zxins/hotfish)
* [NBA近十年新秀爬虫](https://github.com/Marhooo/NBA-Visualization)
* [PornHub爬虫](https://github.com/levphon/pornhubbot)
* [A站视频信息爬虫](https://github.com/ChangxingJiang/CxSpider/tree/master/spider/Acfun_Video)
* [安居客各地房源数量爬虫](https://github.com/ChangxingJiang/CxSpider/tree/master/spider/Anjuke_House_Resources_Num)
* [Facebook账号信息爬虫](https://github.com/ChangxingJiang/CxSpider/tree/master/spider/Facebook_Account_Info)
* [Google搜索引擎收录增量爬虫](https://github.com/ChangxingJiang/CxSpider/tree/master/spider/Google_Result_Num)
* [Twitter用户信息爬虫](https://github.com/ChangxingJiang/CxSpider/tree/master/spider/Twitter_Account_Info)
* [起点中文网小说列表爬虫](https://github.com/ChangxingJiang/CxSpider/tree/master/spider/Qidian_Book_Type_List)
* [英雄联盟每日比赛列表爬虫](https://github.com/ChangxingJiang/CxSpider/tree/master/spider/Wanplus_Lol_Date_List)
* [智联招聘爬虫](https://github.com/wqh0109663/JobSpiders)
* [瓜子二手车爬虫](https://github.com/jiawei96-liu/second_hand_car)
* [微信公众号爬虫](https://github.com/wnma3mz/wechat_articles_spider)

## Star History

[![Star History Chart](https://api.star-history.com/svg?repos=ityard/python-fxxk-spider&type=Date)](https://star-history.com/#ityard/python-fxxk-spider)

## 注意事项

**爬虫虽好，但注意要合法使用！** 下面的仓库整理了中国大陆爬虫使用者涉诉与违规相关的新闻资料与法律法规，可以帮助大家了解我国相关法律，避免触碰数据合规红线。

* [中国大陆爬虫使用者涉诉与违规相关的新闻资料与法律法规](https://github.com/HiddenStrawberry/Crawler_Illegal_Cases_In_China)

## 更新记录

* 2021-10-24 创建

本内容持续更新，欢迎您 [star 本项目](https://github.com/ityard/python-fxxk-spider)

## 联系我

微信公众号：Python小二，回复 1024 领 100+ Python 实战项目