Sign in
Sign up
Explore
Enterprise
Education
Search
Help
Terms of use
About Us
Explore
Enterprise
Education
Gitee Premium
Gitee AI
AI teammates
Sign in
Sign up
Categories
New Tech
Lowcode
科研论文
quantum
Web 3.0
Cloud Native
OpenHarmony
HarmonyOS Button
HarmonyOS EditText
HarmonyOS Layout
HarmonyOS Image
HarmonyOS Progress
HarmonyOS Menu
HarmonyOS Popup
HarmonyOS Selector
HarmonyOS TextView
HarmonyOS ListView
HarmonyOS Loading
HarmonyOS Notification
HarmonyOS View Transition
HarmonyOS Slider
HarmonyOS Chart
HarmonyOS Draw
HarmonyOS Counter
HarmonyOS Animate
HarmonyOS Captcha
HarmonyOS Multimedia
HarmonyOS Barcode
HarmonyOS Advanced
HarmonyOS Map
OpenHarmony Games
HarmonyOS Networking
HarmonyOS Communication
HarmonyOS Payment
HarmonyOS Database
HarmonyOS Drivers
OpenHarmony Guide
OpenHarmony DevTools
OpenHarmony App
HMS
HarmonyOS Permission
HarmonyOS Toolkit
OpenHarmony Components
Gesture
Development Lib
Chinese/English Segmenter
Payment Dev
Security Dev
Common Toolkit
Excel Toolkit
Barcode/QRCode
Template Engine
Desktop UI
Network Development Package
Audio Process
Network Tool
Network Service
Data Mining
Job/Task Scheduling
Programming Language/Scripting Language
Cache
Markdown Tools
Search Engine
Microservice
Workflow
Chart/Diagram Component
Authority Management
Reporting Tool
Code Generator
IoC/AOP Framework
Image Library
Rule Engine
JSON Toolkit
Log Toolkit
Spring Boot Extension
Verification Code
Algorithm/Mathematical Calculation
Node Extension
Process Engine
Animation Development
3G/4G/5G
Tauri Plugins
AI/ML
Artificial Intelligence
VR/AR
Machine Learning/Deep Learning
Computer Vision/Face Recognition
Smart Home
Natural Language Processing
LLM
inference-lib
MCP/Agents/Skills
RAG
Datasets
Industrial
Hardware
IoT/Edge Computing
车载应用
Car Application
Autopilot
Robots
5G
chips
Privacy Computing
Engineering
CAD
CAE
MBSE
CAM
EDA
Blockchain
bitcoin
NFT
Wechat Projects
Wechat Development Package
WeChat Applet/Game
WeChat Application
WeChat Game
Enterprise App
Task/Project Management
Enterprise Application System
Business Intelligence
Financial/Stock Securities
GIS/Map/Navigation/Positioning
Web System
Content Management System
New-Sale/E-Shop
BBS
Blog
Questionnaire
SNS
Teaching Managment
Album/Gallery/Picture
RSS/Atom Tool
Application
File Management System
Multimedia
Text Editor
Instant Messaging
Application Software
RPA-机器人过程自动化
Web Development
Web Framework
jQuery Plugin
UI Framework
JavaScript Toolkit
RESTful Projects
Backend Management
Website Theme
Vue.js Components
Web Sipder
OAuth/SSO
Angular Plugin
Bootstrap Plugin
React Compnent
RPC Development Framework
API Gateway
短网址
layui-components
DevOps/Network
Network Management Tool
System Monitor
DevOps
Mobile Dev
Android Component/ Project
iOS Component
Mobile App
Alipay Applet
Baidu Applet
PhoneGap/Cordova Plugin
Cross-platform Mobile Development
QuickApp
TV Devel
uniapp components
Development Tools
Version Management System
Dev/Debug
Wiki/Document
Compile/Build/Deploy
Maven Plugin
Gulp Extension
Testing Tool
Code Scan
Server Development
Distributed Service/Framework
Message Server/Message Queue
Docker
Container/Virtual Machine
Nginx Module
Big Data
Cloud Computing
One-click Installation Package
OpenResty Extension
系统性能优化
Serverless
storage
Database Related
DB Development Package
Database Service
Database Management/Monitor
Game/Recreation
Game
Game Development
3D Engine
Plugins/Extension
Chrome Extension
Wordpress Plugin
Eclipse Plugin
IDEA Plugin
Firefox Extension
Safari Extension
Visual Studio Code Plugin
Jenkins Plugins
Other
Simulation Project
Handbook/Manual/Tutorial
ACM/OJ Project
Operation System
Teaching Managment
Tutorial Code
RISC-V Development
Bio/Medical
2020公益黑客马拉松
新冠病毒相关开源
Web Development
/
Web Sipder
Licenses
MulanPSL-2.0
0BSD
AFL-3.0
AGPL-3.0
Apache-2.0
Artistic-2.0
BSD-2-Clause
BSD-3-Clause
BSD-3-Clause-Clear
BSD-4-Clause
BSL-1.0
CC-BY-4.0
CC-BY-SA-4.0
CC0-1.0
CECILL-2.1
CERN-OHL-P-2.0
CERN-OHL-S-2.0
CERN-OHL-W-2.0
ECL-2.0
EPL-1.0
EPL-2.0
EUPL-1.1
EUPL-1.2
GFDL-1.3
GPL-2.0
GPL-3.0
ISC
LGPL-2.1
LGPL-3.0
LPPL-1.3c
MIT
MIT-0
MPL-2.0
MS-PL
MS-RL
MulanPSL-1.0
MulanPubL-1.0
MulanPubL-2.0
NCSA
ODbL-1.0
OFL-1.1
OSL-3.0
PostgreSQL
UPL-1.0
Unlicense
Vim
WTFPL
Zlib
Python
All Languages
Java
JavaScript
HTML
CSS
Shell
TypeScript
C
C++
C#
PHP
Go
Objective-C
Kotlin
Android
Ruby
PowerShell
Swift
Assembly
Dart
Rust
Lua
NodeJS
Perl
Matlab
其他
HTML/CSS
Scala
微信
Groovy
C/C++
Verilog
XSLT
R
QML
Pascal
Docker
CoffeeScript
FORTRAN
Erlang
Smalltalk
M
SQL
Emacs Lisp
ActionScript
VHDL
Delphi
TeX/LaTeX
Common Lisp
Scheme
Visual Basic
ASP
Clojure
LiveScript
Awk
Julia
Haskell
Elixir
Pawn
易语言
AutoHotkey
D
YAML
Standard ML
Logos
Coq
Ada
OCaml
Prolog
Puppet
XML
Arduino
VimL
汇编
Haxe
Vala
Scilab
ColdFusion
Crystal
Racket
Lisp
Slash
Eiffel
eC
DOT
Zephir
Nemerle
Stars
Stars
Recommend
Last updated
AJay13/ECommerceCrawlers
GVP
5.4K
实战多种网站、电商数据爬虫。包含:淘宝商品、微信公众号、大众点评、招聘网站、闲鱼、阿里任务、scrapy博客园、微博、百度贴吧、豆瓣电影、包图网、全景网、豆瓣音乐、某省药监局、搜狐新闻、机器学习文本采集、fofa资产采集、汽车之家、国家统计局、百度关键词收录数、蜘蛛泛目录、今日头条、豆瓣影评️️️。微信爬虫展示项目:
Python
Web Sipder
|
over 2 years ago
Deep Research
shengqiangzhang/examples-of-web-crawlers
607
一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
Python
crawler
Selenium
wechat
Taobao
Python
Web Sipder
|
over 4 years ago
Deep Research
JIANGWL/ZhihuSpider
503
多线程知乎用户爬虫,基于python3
Python
Web Sipder
|
almost 9 years ago
Deep Research
DTC2/ECommerceCrawlers
441
实战多种网站、电商数据爬虫。包含:淘宝商品、微信公众号、大众点评、闲鱼、阿里任务、百度贴吧、豆瓣电影、包图网、全景网、豆瓣音乐、某省药监局、搜狐新闻、机器学习文本采集、fofa资产采集、汽车之家️️️
Python
Web Sipder
|
6 years ago
Deep Research
resolvewang/WeiboSpider
364
分布式微博爬虫。抓取内容包括微博用户资料、微博信息、评论信息和转发信息。目前专注于微博数据抓取本身,正在快速迭代。如果觉得有帮助,不妨到github上给我点个star,osc上可能不会再继续更新了
Python
Web Sipder
|
9 years ago
Deep Research
mktime/scrapy-douban-group
359
通过一个实际的项目,来学习如何使用scrapy爬取网络上的信息。这里以豆瓣小组为例,对组内的图片进行爬取,相关信息保存数据到MongoDB,图片下载到本地。
Python
Web Sipder
|
10 months ago
Deep Research
isyuu/wxhub
343
微信公众号文章-无限制抓取
Python
Web Sipder
|
almost 8 years ago
Deep Research
小码编程/scrapy_zhaopin
252
基于Python和Echarts职位画像系统,使用Scrapy抓取职位招聘数据,使用Django+echarts完成数据可视化
Python
Web Sipder
|
over 5 years ago
Deep Research
惊鸿一回车/WeChat_Article
225
爬取微信公众号文章
Python
Web Sipder
|
7 months ago
Deep Research
沈阳程序员/Scrapy-Python
133
Scrapy:网站爬虫框架库抓取
Python
Web Sipder
|
1 year ago
Deep Research
博众科技/feapder
109
feapder是一款支持分布式、批次采集、任务防丢、报警丰富的python爬虫框架
Python
Web Sipder
|
11 months ago
Deep Research
Algebra-FUN/WeReadScan
86
扫描“微信读书”已购图书并下载本地PDF的爬虫
Python
Web Sipder
|
3 years ago
Deep Research
fffonion/xeHentai
73
绅士站爬虫 镜像自 https://github.com/fffonion/xeHentai
Python
Web Sipder
|
almost 5 years ago
Deep Research
liweimin/爬虫代码片段 拼多多,团油,抖店
61
pinduoduo店铺订单采集 彩妆网商品采集 团油油站油价采集 douyin 抖音店铺数据采集 往约app数据采集 快手视频批量上传 抖音视频批量上传 异步采集写真/头像 登录农业银行 钉钉商机 西煤交易定时按键 设备协会人员资质 liweimin@taiyuan
Python
Web Sipder
|
over 1 year ago
Deep Research
Herche Jane/IntelliScraper
57
它是一个先进的网络爬虫工具,利用 BeautifulSoup 和机器学习技术实现高效的数据提取和分析。
Python
Web Sipder
|
almost 3 years ago
Deep Research
1
2
3
4
5
Trending Projects
Today
Weekly
Nothing here
AJay13/ECommerceCrawlers
5.4K
实战多种网站、电商数据爬虫。包含:淘宝商品、微信公众号、大众点评、招聘网站、闲鱼、阿里任务、scrapy博客园、微博、百度贴吧、豆瓣电影、包图网、全景网、豆瓣音乐、某省药监局、搜狐新闻、机器学习文本采集、fofa资产采集、汽车之家、国家统计局、百度关键词收录数、蜘蛛泛目录、今日头条、豆瓣影评️️️。微信爬虫展示项目:
Going to Help Center
Search
Git 命令在线学习
如何在 Gitee 导入 GitHub 仓库
Git 仓库基础操作
企业版和社区版功能对比
SSH 公钥设置
如何处理代码冲突
仓库体积过大,如何减小?
如何找回被删除的仓库数据
Gitee 产品配额说明
GitHub仓库快速导入Gitee及同步更新
什么是 Release(发行版)
将 PHP 项目自动发布到 packagist.org
Back to the top