# githubDailyTrendSpider

**Repository Path**: icepear_eric/githubDailyTrendSpider

## Basic Information

- **Project Name**: githubDailyTrendSpider
- **Description**: github daily trend 爬虫
- **Primary Language**: Python
- **License**: Not specified
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2023-03-08
- **Last Updated**: 2023-03-08

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# githubDailyTrendSpider
github daily trend 爬虫

爬取Github 每日热搜榜，将抓取的数据自动存储到数据库，因此需要配置数据库连接的相关信息，

1.需要在在下面配置数据库连接用户名和密码
def db_connect():
    try:
        db = pymysql.connect(host='localhost', port=3306, user='数据库用户名', password='数据库密码', database='gitTrend_db',
                             charset='utf8')
                             

2.创建数据库和数据表

数据库名字：gitTrend_db

表名：github_trending_day

建表语句：

CREATE TABLE IF NOT EXISTS `github_trending_day` (

  `id` int NOT NULL AUTO_INCREMENT,
  
  `ranking` int DEFAULT NULL,
  
  `repo` varchar(50) DEFAULT NULL,
  
  `url` varchar(256) CHARACTER SET utf8mb3 COLLATE utf8_general_ci DEFAULT NULL,
  
  `description` text CHARACTER SET utf8mb3 COLLATE utf8_general_ci,
  
  `lang` varchar(50) DEFAULT NULL,
  
  `stars` varchar(50) DEFAULT NULL,
  
  `forks` varchar(50) DEFAULT NULL,
  
  `added_stars` varchar(120) DEFAULT NULL,
  
  `time` datetime DEFAULT NULL,
  
  PRIMARY KEY (`id`)
  
) ENGINE=InnoDB AUTO_INCREMENT=173 DEFAULT CHARSET=utf8mb3;