# FetchMeCrawl

**Repository Path**: xinwang0/FetchMeCrawl

## Basic Information

- **Project Name**: FetchMeCrawl
- **Description**: the Crawl for FetchMe getting more and more data
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 2
- **Created**: 2018-03-14
- **Last Updated**: 2020-12-19

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

#FetchMeCrawl
##Abstract
This is the project to fetch more data for FetchMe project. Now the project is going to statisfy the most famous data engine to crawl our data. including [Baidu](www.baidu.com), [Google](www.google.com),[Bing](www.bing.com),[Flickr](www.flickr.com),[Instagram](www.instagram.com).
##Structure
###*1. FetchAll*
This is the total wrapper for all different engines,like BaiduImage,GoogleIamge,BingImage,FlickrImage,InstagramImage and so on,these image engines all store their data fetch into the SqlDB using the db file UrlImage.db.
###*2. SqlDB*
This is the Sql for the data taing the role of the database.it provides the insert and queryAll implements now.And the main table is ImageUrl which is by all differe rows structed like (id, url, engine, keywords).
###*3. BaiduImage*
Use baidu image engine to get different data.The same engine as others provides the fetch implements. Their different crawl methods will be introduced by now.
###*4. GoogleImage*
Use google image to fetch data.
###*5. BingImage*
Use bing image engine to fetch data.
###*6. FlickrImage*
Use flickr image to query interesting image to fetch data.
###*7. InstagramImage*
Like FlickrImage to fetch data.
##Feature
I wiil tell the main methods to crawl these web engines using different ideas.The Crawl will support the crawl the releated video about the infomation,this is going to develop.