# ProjectNIIT

**Repository Path**: favorite-wang-liang/project-niit

## Basic Information

- **Project Name**: ProjectNIIT
- **Description**: HNU-NIIT project
- **Primary Language**: Java
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 1
- **Forks**: 0
- **Created**: 2024-06-24
- **Last Updated**: 2024-06-24

## Categories & Tags

**Categories**: Uncategorized

**Tags**: Java, hadoop, sqoop, flume, HTML

## README

## Diabetes Project Config

### Part 1. Configuration

#### Step 1. Version Configuration

`hadoop version-2.9.2`
`hbase version-2.2.4`
`hive version-2.3.8`
`sqoop version-1.4.7`
`flume version-1.9.0`

#### Step 2. Virtual Machine Commands

`start-all.sh` **start hadoop**
`start-hbase.sh` **Starts hbase**

#### Step 3. Modify the idea configuration file config.java

#### Step 4. Configuration Tomcat server

#### Step 5. flume 
```java
flume-ng agent -n agent -f flume/flume-conf.properties
```

### Part 2. Data Upload

#### Step 1. Windows to Mysql

#### Step 2. Mysql to HDFS use Sqoop

#### Step 3. Mysql to Hive use Sqoop

#### Step 4. Mysql to HDFS use Flume(Logs)

#### Step 5. Windows to HDFS use Flume(Logs)

#### Step 6. Mapreduce data process

### Part 3. Technique and Tools

##### part 3.1 Data Transfer

Sqoop、Flume

##### part 3.2 Data Stored

MySQL、HDFS

##### part 3.3 Data Process

Mapreduce、HBase

##### part 3.4 Data Display

Echart