# hadoop

**Repository Path**: cqcfe/hadoop

## Basic Information

- **Project Name**: hadoop
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2021-08-03
- **Last Updated**: 2025-11-07

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# hadoop

#### 介绍
基于docker-compose管理的hadoop容器集群
#### 软件架构
软件架构说明

| 服务名称  |  集群节点 |
|---|---|
| SSH  |  ssh.hadoop.com |
| HTTP | nginx01.hadoop.com |
| MYSQL | mysql.hadoop.com |
| ZK集群  | zk01.hadoop.com、zk02.hadoop.com、zk03.hadoop.com |
| Hadoop集群  | master.hadoop.com、slave1.hadoop.com、slave2.hadoop.com |
| Hive  | hive.hadoop.com |
| Flume集群  | master.flume.com、slave1.flume.com、slave2.flume.com |
| HBase集群  | master.region.com、node01.region.com、node02.region.com |
| Sqoop  | sqoop.hadoop.com |
| Sqoop2  | sqoop2.hadoop.com |
| Spark集群  | master.spark.com、worker1.spark.com、worker2.spark.com |
| Grafana  | grafana.hadoop.com |
| 普罗米修斯  | prometheus.hadoop.com |


#### 安装教程

1.  [安装Docker](https://note.youdao.com/s/AwToQnc1)
2.  下载软件: ./down.sh
3.  基础镜像: ./build.sh
4.  在docker-compose.yml所在目录执行如下操作
5.  构建镜像: docker compose build
6.  启动集群: docker compose up -d
7.  查看集群: docker-compose ps -a

#### 使用说明

1.  配置本地电脑的 hosts 文件
```bash
# Added by Hadoop
192.168.10.100  master.spark.com
192.168.10.100  worker1.spark.com
192.168.10.100  worker2.spark.com
192.168.10.100  master.hadoop.com
192.168.10.100  slave1.hadoop.com
192.168.10.100  slave2.hadoop.com
192.168.10.100  slave3.hadoop.com
192.168.10.100  master.region.com
192.168.10.100  node01.region.com node01.region.com.hadoop_hadoopnet
192.168.10.100  node02.region.com node02.region.com.hadoop_hadoopnet
192.168.10.100  grafana.hadoop.com
192.168.10.100  prometheus.hadoop.com
# End of section
```
2.  conf/users.txt 集群账户和密码
3.  集群中访问WEBUI: http://{ip/host}:3080
4.  使用账户进行访问: ssh -p 2022 hive@{ip/host}
5.  集群中访问数据库: mysql -uroot -p7B4Ha2 -h mysql.hadoop.com