# clickhouse-sink

**Repository Path**: javakoala/clickhouse-sink

## Basic Information

- **Project Name**: clickhouse-sink
- **Description**: flume clickhouse-sink
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2022-02-10
- **Last Updated**: 2022-02-17

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

1、使用环境
MySql -> Maxwell -> Kafka -> Flume -> Clickhouse

2、打包命令

```sh
mvn assembly:assembly
```

3、将clickhouse-sink-1.0.0.jar拷贝到flume/lib目录

4、编辑配置文件启用该sink

```pro
a1.sources = r1
a1.sinks = k1
a1.channels = c1

a1.sources.r1.type = org.apache.flume.source.kafka.KafkaSource
a1.sources.r1.kafka.bootstrap.servers = localhost:9092
a1.sources.r1.kafka.topics = koala_olap
a1.sources.r1.kafka.consumer.group.id = custom.g.id

a1.sinks.k1.type = org.koala.clickhouse.sink.ClickhouseSink
a1.sinks.k1.host = 127.0.0.1
a1.sinks.k1.port = 8123
a1.sinks.k1.database = koala_olap
a1.sinks.k1.user = default
a1.sinks.k1.password = root

a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 1000

a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1
```

4、启动flume

```sh
./flume-ng agent --conf ../conf/ --conf-file ../conf/flume-conf.properties --name a1 -Dflume.root.logger=INFO,console
```