# TiBigData

**Repository Path**: ai-iotdb/TiBigData

## Basic Information

- **Project Name**: TiBigData
- **Description**: TiBigData 是为了整合 TiDB 与大数据而诞生的项目，它借助 Flink/Presto/MapReduce 等分布式计算框架，充分发挥 TiDB 分布式集群的优势，为 TiDB 在大数据场景下的使用带来良好的用户体验。
- **Primary Language**: Unknown
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 2
- **Forks**: 1
- **Created**: 2023-02-26
- **Last Updated**: 2024-03-23

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# TiBigData
[License](https://github.com/pingcap-incubator/TiBigData/blob/master/LICENSE)

---
[![EN doc](https://img.shields.io/badge/document-English-blue.svg)](README.md)
[![CN doc](https://img.shields.io/badge/文档-中文版-blue.svg)](README_zh_CN.md)
---

Misc BigData components for TiDB, Presto, Flink and MapReduce connectors for example.

## License

TiBigData project is under the Apache 2.0 license. See the [LICENSE](./LICENSE) file for details.

## Code style

TiBigData use [Google Code Style](https://github.com/google/styleguide).

Format the code with the following command:

```bash
mvn com.coveo:fmt-maven-plugin:format
```

## Getting Started

**Compiling TiBigData requires git and downloading source code directly is not supported.**

[Flink-TiDB-Connector(Batch)](./flink/README.md)

[Flink-TiDB-Connector(Unified Batch & Streaming)](./flink/README_unified_batch_streaming.md)

[PrestoSQL-TiDB-Connector](./prestosql/README.md)

[Trino-TiDB-Connector](./trino/README.md)

[PrestoDB-TiDB-Connector](./prestodb/README.md)

[MapReduce-TiDB-Connector](./mapreduce/README.md)

[Hive-TiDB-Storage-Handler](./hive/README.md)

## Run Tests

Use the following command to run the integration test.

```bash
export TIDB_HOST="127.0.0.1"
export TIDB_PORT="4000"
export TIDB_USER="root"
export TIDB_PASSWORD=""
mvn clean test-compile failsafe:integration-test -am -pl ${MODULE_NAME}
```

Use the following command to run the unit test.

```
mvn clean test -am -pl ${MODULE_NAME}
```

## Write integration test

First, make sure the module add dependency:

```xml
 <dependency>
      <groupId>io.tidb</groupId>
      <artifactId>bigdata-test</artifactId>
      <version>${project.version}</version>
      <scope>test</scope>
</dependency>
```

Second, use JUnit Category to clarify integration-test:

```java
import io.tidb.bigdata.test.IntegrationTest;

@Category(IntegrationTest.class)
public class ConnectorsPluginTest {
}
```

## Community

Lark / Feishu Group:

<img src="docs/assets/lark_group.png" width="300">

## Supported by

### YourKit

![YourKit Logo](https://www.yourkit.com/images/yklogo.png)

YourKit supports open source projects with innovative and intelligent tools
for monitoring and profiling Java and .NET applications.
YourKit is the creator of <a href="https://www.yourkit.com/java/profiler/">YourKit Java Profiler</a>,
<a href="https://www.yourkit.com/.net/profiler/">YourKit .NET Profiler</a>,
and <a href="https://www.yourkit.com/youmonitor/">YourKit YouMonitor</a>.

### IntelliJ IDEA

<img src="https://resources.jetbrains.com/storage/products/company/brand/logos/IntelliJ_IDEA_icon.png" width="50">

[IntelliJ IDEA](https://www.jetbrains.com/?from=TiBigData) is a Java integrated development environment (IDE) for developing computer software.  
It is developed by JetBrains (formerly known as IntelliJ), and is available as an Apache 2 Licensed community edition,  
and in a proprietary commercial edition. Both can be used for commercial development.