# LivySessionPool

**Repository Path**: vergilchiu/LivySessionPool

## Basic Information

- **Project Name**: LivySessionPool
- **Description**: No description available
- **Primary Language**: Java
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 1
- **Forks**: 0
- **Created**: 2021-05-14
- **Last Updated**: 2021-07-07

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Livy Session Pool

livy的session池子🌊

用session pool管理livy上的spark连接，保证连接的可用性。

使用apache的commons-pool实现。

## Feature

- 维护指定数量的spark连接
- 自动检测连接的可用性，不可用自动删除并创建新的连接

## Example

- 创建session

```java
        //配置
        LivySessionFactory livySessionFactory = new LivySessionFactory("http://10.12.6.58:8999",
                "work",
                "2G",
                2,
                "2G",
                2,
                2,
                2,
                "default");

        //池子配置
        GenericObjectPoolConfig genericObjectPoolConfig = new GenericObjectPoolConfig();
        genericObjectPoolConfig.setMinIdle(1);
        genericObjectPoolConfig.setMaxIdle(1);//保留连接池大小
        genericObjectPoolConfig.setMaxTotal(1);//最大连接池大小
        genericObjectPoolConfig.setMinEvictableIdleTimeMillis(1000 * 60 * 60 * 12);//空闲移除时长
        genericObjectPoolConfig.setTimeBetweenEvictionRunsMillis(1000 * 60 * 1);//空间资源监测时间间隔
        genericObjectPoolConfig.setTestOnCreate(true);//验证。create
        genericObjectPoolConfig.setTestOnBorrow(true);//验证。borrow
        genericObjectPoolConfig.setTestWhileIdle(true);//验证。idle
        genericObjectPoolConfig.setFairness(true);//从池子中拿对象的公平锁
        genericObjectPoolConfig.setLifo(false);//last in first out，设置为false，可以让池子中的对象排队被获取
        genericObjectPoolConfig.setEvictionPolicyClassName(ScheduleEvictionPolicy.class.getName());//自定义实现驱逐策略，定时驱逐

        //创建session pool
        livySessionPool = new LivySessionPool(livySessionFactory, genericObjectPoolConfig);
        //预热
        livySessionPool.preparePool();
```

- 查询

```java
        Session session = livySessionPool.borrowObject();
        try {
            Statement statement = session.executeStatementSync("show databases", "sql");
            System.out.println("statement = " + statement);
        } catch (Exception e) {

        } finally {
            livySessionPool.returnObject(session);
        }
```



## Build And Package

```shell
mvn clean package -Dmaven.test.skip=true 
```