# EmbeddingInferenceServer

**Repository Path**: manliu/embedding-inference-server

## Basic Information

- **Project Name**: EmbeddingInferenceServer
- **Description**: No description available
- **Primary Language**: Python
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2025-04-17
- **Last Updated**: 2025-04-17

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# EmbeddingInferenceServer

#### 介绍
Embedding Server,兼容OpenAI接口规范,embedding model为**netease-youdao/bce-embedding-base_v1**,支持水平扩展

#### 软件架构
基于ONNXRuntime部署模型


#### 安装教程

1.  无需安装直接执行

#### 使用说明

1.  启动
    ```python
    python -u src/embedding_server.py
    ```

1.  客户端调用
    ```python
    python -u test/test.py
    ```