# UnInfer

**Repository Path**: mgdh/uninfer

## Basic Information

- **Project Name**: UnInfer
- **Description**: 一个关于推理的仓库。
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2026-03-21
- **Last Updated**: 2026-08-21

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# UniInfer

UniInfer is organized so that reusable inference infrastructure remains
separate from task flows, examples and complete applications.

```text
UniInfer/
├── backend/      Tensor abstraction and inference backends
├── toolkit/      Shared utilities (Git submodule)
├── examples/     Small API examples
├── projects/     Complete applications and external project submodules
├── llama.cpp/    Optional local LLM dependency
└── cmake/        CMake dependency and package helpers
```

## Dependency direction

```text
projects -> backend
         -> toolkit
examples -> backend
         -> toolkit
```

Lower-level directories must not depend on `examples` or `projects`.

## Build

```bash
cmake -S . -B build
cmake --build build --config Release
```

Available top-level options:

- `UNIINFER_BUILD_EXAMPLES`: build examples; defaults to `ON`.
- `UNIINFER_BUILD_PROJECTS`: build full applications; defaults to `OFF`.

Projects are disabled by default because they may require additional CUDA,
Qt, FFmpeg, GStreamer or hardware-specific dependencies.