High-performance C++ LLM inference server with dynamic batching and paged KV cache.
A cross-platform networking library in C/C++ for client-side SDKs — the connectivity foundation for your applications.
Zero-dependency C++11 utility library with 25 independent modules: JSON, hashing, logging, thread pool, UUID, and more.
为 AI Agent 提供微秒级流式消息路由的嵌入式 C++ 中间件。库优先，可选独立服务。 Embedded C++ messaging middleware for microsecond streaming routing in AI Agents. Library-first, with optional standalone server.
io_uring client & io_uring server examples
