High-performance C++ LLM inference server with dynamic batching and paged KV cache.
最近更新: 4天前A cross-platform networking library in C/C++ for client-side SDKs — the connectivity foundation for your applications.
最近更新: 5天前Zero-dependency C++11 utility library with 25 independent modules: JSON, hashing, logging, thread pool, UUID, and more.
最近更新: 5天前为 AI Agent 提供微秒级流式消息路由的嵌入式 C++ 中间件。库优先，可选独立服务。 Embedded C++ messaging middleware for microsecond streaming routing in AI Agents. Library-first, with optional standalone server.
最近更新: 5天前
