SGLang is a high-performance serving framework for large language models and multimodal models.
最近更新: 6小时前SGLang Omni: High-Performance Multi-Stage Pipeline Framework for Omni Models
最近更新: 7小时前Sub2API 一站式开源中转服务,让 Claude、Openai 、Gemini、Antigravity订阅统一接入,支持拼车共享,更高效分摊成本,原生工具无缝使用。
最近更新: 6天前A high-throughput and memory-efficient inference and serving engine for LLMs
最近更新: 9天前🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
最近更新: 2个月前