Jon Saad-FalconandClaude Opus 4.6 961b451047 feat(rust): add vLLM, SGLang, and llama.cpp engine backends
Adds three new inference engine implementations to the Rust engine crate:
- VLLMEngine: OpenAI-compatible /v1/chat/completions API
- SGLangEngine: OpenAI-compatible API with SGLang-specific features
- LlamaCppEngine: Native /completion endpoint with ChatML prompt formatting

All backends implement InferenceEngine trait with generate, stream,
list_models, and health methods. Includes comprehensive unit tests.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-07 00:28:29 +00:00
2026-03-03 19:12:37 -08:00
2026-03-05 13:47:26 -08:00
S
Description
No description provided
105 MiB
Languages
Python 82.8%
Rust 8.6%
TypeScript 7.1%
Shell 0.7%
HTML 0.3%
Other 0.5%