mirror of
https://github.com/open-jarvis/OpenJarvis.git
synced 2026-07-30 19:02:16 +00:00
961b451047fbb7669e80f47f783170e468f48b3f
Adds three new inference engine implementations to the Rust engine crate: - VLLMEngine: OpenAI-compatible /v1/chat/completions API - SGLangEngine: OpenAI-compatible API with SGLang-specific features - LlamaCppEngine: Native /completion endpoint with ChatML prompt formatting All backends implement InferenceEngine trait with generate, stream, list_models, and health methods. Includes comprehensive unit tests. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Description
No description provided
105 MiB
Languages
Python
82.8%
Rust
8.6%
TypeScript
7.1%
Shell
0.7%
HTML
0.3%
Other
0.5%