mirror of
https://github.com/open-jarvis/OpenJarvis.git
synced 2026-07-27 21:05:34 +00:00
docs(agents): add eval-backed model-capability guidance for OpenCodeAgent
A 27B local model (Qwen3.5-27B via vLLM) passed a 7-task coding suite cleanly (create/edit/bug-fix/implement-to-pass-tests/multi-file, verified by running code + pytest); an 8B model was unreliable. Document so users pick a capable model for real coding work. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
co-authored by
Claude Opus 4.7
parent
00b85b71dd
commit
c6f172cbdc
@@ -430,6 +430,16 @@ jarvis ask --agent opencode "Refactor the parser to use a state machine"
|
||||
!!! tip "Pass-through providers"
|
||||
If the `engine` has no derivable base URL, pass `model` as `provider/model` (e.g. `ollama/llama3`) and opencode resolves it from its own configuration — no `opencode.json` is written.
|
||||
|
||||
!!! warning "Model capability matters"
|
||||
opencode's agentic loop (planning + correct tool calls + multi-step
|
||||
follow-through) needs a reasonably capable model. In testing, a **27B**
|
||||
local model (Qwen3.5-27B served via vLLM) solved a 7-task coding suite
|
||||
cleanly (create / edit / bug-fix / implement-to-pass-tests / multi-file,
|
||||
verified by running the code and tests). An **8B** model (qwen3:8b) was
|
||||
unreliable — malformed tool calls, syntactically broken code, and
|
||||
half-finished tasks. Prefer a capable local model (or a cloud model) for
|
||||
real coding work.
|
||||
|
||||
---
|
||||
|
||||
## OperativeAgent
|
||||
|
||||
Reference in New Issue
Block a user