2 Commits

Include renames

Author	SHA1	Message	Date
Jon Saad-FalconandClaude Opus 4.6	2aebcd7d77	feat: Phase 23 — Differentiated functionalities ... Trace-driven learning pipeline: - TrainingDataMiner: extract SFT/routing/agent pairs from traces - LoRATrainer: fine-tune local models from trace-derived data - AgentConfigEvolver: rewrite agent configs from trace analysis - LearningOrchestrator: coordinate mine→train→evolve cycle, wired into SystemBuilder Eval framework (15 real IPW benchmarks): - Datasets: SuperGPQA, GPQA, MMLU-Pro, MATH-500, Natural Reasoning, HLE, SimpleQA, WildChat, IPW, GAIA, FRAMES, SWE-bench, SWEfficiency, TerminalBench, TerminalBench Native - Scorers: MCQ extraction, LLM-judge, exact match, structural validation - CLI: jarvis eval list|run|compare|report Composable abstractions: - Recipe system: TOML composition of all 5 pillars (3 built-in recipes) - Agent templates: 15 pre-configured TOML manifests with system prompts - Bundled skills: 20 ready-to-use TOML skill manifests - Operator recipes: researcher (4h), correspondent (5min), sentinel (2h) 102 files changed, ~11,500 lines added. 3241 tests pass (44 skipped). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-03-02 05:34:46 +00:00
Jon Saad-FalconandClaude Opus 4.6	bd49383201	Add evaluation framework and center README logo SVGs ... Evaluation framework (evals/): benchmarking system for measuring accuracy across four categories — Chat (WildChat), Reasoning (SuperGPQA), RAG (FRAMES), and Agentic (GAIA). Two backends: jarvis-direct (engine-level) and jarvis-agent (agent-level with tool calling), both supporting local and cloud models. Datasets adapted from IPW, scorers include exact match, LLM letter extraction, and LLM-as-judge. Parallel execution via ThreadPoolExecutor with incremental JSONL output. CLI: python -m evals {run,run-all,summarize,list}. 57 tests pass. SVG fix: center logo content within viewBox by wrapping icon+text in a translate(90,0) group, eliminating the left-shift visible in the README. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-22 23:48:43 +00:00