Jon Saad-Falcon and Claude Opus 4.6
24972e3e52
Add Phase 12+13: energy measurement, install polish, PWA, cross-hardware
...
Phase 12 — Energy Measurement Upgrade:
- EnergyMonitor ABC with multi-vendor support (NVIDIA hw counters,
AMD amdsmi, Apple zeus-ml, CPU RAPL sysfs)
- EnergyBatch batch-level energy-per-token accounting
- SteadyStateDetector CV-based thermal equilibrium detection
- EnergyBenchmark with warmup phase
- InstrumentedEngine prefers EnergyMonitor over legacy GpuMonitor
- Telemetry store/aggregator extended with energy fields
Phase 13 — Install, Hosting, Cross-Hardware:
- jarvis doctor diagnostic command (8 checks, --json output)
- jarvis init post-setup guidance with engine-specific next steps
- README Quick Start section
- MLX engine backend (Apple Silicon → mlx recommendation)
- AMD VRAM/multi-GPU detection via rocm-smi
- PyTorch MPS device selection in orchestrator trainers
- PWA support (vite-plugin-pwa, service worker, manifest, icons)
- Server static file serving fix for PWA files
- Dockerfile.gpu.rocm + docker-compose.gpu.rocm.yml for ROCm
- Eval framework display module and efficiency metrics
2244 tests pass, 37 skipped.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com >
2026-02-26 20:09:07 +00:00
Jon Saad-Falcon and Claude Opus 4.6
9ec402ab4a
Enrich agent tool awareness, normalize engine tool_calls, add telemetry and eval config
...
- Add build_tool_descriptions() shared builder for enriched agent system
prompts (NativeReAct, NativeOpenHands, RLM, Orchestrator structured mode)
- Normalize tool_calls to flat {id, name, arguments} across CloudEngine
(OpenAI/Anthropic/Google), LiteLLM, and Ollama
- Add Anthropic tool_use extraction and input_schema conversion
- Add Google function_call extraction
- Make ReAct/OpenHands parsing case-insensitive
- Add telemetry efficiency, GPU monitor, and vLLM metrics modules
- Add TOML-based eval suite config system
- Update documentation and changelog
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com >
2026-02-25 01:58:18 +00:00
Jon Saad-Falcon and Claude Opus 4.6
323d7ff032
Add TOML config system for eval suites, pillar-aligned config, and documentation
...
- Eval config: TOML-based suite configs defining models x benchmarks matrix,
loaded via --config flag. Includes load_eval_config(), expand_suite(),
7 config dataclasses, 3 example configs, and 61 new tests.
- Pillar-aligned config: generation params in IntelligenceConfig, nested
engine/learning configs, agent objective/system_prompt/context_from_memory,
structured learning sub-policies, TOML migration layer.
- Documentation: evaluations user guide, evals API reference, updated
mkdocs.yml navigation, updated architecture docs.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com >
2026-02-24 03:34:05 +00:00
Jon Saad-Falcon and Claude Opus 4.6
bd49383201
Add evaluation framework and center README logo SVGs
...
Evaluation framework (evals/): benchmarking system for measuring accuracy
across four categories — Chat (WildChat), Reasoning (SuperGPQA), RAG (FRAMES),
and Agentic (GAIA). Two backends: jarvis-direct (engine-level) and jarvis-agent
(agent-level with tool calling), both supporting local and cloud models.
Datasets adapted from IPW, scorers include exact match, LLM letter extraction,
and LLM-as-judge. Parallel execution via ThreadPoolExecutor with incremental
JSONL output. CLI: python -m evals {run,run-all,summarize,list}. 57 tests pass.
SVG fix: center logo content within viewBox by wrapping icon+text in a
translate(90,0) group, eliminating the left-shift visible in the README.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com >
2026-02-22 23:48:43 +00:00
