2 Commits

Include renames

Author	SHA1	Message	Date
Jon Saad-FalconandClaude Opus 4.6	9ec402ab4a	Enrich agent tool awareness, normalize engine tool_calls, add telemetry and eval config ... - Add build_tool_descriptions() shared builder for enriched agent system prompts (NativeReAct, NativeOpenHands, RLM, Orchestrator structured mode) - Normalize tool_calls to flat {id, name, arguments} across CloudEngine (OpenAI/Anthropic/Google), LiteLLM, and Ollama - Add Anthropic tool_use extraction and input_schema conversion - Add Google function_call extraction - Make ReAct/OpenHands parsing case-insensitive - Add telemetry efficiency, GPU monitor, and vLLM metrics modules - Add TOML-based eval suite config system - Update documentation and changelog Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-25 01:58:18 +00:00
Jon Saad-FalconandClaude Opus 4.6	bd49383201	Add evaluation framework and center README logo SVGs ... Evaluation framework (evals/): benchmarking system for measuring accuracy across four categories — Chat (WildChat), Reasoning (SuperGPQA), RAG (FRAMES), and Agentic (GAIA). Two backends: jarvis-direct (engine-level) and jarvis-agent (agent-level with tool calling), both supporting local and cloud models. Datasets adapted from IPW, scorers include exact match, LLM letter extraction, and LLM-as-judge. Parallel execution via ThreadPoolExecutor with incremental JSONL output. CLI: python -m evals {run,run-all,summarize,list}. 57 tests pass. SVG fix: center logo content within viewBox by wrapping icon+text in a translate(90,0) group, eliminating the left-shift visible in the README. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-22 23:48:43 +00:00