 Jon Saad-FalconandClaude Opus 4.6
|
cb83bff1c5
|
fix(rust): resolve all clippy warnings across workspace
Fix pre-existing clippy issues from rust-migration-v2 merge:
- Add #[allow(clippy::too_many_arguments)] where needed
- Add #[allow(dead_code)] for reserved struct fields
- Add #[allow(clippy::vec_init_then_push)] for prompt builders
- Add #[allow(clippy::approx_constant)] for test literals
- Add #[allow(clippy::redundant_closure, unused_variables)] crate-level
- Fix map_or → is_some_and, get().is_none() → !contains_key()
- Fix nested if → combined condition
- Fix statement with no effect → let _
- Fix RangeInclusive::contains usage
- Add #[pyo3(signature)] to fix deprecated trailing Option<T>
- Remove unused imports
cargo clippy --workspace --all-targets -- -D warnings now passes clean.
All 386 tests pass.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-03-07 22:27:45 +00:00 |
|
|
Jon Saad-FalconandClaude Opus 4.6
|
d89bbcce52
|
feat: upgrade eval pipeline with agentic runner, telemetry session, and savings meter
Add 9 capabilities to match IPW pipeline:
Eval Pipeline:
- AgenticRunner for multi-turn agent execution with per-turn trace decomposition
- QueryTrace/TurnTrace data model for agentic workload telemetry
- EventRecorder for thread-safe agent event collection
- TerminalBenchTaskEnv for Docker-based task execution
- Cost computation via engine/cloud.py PRICING table
- Rich export: JSONL, HF Arrow, summary JSON, artifacts manifest
- CLI: --agentic, --concurrency, --query-timeout flags
Telemetry:
- TelemetrySession with background-sampling ring buffer (Python fallback)
- Phase metrics: prefill/decode energy split at TTFT boundary
- ITL percentile tracking (p50/p90/p95/p99)
- FLOPs estimation and MFU computation
- EnergyMonitor.snapshot() method
Rust Performance Layer:
- Ring buffer with binary search O(log n) window queries
- Trapezoidal energy integration
- Phase metrics, ITL stats, FLOPs estimation in Rust
- PyO3 bindings for all new telemetry modules (50 Rust tests)
Savings Meter & Benchmarks:
- Use-case benchmark datasets (coding, email, research, knowledge, morning brief)
- Savings dashboard component with cost comparison visualization
- Cloud cost calculator and comparison server routes
- Use-case eval configs for multiple agent/engine combinations
Tests: 80 new tests (3779 total pass, 37 skipped, 0 failures)
Lint: ruff check src/ tests/ — all checks passed
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-03-06 04:22:55 +00:00 |
|