will/flynn
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

chore(audit): dedupe rolling cadence script wiring

Browse Source
This commit is contained in:
William Valentin
2026-02-27 11:35:26 -08:00
parent c2c9b2af66
commit 0c7d2b9190
23 changed files with 2260 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/plans/state.json
+33 -1
View File
@@ -385,6 +385,38 @@
],
"test_status": "pnpm audit:phase0-baseline:live:refresh:drift:rolling:prune + pnpm audit:phase0-baseline:live:prune + pnpm test:run src/audit/phase0BaselineArtifactRetention.test.ts + pnpm typecheck passing"
},
"phase0-live-baseline-rolling-script-dedup": {
"status": "completed",
"date": "2026-02-27",
"updated": "2026-02-27",
"summary": "Deduplicated rolling cadence script wiring by making `audit:phase0-baseline:live:refresh:drift:rolling` accept external `TAG` and updating `...rolling:prune` to reuse that pipeline with a shared tag before apply-prune, reducing script drift risk while preserving tagged artifact consistency. Validated with a fresh rolling artifact set (`2026-02-27-193429`).",
"files_modified": [
"package.json",
"README.md",
"docs/api/PROTOCOL.md",
"docs/architecture/AGENT_DIAGRAM.md",
"docs/architecture/GATEWAY_SESSIONS_AND_QUEUE.md",
"docs/plans/2026-02-25-phase0-instrumentation-ticket-checklist.md",
"docs/plans/artifacts/phase0_baseline_live_2026-02-27-193429.jsonl",
"docs/plans/artifacts/phase0_baseline_live_2026-02-27-193429.md",
"docs/plans/artifacts/phase0_baseline_live_2026-02-27-193429.json",
"docs/plans/artifacts/phase0_baseline_live_gateway_2026-02-27-193429.jsonl",
"docs/plans/artifacts/phase0_baseline_live_gateway_2026-02-27-193429.md",
"docs/plans/artifacts/phase0_baseline_live_gateway_2026-02-27-193429.json",
"docs/plans/artifacts/phase0_baseline_live_backend_pi_embedded_2026-02-27-193429.jsonl",
"docs/plans/artifacts/phase0_baseline_live_backend_pi_embedded_2026-02-27-193429.md",
"docs/plans/artifacts/phase0_baseline_live_backend_pi_embedded_2026-02-27-193429.json",
"docs/plans/artifacts/phase0_baseline_live_backend_native_2026-02-27-193429.jsonl",
"docs/plans/artifacts/phase0_baseline_live_backend_native_2026-02-27-193429.md",
"docs/plans/artifacts/phase0_baseline_live_backend_native_2026-02-27-193429.json",
"docs/plans/artifacts/phase0_baseline_live_backend_drift_2026-02-27-193429.md",
"docs/plans/artifacts/phase0_baseline_live_backend_drift_2026-02-27-193429.json",
"docs/plans/artifacts/phase0_baseline_live_prune_2026-02-27-193429.md",
"docs/plans/artifacts/phase0_baseline_live_prune_2026-02-27-193429.json",
"docs/plans/state.json"
],
"test_status": "pnpm audit:phase0-baseline:live:refresh:drift:rolling:prune + pnpm audit:phase0-baseline:live:prune + pnpm test:run src/audit/phase0BaselineArtifactRetention.test.ts + pnpm typecheck passing"
},
"phase0-instrumentation-ticket-checklist": {
"status": "completed",
"date": "2026-02-25",
@@ -7570,7 +7602,7 @@
"deeper_surfaces_phase0_ticket_02": "completed — gateway + daemon routing emit run lifecycle/cancel telemetry and reaction match/skip audit events with filter summaries and cancellation latency, plus focused tests",
"deeper_surfaces_phase0_ticket_03": "completed — gateway metrics now track run-state outcomes, cancel latency samples, and reaction decision counters with routing/gateway emitters",
"deeper_surfaces_phase0_ticket_04": "completed — added phase-0 baseline summary tooling for run outcomes, cancel latency, and reaction decisions with markdown/json CLI output",
"deeper_surfaces_phase0_ticket_05": "completed — documented phase-0 telemetry fields/workflow, refreshed architecture/protocol docs, generated anonymized live baseline artifacts for channel/gateway/backend-scoped (pi/native) windows, added backend freshness/drift gates with persisted drift reports, added rolling timestamp-tag cadence runs for immediate baseline-vs-prior drift comparisons, added rolling artifact retention tooling (`live:prune` with prune reports retained as a managed family), and added one-command cadence refresh+drift+retention apply (`live:refresh:drift:rolling:prune`)",
"deeper_surfaces_phase0_ticket_05": "completed — documented phase-0 telemetry fields/workflow, refreshed architecture/protocol docs, generated anonymized live baseline artifacts for channel/gateway/backend-scoped (pi/native) windows, added backend freshness/drift gates with persisted drift reports, added rolling timestamp-tag cadence runs for immediate baseline-vs-prior drift comparisons, added rolling artifact retention tooling (`live:prune` with prune reports retained as a managed family), added one-command cadence refresh+drift+retention apply (`live:refresh:drift:rolling:prune`), and deduplicated rolling script wiring through shared `TAG` reuse",
"next_up": "Run scheduled `pnpm audit:phase0-baseline:live:refresh:drift:rolling:prune` in each active environment for at least one full cadence cycle (tuning `KEEP_PER_FAMILY` as needed), then tighten drift thresholds based on observed variance before additional run-control/reaction semantic changes.",
"pi_embedded_canary_spike": "completed — added optional pi_embedded backend adapter, canary-safe no-tools routing guard, backend success/fallback latency audit events, and docs/diagram updates while native remains default",
"pi_embedded_evaluation_phase": "completed — final decision rollback (applied in runtime config): Window A failed latency/fallback gates (p50 +259ms, p95 +5695ms, fallback 25%, categories: pi_module_interface/empty_assistant_text); Window B remained sample-insufficient; controlled probes verified guard coverage (pi_no_tools_mode/capability_query/attachments_present each hit once)",