diff --git a/docs/HANDOFF-2026-05-14-multi-runner-shipped.md b/docs/HANDOFF-2026-05-14-multi-runner-shipped.md new file mode 100644 index 0000000..afd409b --- /dev/null +++ b/docs/HANDOFF-2026-05-14-multi-runner-shipped.md @@ -0,0 +1,124 @@ +# Handoff — 2026-05-14: multi-runner shipped, v0.2 ready + +**Session window:** 2026-05-13 afternoon (Grogu single runner setup) → 2026-05-14 (multi-runner expansion + first auto-Release) +**Branch:** `develop`, clean +**HEAD at write time:** `774e60a0` — `ci(actions): create GitHub Release directly in publish-tag job (#187)` +**Open PR count:** 2 (#185, #191 — both with shepherds running) +**Repo visibility:** PUBLIC + +--- + +## TL;DR + +- **3-runner self-hosted CI on Grogu is live** — `Grogu-jarvis`, `-2`, `-3`. Matrix parallelism observed (≥3 SPM jobs concurrent). Develop CI green in ~5 min vs. ~13 min single-runner. +- **Auto-Release flow proven** — `v0.1.0-dev.64` has a real GitHub Release object, created by the new `gh release create` step in `publish-tag`. No more manual `gh release create` needed. +- **Brainstorm → spec → plan → execute discipline established** via the Superpowers skills. Multi-runner work has a committed spec + plan under `docs/superpowers/{specs,plans}/`. Pattern to follow for v0.2 onward. +- **Memory test flake** surfaced: `MemoryWiringEndToEndTests.testMemoryEnqueueReceivesNonNilUserAndAssistantText` fails intermittently on PR branches but passes on develop. Hypothesis: race in `TurnTranscriptStore` actor under concurrent-runner load. Pre-existing; not from any 2026-05-13/14 code change. + +--- + +## What shipped today + +### v0.1 mop-up + first dev tag +- **PR #184** (squash `5fc2d3fa`) — Ollama model baseline reconciled to `qwen3.6:latest` (extractor) + `qwen2.5-coder:32b-instruct-q8_0` (agent fallback). Closes #58 (last v0.1 issue). +- **v0.1.0-dev.50** — first release tag of the project. Release object created manually (workflow couldn't trigger downstream). +- **v0.1.0-dev.64** — second release tag. Release object created **automatically** via the new inline `gh release create` step in `publish-tag`. + +### Self-hosted runner saga +- **PR #181** (`eef17252`) — Moved `swift-packages` matrix to `Grogu-jarvis`. DEVELOPER_DIR Xcode-select. Fork-PR gate. +- **PR #183** (`81ce64c3`) — Orphan-process reaper at job start (closes #182). +- **PR #189** (`4cdb3560`) — Reaper gets a `>=1h` age filter so sibling runners on Grogu don't kill each other. +- **PR #187** (`774e60a0`) — `publish-tag` step creates the Release object directly instead of relying on `release.yml` triggering on tag push (GITHUB_TOKEN can't trigger downstream workflows). +- **PR #190** (`a26f49fd`) — Multi-runner spec + plan committed to `docs/superpowers/`. +- **PR #185** — open, AgentCore #23+#24 fix. Currently has a Memory-flake CI failure under shepherd watch. +- **PR #191** — open, CLAUDE.md inventory update. Same Memory flake situation. + +### Grogu state +- 3 runners installed at `~/actions-runner-jarvis{,-2,-3}/`, each with `_work` symlinked to `/Volumes/HD-2/jarvis-runner-work{,-2,-3}/`. +- LaunchAgents managed by `~/Library/LaunchAgents/actions.runner.KofTwentyTwo-Jarvis.Grogu-jarvis{,-2,-3}.plist`. +- Keychain workflow: `~/Library/Keychains/jarvis-runner.keychain-db`, password in repo secret `JARVIS_RUNNER_KEYCHAIN_PASSWORD`. CI unlocks + makes default + prepends to search list. +- Side effect: `jarvis-runner.keychain-db` is your user's default keychain after CI runs. Undo command in CLAUDE.md. + +--- + +## Active background processes at handoff + +| Task ID | What | Expected exit | +|---|---|---| +| `bny76q2ad` | Final shepherd watching PR #185 + #191 | When both PRs are handled (merged or marked `ci-failed`), or 60-min timeout | + +**Log location:** `/tmp/final-shepherd.log` + +Reading the log will tell you what the shepherd did. If it marked both PRs `ci-failed` because of the Memory flake, see "Memory flake disposition" below. + +--- + +## Memory flake disposition (what to do when you pick up) + +`MemoryWiringEndToEndTests.testMemoryEnqueueReceivesNonNilUserAndAssistantText` fails with: +``` +XCTAssertEqual failed: ("0") is not equal to ("1") - enqueue was not called — BLOCKER-1 regression +XCTAssertEqual failed: ("nil") is not equal to ("Optional("hi")") - userText empty/nil — Plan 4's submit-time append did not propagate via TurnTranscriptStore +XCTAssertEqual failed: ("nil") is not equal to ("Optional("hello there")") - assistantText empty/nil — Plan 1's transcript subscriber did not propagate via TurnTranscriptStore +``` + +**Evidence it's a flake, not a regression:** +- PR #191 doesn't touch AgentCore at all (only `CLAUDE.md`) yet hits the same exact failure. +- Develop's latest CI (`25832341662`, on `774e60a0`) passed Memory in 45s. +- Both #185 and #191 are branched off slightly different develop SHAs — the test passes on the latest develop but fails on these branch HEADs after forward-merge. + +**Recommended next steps:** +1. Open a new issue: `bug,severity:medium,area:memory` — "MemoryWiringEndToEndTests intermittent failure under concurrent runner load". Describe the `TurnTranscriptStore` race hypothesis. +2. Either rerun the failed jobs (CI may pass on next attempt) OR merge both PRs as-is since branch protection has 0 required checks and the test passes reliably on develop. +3. Long-term: file the test as known-flaky in v0.2 milestone. + +--- + +## v0.2 Wave 1 (next session start) + +Tiny / doc-only / deterministic fixes — safe to land in a single session each: + +| Issue | What | Effort | Why first | +|---|---|---|---| +| **#19** | MemoryStore.swift stale Phase 7 hedge doc-comments | ~5 min | Pure docs, zero risk | +| **#45** | Bus 'JarvisBusWorld' docstring drift (20+ docstrings) | ~15 min | Pure docs, mechanical | +| **#46** | Stale webview bundle artifacts in `App/Resources/webview/assets/` (~50MB) | ~10 min | File deletes | +| **#37** | STTBackendSelector snake_case vs camelCase mismatch | ~15 min | Single rename | +| **#178** | Add OpenSSF Scorecard workflow | ~15 min | One new `.github/workflows/` file | +| **#47** | WebviewBridge.sendRaw NaN→null JSON guard | ~20 min | One-line bug fix | + +Each gets brainstorm → spec → plan via the Superpowers skills (specs/plans templates established in `docs/superpowers/`). Brief specs (a few paragraphs) — these are "issue body IS the design" cases. + +## v0.2 Wave 2 / Wave 3 — wait + +Larger items that need real diagnostic work or design decisions: +- #18 MemoryReplaySink error propagation — needs care +- #23 + #24 already in PR #185 (held) +- #44 HUD audioLevel consumer rewire — MED, design choice +- #43 sessionHistory dead-letter — overlaps M-7, defer +- #176 vitest 4.x major bump — needs eval +- #26 confirmation panel multi-monitor — needs real hardware +- Any M-0..M-7 issue — strategic, gets its own spec → plan + +--- + +## Key references + +- **Spec template:** `docs/superpowers/specs/2026-05-13-multi-runner-grogu-design.md` +- **Plan template:** `docs/superpowers/plans/2026-05-13-multi-runner-grogu.md` +- **Previous handoff:** `docs/HANDOFF-2026-05-13-v0.1-shipped.md` (now superseded for the multi-runner story but still describes v0.1 mop-up) +- **Roadmap:** `.planning/ROADMAP-2026-05-12.md` +- **Live state:** GitHub Issues + Milestones at https://github.com/KofTwentyTwo/Jarvis +- **CI workflow:** `.github/workflows/ci.yml` — has the age-filtered cleanup + inline release create +- **CLAUDE.md `Self-hosted CI runner (Grogu)`** section — operational reference for the 3-runner setup + +## What this handoff deliberately doesn't relitigate + +- The Memory flake's root cause — open a v0.2 bug and move on; develop's CI is reliably green so it's not blocking. +- Whether to merge PR #185 / PR #191 with a known-flaky failure — branch protection allows it; user judgment. +- Wave 2/3 v0.2 issues — they need design conversations; pick them up after Wave 1. +- M-0..M-7 — strategic, gets its own session. + +--- + +*Written 2026-05-14 at the natural session-end after multi-runner expansion shipped. Next session should start with `/clear`, read this doc, then read the latest `/tmp/final-shepherd.log` to see what the background shepherd did, then pick up Wave 1.* diff --git a/docs/superpowers/specs/2026-05-14-v0.2-wave-1-sequencing-design.md b/docs/superpowers/specs/2026-05-14-v0.2-wave-1-sequencing-design.md new file mode 100644 index 0000000..8057af1 --- /dev/null +++ b/docs/superpowers/specs/2026-05-14-v0.2-wave-1-sequencing-design.md @@ -0,0 +1,114 @@ +# v0.2 Wave 1 sequencing and execution — design + +**Status:** approved 2026-05-14 (autonomous execution authorized) +**Authors:** brainstorm with James + Claude (Opus 4.7) +**Scope:** Six tiny v0.2 issues (#19, #37, #45, #46, #47, #178) — sequenced into three PRs. + +## Goal + +Land all six Wave 1 issues against `develop` in three coherent PRs, in an order that minimises CI exposure to the known `MemoryWiringEndToEndTests` flake and keeps each PR's narrative reviewable as a single story. + +## Why three PRs, not six and not two + +Six individual PRs (the handoff's implicit default) maximises history granularity but burns 6× the SPM CI matrix and exposes us to the Memory flake on every branch. Two giant PRs maximise throughput but mix surfaces (build script + new workflow + bundle rebuild + Swift code) into a single review and a single revert unit. + +Three PRs grouped by surface area give us: + +- 3× CI runs instead of 6×. +- Each PR has one coherent narrative (docs ⋄ infra ⋄ code). +- Each PR can be reverted independently without untangling unrelated work. + +## Composition + +### PR 1 — "Doc drift cleanup" (`docs/v0.2-wave-1-doc-drift`) + +**Issues:** #19 (MemoryStore stale Phase-7 doc-comments) + #45 (Bus JarvisBusWorld drift across 20+ docstrings post `fb41c5f`). + +**Why grouped:** both are descriptive/textual changes to documentation that no longer matches the code. #45 already requires a `@jarvis/bus` bundle rebuild and a new grep-gate, so it warrants doc-class company rather than mixing with real code fixes. Both touch package-internal documentation only; no behavioural change. + +**Deliverables:** + +- `packages/Memory/Sources/Memory/MemoryStore.swift` — scrub "Plan 07-02 wires", "Plan 07-03 will replace", "future ops plan" hedges. Keep the 2026-05-11 comment at line 464–468 intact (it is correct). +- Bus comments renamed across `WebviewBridge.swift`, `Injection.js`, `webview/packages/bus/src/bridge.ts`, `webview/packages/hud/src/main.tsx`, `App/AppDelegate.swift` — replace "JarvisBusWorld" / "WKContentWorld('JarvisBusWorld')" / cross-world-attach language with "page world" / "shared world" / "defensive double-install guard". +- `bridge.ts:60–99` rationale rewritten — the duck-type `isJarvisBusShape` guard is now defensive against double-install (both `Injection.js`'s stub and the bundle's `installJarvisBus` running in the same page world), not cross-world attach. Comment must say this without misleading; do **not** delete the guard itself. +- Bundle rebuilt: `webview/packages/bus/dist/bridge.{js,d.ts}` regenerated via `pnpm --filter @jarvis/bus build` (or equivalent). +- `@jarvis/bus` `package.json` patch-version bumped to reflect comment changes in dist (matches existing project convention of patch-bumping when the published comments shift). +- New grep-gate: `scripts/check-no-jarvis-bus-world-references.sh` — fails if any tracked file outside `.planning/`, `docs/`, or git-history references contains the literal `JarvisBusWorld`. Wired into the boundary-gates list in CI and in `CLAUDE.md`. + +**Closes:** #19, #45. + +### PR 2 — "Build hygiene" (`ci/v0.2-wave-1-build-hygiene`) + +**Issues:** #46 (stale webview bundle artifacts) + #178 (OpenSSF Scorecard workflow). + +**Why grouped:** both touch repo-level infrastructure (`scripts/` and `.github/workflows/`) and neither touches Swift packages, so the heavy SPM matrix runs but with low chance of new test failures. Quick CI; safe to land first. + +**Deliverables:** + +- `scripts/build-webview.sh` — before the existing `rsync -a ... dist/ -> App/Resources/webview/` at line 88, add an explicit cleanup of `App/Resources/webview/assets/*.js`, `*.js.map`, `*.css` (preserving `bus-harness.html`, the directory's `.gitignore`, and any other already-excluded files). Easiest mechanism: pass `--delete-excluded` plus an `--exclude` for each preserve target, or `rm -f` the asset glob before rsync. Either works; preference is `rm -f` of the explicit asset glob because it's grep-able. +- `App/Resources/webview/assets/` — delete the 10 stale `index-*.js` files and their `.map` siblings in the same commit so the directory is clean post-merge. +- `.github/workflows/scorecard.yml` — new file. Trigger `schedule: cron: "0 6 * * 1"` (weekly Mondays) + `push: branches: [develop]` + `workflow_dispatch`. Permissions: `id-token: write`, `contents: read`, `security-events: write`. Uses `ossf/scorecard-action@v2.4.0` (or latest at execution time). Upload SARIF to GitHub code-scanning. +- `README.md` — add OpenSSF Scorecard badge near the top (under the title or alongside existing badges). Badge URL pattern is the standard `https://api.scorecard.dev/projects/github.com/KofTwentyTwo/Jarvis/badge`. + +**Closes:** #46, #178. + +### PR 3 — "Small code fixes" (`fix/v0.2-wave-1-code-fixes`) + +**Issues:** #37 (STTBackendSelector snake_case vs call-site camelCase) + #47 (WebviewBridge NaN→null JSON guard for `audioLevel`). + +**Why grouped:** both are genuine one-shot code fixes with a unit test each, in different packages (Voice/App + Bus). Landing them together gives one Swift-package-test cycle for both fixes. + +**Deliverables for #37:** + +- Decision: standardise on **camelCase** at call sites (matches existing identifier style elsewhere in the codebase). Update the constants in `STTBackendSelector` to camelCase string values, OR delete the unused constants in favour of an enum if call sites can adopt cheaply. Master agent picks the smaller diff after a quick read. +- Single rename or constant-shape change; ensure `App/AppDelegate.swift:2028` (and any other call sites a grep reveals) is consistent. +- Existing tests must still pass; if none cover the constant identity, add a small one in `packages/Voice/Tests/` asserting the chosen shape. + +**Deliverables for #47:** + +- First verify #47 is still latent or has become active post-#42: grep for the audioLevel consumer in `webview/packages/hud/` and check whether real decode errors are firing in any logged scenario. Either way, ship the clamp. +- `packages/Bus/Sources/Bus/WebviewBridge.swift` — in `sendRaw` (or the `BusOutbound.audioLevel.encode` path, whichever is the cleanest place), replace non-finite `rms` floats with `0.0` before encoding. Inline fix only; do not refactor `AudioLevelEmitter` simultaneously (separate concern). +- New unit test: `BusOutboundEncodingTests` (or extend the nearest existing suite) asserts `BusOutbound.audioLevel(rms: .nan)` decodes JS-side with `rms == 0.0`. Use the existing harness convention (`Mock*` only if recording, `Stub*` for canned data, `Fake*` for stateful) per CLAUDE.md. + +**Closes:** #37, #47. + +## Landing order + +1. **PR 2 first** — lowest blast radius, lightest CI footprint, validates the multi-runner pipeline on something we can revert in seconds if it breaks. +2. **PR 1 second** — purely descriptive, no behavioural change. CI surface is large (Bus + Memory packages, full webview build), but new tests should not fail because no logic moves. +3. **PR 3 last** — real code touches. By the time we get here, the Memory flake is the only plausible failure mode, so if a job goes red we know it is the flake. + +## Memory-flake disposition + +Per `docs/HANDOFF-2026-05-14-multi-runner-shipped.md`: `MemoryWiringEndToEndTests` flakes intermittently on PR branches under concurrent-runner load. Branch protection has zero required checks, so flake-induced red is not blocking. + +Master agent policy: + +1. If a PR's CI fails on Memory only, rerun the failed jobs once. +2. If they pass on rerun, merge. +3. If they fail a second time, leave the PR open with the Memory failure visible and open `bug,severity:medium,area:memory` issue documenting the test as known-flaky in v0.2. Do not merge without user sign-off. +4. If any *non-Memory* check fails, stop and report back — do not rerun, do not merge. + +## Non-goals + +- Do not touch PRs #185, #191, #192. They are tracked in a separate disposition. +- Do not open or address Wave 2/3 issues (#18, #23/#24, #43, #44, #176, #26, M-series epics). +- Do not refactor `AudioLevelEmitter` while fixing #47. +- Do not change branch protection settings. +- Do not bypass pre-commit hooks (`--no-verify`). +- Do not force-push. +- Do not rebase #185/#191/#192 onto the new tip of develop. + +## Success criteria + +- Issues #19, #37, #45, #46, #47, #178 all closed via merge. +- `develop` HEAD's CI is green after all three merges. +- `App/Resources/webview/assets/` contains only the active bundle (one `index-*.js` + `.map` + `.css`) after PR 2 merges. +- OpenSSF Scorecard workflow appears in Actions → Workflows and has at least one successful run (or a clearly-named permission failure to address in a follow-up). +- Grep for `JarvisBusWorld` outside `.planning/`, `docs/`, and committed history returns nothing. +- `swift test --package-path packages/Bus` passes including the new NaN-clamp test. +- No new test doubles violate the `Mock*`/`Stub*`/`Fake*` convention. + +## Effort budget + +~90 min of coding across the three PRs, plus CI wait time. Master agent should target completion in 90 min wall clock; if it falls behind, it must report partial progress rather than rush.