Docs present five different 'current' test counts, closed preview URLs as live, and contradictory data-policy statements #11

Open
opened 2026-10-01 22:50:39 +00:00 by KofTwentyTwo · 1 comment
KofTwentyTwo commented 2026-10-01 22:50:39 +00:00 (Migrated from github.com)

Summary

The documentation set disagrees with itself about the current state.

Topic Values found
"Current" Java test count 377 (CLIENT-INTEGRATION.md:5, SESSION-STATE.md:9), 386 (REQUIREMENT-EVIDENCE.md:5, OPERATOR-RUNBOOK.md:71, UI-REQUIREMENTS.md:61), 408 (TODO.md:17, README.md:7), 419 (TODO.md:77, ACCEPTANCE.md:5, SESSION-STATE.md:3); local surefire now 428
Browser checks 32, 59, 113 (TODO.md:17, ACCEPTANCE.md:62), 117 (ACCEPTANCE.md:5)
Preview URLs stated as current 50010, 51051, 54618, 57132, 63173, 63792, 64503; every port is closed (nc -z). TODO.md:60, OPERATOR-RUNBOOK.md:69, UI-REQUIREMENTS.md:81, ACCEPTANCE.md:64, DECISIONS.md:55, PLAN-money-presentation.md:19
Next UI version RC.7 in OPERATOR-RUNBOOK.md:44 and CLIENT-INTEGRATION.md:5; RC.8 elsewhere
Data policy "Development uses synthetic data only" (README.md:7, REQUIREMENT-EVIDENCE.md:52-53) versus real-data authorization (README.md:3, AGENTS.md:5, DECISIONS.md:5)
Decisions DECISIONS.md:19 D-09 "no production hosting, identity provider ... selected" versus CICD-GITOPS-REQUIREMENTS.md:23-25 (k8s-prod, galaxy.direct, Authentik confirmed); the decision table was never extended
PR #1 "draft PR1" (SESSION-STATE.md:218, TODO.md:49) versus merged
Branch scope SESSION-STATE.md:280 says feature/cicd-liquibase-gitops owns the CI/CD phase; its uncommitted work is the V60 source-account review feature

docs/SESSION-STATE.md is a 297-line append-only journal; its last lines (295-297) are a working note about another agent's foundation issue numbers and local tooling directories.

Suggested resolution

Keep one machine-readable status file (counts, versions, preview state) and generate or reference it from the prose; mark every superseded number as historical in place; delete working notes; record the CI/CD decisions in the decision table.

Priority rationale

P1: AGENTS.md tells every agent to read these files first; they cannot currently be trusted.


Filed from the 2026-10-01 real-versus-fake audit of Carl (branch feature/cicd-liquibase-gitops, HEAD 5414d7a, main 1b334d1). Four read-only reviews covered domain and services, QQQ metadata and data model, tests/CI/evidence, and docs/integrations. A local offline build of a Carl copy against the installed foundation 0.5.0-SNAPSHOT is in progress; its result will be added as a comment. Existing issues #3, #4 and #5 (real Monarch accounts, Authentik with real data, CI/CD with Liquibase and ArgoCD) are referenced rather than duplicated.

## Summary The documentation set disagrees with itself about the current state. | Topic | Values found | | --- | --- | | "Current" Java test count | 377 (`CLIENT-INTEGRATION.md:5`, `SESSION-STATE.md:9`), 386 (`REQUIREMENT-EVIDENCE.md:5`, `OPERATOR-RUNBOOK.md:71`, `UI-REQUIREMENTS.md:61`), 408 (`TODO.md:17`, `README.md:7`), 419 (`TODO.md:77`, `ACCEPTANCE.md:5`, `SESSION-STATE.md:3`); local surefire now 428 | | Browser checks | 32, 59, 113 (`TODO.md:17`, `ACCEPTANCE.md:62`), 117 (`ACCEPTANCE.md:5`) | | Preview URLs stated as current | 50010, 51051, 54618, 57132, 63173, 63792, 64503; every port is closed (`nc -z`). `TODO.md:60`, `OPERATOR-RUNBOOK.md:69`, `UI-REQUIREMENTS.md:81`, `ACCEPTANCE.md:64`, `DECISIONS.md:55`, `PLAN-money-presentation.md:19` | | Next UI version | RC.7 in `OPERATOR-RUNBOOK.md:44` and `CLIENT-INTEGRATION.md:5`; RC.8 elsewhere | | Data policy | "Development uses synthetic data only" (`README.md:7`, `REQUIREMENT-EVIDENCE.md:52-53`) versus real-data authorization (`README.md:3`, `AGENTS.md:5`, `DECISIONS.md:5`) | | Decisions | `DECISIONS.md:19` D-09 "no production hosting, identity provider ... selected" versus `CICD-GITOPS-REQUIREMENTS.md:23-25` (k8s-prod, galaxy.direct, Authentik confirmed); the decision table was never extended | | PR #1 | "draft PR1" (`SESSION-STATE.md:218`, `TODO.md:49`) versus merged | | Branch scope | `SESSION-STATE.md:280` says `feature/cicd-liquibase-gitops` owns the CI/CD phase; its uncommitted work is the V60 source-account review feature | `docs/SESSION-STATE.md` is a 297-line append-only journal; its last lines (295-297) are a working note about another agent's foundation issue numbers and local tooling directories. ## Suggested resolution Keep one machine-readable status file (counts, versions, preview state) and generate or reference it from the prose; mark every superseded number as historical in place; delete working notes; record the CI/CD decisions in the decision table. ## Priority rationale P1: AGENTS.md tells every agent to read these files first; they cannot currently be trusted. --- Filed from the 2026-10-01 real-versus-fake audit of Carl (branch `feature/cicd-liquibase-gitops`, HEAD `5414d7a`, main `1b334d1`). Four read-only reviews covered domain and services, QQQ metadata and data model, tests/CI/evidence, and docs/integrations. A local offline build of a Carl copy against the installed foundation 0.5.0-SNAPSHOT is in progress; its result will be added as a comment. Existing issues #3, #4 and #5 (real Monarch accounts, Authentik with real data, CI/CD with Liquibase and ArgoCD) are referenced rather than duplicated.
KofTwentyTwo commented 2026-10-01 23:14:27 +00:00 (Migrated from github.com)

For the record, the current branch's suite is 428 tests (local mvn verify, 2026-10-01, zero failures), which is a sixth number beyond the five already in the docs. Whatever file becomes the single source of truth should carry that one.

For the record, the current branch's suite is 428 tests (local `mvn verify`, 2026-10-01, zero failures), which is a sixth number beyond the five already in the docs. Whatever file becomes the single source of truth should carry that one.
This repo is archived. You cannot comment on issues.
1 Participants
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: KofTwentyTwo/carl#11