KofTwentyTwo/Jarvis
2
0 Fork 0
Code Issues 111 Pull Requests 16 Actions Packages Projects Releases 4 Wiki Activity

v1.2: Vision T2 sidecar (vLLM/MLX) activation #84

New Issue
Open
opened 2026-05-12 19:31:00 +00:00 by KofTwentyTwo · 0 comments
KofTwentyTwo commented 2026-05-12 19:31:00 +00:00 (Migrated from github.com)
Copy link
Copy source

Summary

Activate the Vision T2 escalation path with a real provider (vLLM or MLX-based sidecar). Today `MissingT2Provider` is wired into AppDelegate as the T2 provider; #1 covers the orchestrator's mis-gating bug. Once that closes, T2 stays effectively unreachable until a real provider lands.

Includes: model selection, sidecar process management (`ChildSpawnGate` already exists), T2 escalation policy reactivated end-to-end.

Evidence

  • Migration plan §10 v1.2: `.planning/architecture/JARVIS-API-MIGRATION-PLAN.md:742`.
  • INVENTORY.md: `VllmMlxProvider`, `VllmMlxSidecar.`, `VllmMlxAvailability.` all MAPPED + DEFERRED internally.
  • API design v0.1:733-734 lists `VllmMlxProvider` + `MissingT2Provider` as DEFERRED internal.

Gap classification

"design-mapped but not built" — surface mapped in v1.0 contract; activation v1.2.

Recommended action

File against v1.2 milestone. Block on #1 (orchestrator t2Available mis-gating). When activated, the existing `VisionRouter` post-response T2 heuristic + `VisionEscalationHeuristic` (currently DEAD per INVENTORY) light up.

Cross-references

  • Related: #1 (T2 escalation always dies)
  • Migration plan §10 v1.2
## Summary Activate the Vision T2 escalation path with a real provider (vLLM or MLX-based sidecar). Today \`MissingT2Provider\` is wired into AppDelegate as the T2 provider; #1 covers the orchestrator's mis-gating bug. Once that closes, T2 stays effectively unreachable until a real provider lands. Includes: model selection, sidecar process management (\`ChildSpawnGate\` already exists), T2 escalation policy reactivated end-to-end. ## Evidence - Migration plan §10 v1.2: \`.planning/architecture/JARVIS-API-MIGRATION-PLAN.md:742\`. - INVENTORY.md: \`VllmMlxProvider\`, \`VllmMlxSidecar.*\`, \`VllmMlxAvailability.*\` all MAPPED + DEFERRED internally. - API design v0.1:733-734 lists \`VllmMlxProvider\` + \`MissingT2Provider\` as DEFERRED internal. ## Gap classification \"design-mapped but not built\" — surface mapped in v1.0 contract; activation v1.2. ## Recommended action File against v1.2 milestone. Block on #1 (orchestrator t2Available mis-gating). When activated, the existing \`VisionRouter\` post-response T2 heuristic + \`VisionEscalationHeuristic\` (currently DEAD per INVENTORY) light up. ## Cross-references - Related: #1 (T2 escalation always dies) - Migration plan §10 v1.2
Sign in to join this conversation.
No Branch/Tag Specified
Labels
Clear labels
area:agent
area:build
area:bus
area:devtool
area:hud
area:logging
area:mcp
area:memory
area:vision
area:voice
audit-finding
bug
Something isn't working
 carry-forward
comment-cleanup
Comment / docstring cleanup per .planning/code-commenting-guide.md
 dependencies
Dependency updates
 documentation
Improvements or additions to documentation
 duplicate
This issue or pull request already exists
 enhancement
New feature or request
 epic
good first issue
Good for newcomers
 help wanted
Extra attention is needed
 invalid
This doesn't seem right
 javascript
Pull requests that update javascript code
 migration
question
Further information is requested
 severity:critical
severity:high
severity:low
severity:medium
wontfix
This will not be worked on
No labels area:vision carry-forward enhancement severity:low
Milestone
No items
No Milestone v1.1 — Backlog (Orpheus, WhisperKit, Voice Log, presence, advanced)
Projects
Clear projects
No projects
Assignees
Clear assignees
forge-recovery (Forge Recovery) james.maes (James Maes)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: KofTwentyTwo/Jarvis#84