THE ACTUAL STACK

What makes the live loop work.

Field Assist is one Go application plus browser-native media and vision. Codex operates only through the WebMCP tools exposed by the authenticated support page.

Start a session

Go 1.27 + GoFastr v0.75.0

Released Go module for the HTTP application, server-rendered UI host, typed handlers, security middleware, rate limiting, JSON logs, and trusted plugin assets.

GoFastr WebMCP

Browser bridge for the twenty-five authenticated scene, conversation, room-context, phone-banner, guidance, operator-question, snapshot, case, and diagnostic tools that Codex discovers on the support page. The public tool catalog is generated from these same declarations without exposing invocation schemas.

Codex

The only agent driving the application. It inspects and guides through page-scoped WebMCP; there is no separate model API embedded in Field Assist.

WebRTC + MediaDevices + DataChannel

Peer-to-peer rear-camera video from the operator phone plus a latest-only scalar orientation bridge. Camera frames do not pass through the Go server.

WebSockets + ICE

GoFastr carries authenticated signaling, session state, annotations, and receipts. Public STUN is the default, with environment-configured TURN support.

OpenCV 5 + HTML Canvas

The support computer owns enhanced tracking and publishes bounded geometry. OpenCV ORB, RANSAC homography, and PnP run against its peer-video copy; Canvas provides the fast fallback.

ONNX Runtime Web + Depth Anything V2 Small

The support computer runs the pinned 1.29 browser runtime and compact monocular-depth models at low cadence to validate planes and seed relative camera pose. It does not claim metric depth or LiDAR.

DeviceOrientation + Canvas

The phone keeps a lightweight Canvas tracker and sends bounded orientation samples over the WebRTC data channel. The support console uses one responsive CSS Grid and container-query layout.

Donald Murillo Barcode

Server-side QR generation through barcode.donaldmurillo.com, backed by a visible one-time copy-link fallback.

VPS hosting + deployctl

A gated prebuilt Linux binary on private VPS infrastructure, with an HTTPS public origin, WebSocket proxying, health probes, and repeatable release verification.

Playwright

End-to-end coverage for WebRTC, WebMCP, responsive layout, camera recovery, tracking, and the deployed Codex-to-phone loop.