dbbb051ebd
Build & push images / images (push) Successful in 4m22s
The wash stream is small; the entry camera photographs every car in exactly the view the classifier is trained on. The booth can now queue entry vehicle reads as pure training material — crop + the camera's class, no order, no operator, no category. - Core announces every vehicle read (deviceEvents.emitVehicleRead from snapshot.ts); the Car Wash module listens, samples entry reads in-process (sampleEntry: exactly one in N) and queues them (enqueueEntry). CARWASH_REVIEW_ENTRY_SAMPLE=N; 1 = every entry (storage and bandwidth are not the limit — user); 0/unset = off. Forwarded by compose. - Packages carry kind: "wash" | "entry". Collector: kind column, entry meta validated without the operator fields, review screen shows an entry sample as such, export has a kind column, operator agreement computed from wash items only. Setup line shows "1 in N entries sampled"; status carries entrySample. - komodo: park-2's four review lines enabled (collector URL by Netbird DNS name, booth-2, the shared per-booth secret, every entry sampled) — the collector is up on the overlay. - Tests on both sides. Wiki: vision-review-outbox (entry stream + the internet-feed assessment), log. Claude-Session: https://claude.ai/code/session_01FWncR69HgGPuei1dLrW3cU
117 lines
7.9 KiB
Markdown
117 lines
7.9 KiB
Markdown
---
|
||
title: Vision review outbox — harvesting the operator's category choice for a trusted reviewer
|
||
type: concept
|
||
status: booth side built 2026-09-06; collector pending
|
||
related: [venue-modules, opencv-anpr-service, threat-model, append-only-event-chain, network-isolation]
|
||
---
|
||
|
||
# Vision review outbox
|
||
|
||
**The idea (user, 2026-09-06).** The Car Wash desk asks the operator for the vehicle's category,
|
||
and the entry camera now proposes one ([[venue-modules]] §Vehicle category from vision). The
|
||
operator's choice is what we would love to train the body-type classifier on — but the
|
||
operator **cannot be fully trusted** (mistake or intent; the [[threat-model]]). So the booth
|
||
hands each decision to a **trusted party** who reviews the picture and the label remotely,
|
||
and *that* verdict is the training label — and, per operator, the honest-mistake / fraud rate.
|
||
The booths sit on a private zero-trust overlay (**Netbird**), so the hand-off can go to a very
|
||
locked-down collector without exposing anything to the open internet.
|
||
|
||
## Rules (all enforced in `apps/server/src/modules/carwash/review-outbox.ts`)
|
||
|
||
1. **Offline-first, never on the intake path.** Creating a wash order *queues* a package (fire
|
||
and forget — a failure is a log line); a background loop drains the queue when the overlay
|
||
is up. The wash never waits on the network.
|
||
2. **One-way.** The booth POSTs; nothing ever comes back into the booth's decisions. The signed
|
||
ledger ([[append-only-event-chain]]) stays the only record of what happened at the wash.
|
||
Reviewer verdicts stay central and reach the owner as a report per site.
|
||
3. **Nothing that names the site leaves the booth.**
|
||
- Only the vehicle **crop** (the detector's box + 8 % margin, ≤ 640 px) — no walls, no camera
|
||
OSD (date / camera name burned into the frame), no bystanders.
|
||
- The **plate is blurred inside the crop** on the booth, from the plate detector's own box.
|
||
- The booth is a **pseudonymous id** set at deploy (`CARWASH_REVIEW_BOOTH_ID`); the operator
|
||
is a **keyed hash** (`sha256(boothId:username)[:16]`). The mapping back to places and
|
||
people is the reviewer's, held off the collector. The dataset export drops even those.
|
||
- Boxes are stored as **fractions of the frame** on the vision read, so the crop is cut from
|
||
the stored (downscaled) snapshot copy.
|
||
4. **The network is not the auth.** A per-booth bearer token on top of the overlay; the booth
|
||
can do nothing at the collector but this one POST. Payloads are small (a crop ≈ 50–80 kB).
|
||
5. **Data minimisation.** Queued only when there is a vehicle box (no box = no sample); the
|
||
image is dropped from the row once delivered; a voided order is abandoned unsent; anything
|
||
older than 14 days is abandoned ("expired") rather than resurfacing a fortnight in a burst.
|
||
|
||
## The entry stream — the real accelerator (built 2026-09-07)
|
||
|
||
The wash stream is small; the **entry camera photographs every car**, in exactly the view the
|
||
classifier is trained on, with zero domain shift. So the booth can also queue **one in N entry
|
||
vehicle reads** as pure training material: the crop and the camera's class, *no* order, *no*
|
||
operator, *no* category — same crop-and-blur pipeline, same one-way path, same privacy
|
||
properties. `CARWASH_REVIEW_ENTRY_SAMPLE=N` (0/unset = off; needs the three upload settings).
|
||
Seam: the core announces every vehicle read (`deviceEvents.emitVehicleRead`, snapshot.ts, entry
|
||
and exit) and the Car Wash module decides — it samples entry reads in-process (`sampleEntry()`,
|
||
exactly one in N) and calls `enqueueEntry()`; the core never imports the module. Packages carry
|
||
`kind: "wash" | "entry"`; the collector stores the kind, the review screen shows an entry sample
|
||
as "entry stream — label the vehicle", the export carries a `kind` column, and **operator
|
||
agreement is computed from wash items only** (an entry sample has no operator decision).
|
||
|
||
An internet feed was considered the same day and kept OUT of the collector's ingest: licensed
|
||
sets only, in a separate folder with provenance, used as warm-up and weighted down, and never
|
||
the judge of accuracy — the evaluation set is gate crops only.
|
||
|
||
## The package
|
||
|
||
`multipart/form-data`: `meta` (JSON) + `image` (JPEG). Meta = `{ v, booth, item, order, at,
|
||
operator (hash), operatorCategory {id,name}, service, vision {class, confidence, categoryId},
|
||
downgraded, image {width, height, plateBlurred} }`. Headers: `Authorization: Bearer <token>`,
|
||
`X-Booth-Id`.
|
||
|
||
## Draining
|
||
|
||
Every `CARWASH_REVIEW_INTERVAL_SEC` (60): due items oldest-first, 20 per pass. `2xx` → sent
|
||
(image cleared). `400/404/413/415/422` → abandoned (the collector refused the package itself).
|
||
Anything else (auth not yet fixed, 429, 5xx, timeout, no route) → retry with backoff
|
||
`1 min · 2^attempts`, capped at 6 h. `GET /api/carwash/review/status` (site:read) and a line in
|
||
Setup → Car wash show queued / delivered / abandoned + the last error.
|
||
|
||
## Config
|
||
|
||
`CARWASH_REVIEW_URL`, `CARWASH_REVIEW_TOKEN`, `CARWASH_REVIEW_BOOTH_ID` — all three or the outbox
|
||
is off and **nothing is queued** (an unbounded queue nobody drains is worse than none). Set per
|
||
booth in the Komodo stack env; compose forwards them.
|
||
|
||
## The collector — skeleton built 2026-09-06 (`apps/collector`)
|
||
|
||
A deliberately small Fastify + SQLite service **in this monorepo** (so it imports the payload
|
||
contract and the class vocabulary from `@parking/shared` — the two ends cannot drift), delivered
|
||
to the reviewer's host by **its own Komodo stack** (`wash-collector` in `komodo/resources.toml`
|
||
→ `docker-compose.collector.yml` only; the booth stacks never see it and it never sees booth
|
||
services). Image `parking-collector:<branch>-<sha>` from the same workflow as the others.
|
||
Three surfaces, nothing else — it must not grow into a fleet console:
|
||
|
||
- **`POST /ingest`** — bearer token **per booth** (`COLLECTOR_BOOTH_TOKENS`, `boothId:token`
|
||
pairs; constant-time compare), `X-Booth-Id` must match the token's booth, multipart `meta` +
|
||
`image` (JPEG magic checked, 2 MB cap), `meta` validated field by field against the contract
|
||
above (unknown vision class, non-id item, wrong booth → 422), **idempotent on the item id**
|
||
(a retry after a lost 2xx → 200 `duplicate`). Stored: `crops/<booth>/<item>.jpg` on the
|
||
volume + one `items` row. The booth now also sends `operatorCategory.classes` (the classes
|
||
the chosen category covers at that site) so a reviewer's CLASS can be judged against the
|
||
operator's CATEGORY without the site's setup.
|
||
- **`/review`** (+ `/api/items`, `/api/items/:id/image`, `/api/items/:id/review`, `/api/stats`)
|
||
— the reviewer's screen, served by the process itself (no build, no framework): one pending
|
||
crop at a time, the operator's pick and the camera's pick beside it, one button (and one
|
||
key) per vocabulary class + *unusable* + *skip*. HTTP Basic, one login
|
||
(`COLLECTOR_REVIEWER_USER/PASS`), over the overlay. Stats: per booth received / pending /
|
||
reviewed; per operator (booth + hash) **agree / disagree / unusable** — disagree = the
|
||
reviewer's class is outside the operator's chosen category. That column is the honest-mistake
|
||
/ fraud rate.
|
||
- **`GET /export/labels.csv`** — reviewed, usable rows: item, booth, crop path, the reviewer's
|
||
label, the operator's category + classes, the camera's class + confidence, downgraded, at.
|
||
Crops are not packaged: the phase-B trainer runs **on the same host** (its GPU) and reads them
|
||
off the volume — `docker-compose.collector.yml` carries the `trainer` seam as a commented
|
||
`profiles: [train]` one-off job (next increment).
|
||
|
||
**Deploy notes.** Bind the published port to the host's **Netbird address** (`COLLECTOR_BIND`),
|
||
never `0.0.0.0` on a host with a public interface; Netbird policy: booths → this host:8090 and
|
||
nothing else. The host must be onboarded as a Komodo server like the booths. `TAG` is pinned
|
||
and promoted with the booths (one sha for all stacks) — fine while the collector stays small;
|
||
its own repo the day it needs its own cadence.
|