Evidence · Conformance
The conformance scoreboard
Every reason code a registered evaluator can emit, checked against the committed golden fixture suite — generated at build time from src/lib/extensions/registry.ts and golden.json, not hand-typed. A new reason code without fixture coverage (and without a documented synthetic-only exception) shows up red here automatically.
Machine-readable: /evidence/conformance.json · ← back to Evidence
43Reason codes trackedAcross RAOS-0001, 0002, 0005, 0007, 0008
38CoveredFixture-reachable or a documented synthetic exception
5UncoveredWould fail this scoreboard
23Directly fixture-covered15 more via a dedicated unit test
What this page proves — and doesn't
This scoreboard covers built specs only: RAOS-0000, 0001, 0002, 0005, 0007, 0008, and 0013 pt 1 (Decision Trace). Planned specs (0003, 0004, 0006, 0009–0012, 0013 pt 2, 0014+) emit no reason codes yet and are never shown as covered here — see /specsfor status. RAOS-0000 (foundations) and RAOS-0013 pt 1 (decision trace) emit no reason codes of their own, so they don't appear in the reason-code table below — they do appear in the archetype grid.
Reason code inventory × fixture coverage
Generated from every registered evaluator's reasonCodesdeclaration (plus RAOS-0008's centrally-attached trust codes), checked against golden.json.
RAOS-0001 · Eligibility & Visibility Semantics5/6 covered
| Reason code | Source | Status | Note |
|---|---|---|---|
| HIDDEN_PRODUCT | visibility, eligibility | ✅ covered | Appears in at least one golden fixture entry. |
| REGION_POLICY_UNDECLARED | eligibility (buildManifest — manifest-build time, not a registered evaluator) | ✅ covered | Synthetic-only — src/lib/projections/__tests__/projections.test.ts. Emitted by buildManifest() at manifest-build time when MerchantProfile.servesRegions is undefined — a state the required TS field prevents for typed profiles; only reachable via JS/JSON-constructed profiles. golden.test.ts never calls buildManifest, so this can never appear in the fixture grid. |
| REGION_RESTRICTED | visibility, eligibility | 🔴 uncovered | No fixture coverage and no documented exception. |
| RESALE_CERTIFICATE_REQUIRED | eligibility | ✅ covered | Appears in at least one golden fixture entry. |
| TIER_RESTRICTION | eligibility | ✅ covered | Appears in at least one golden fixture entry. |
| WHOLESALE_ONLY | eligibility | ✅ covered | Appears in at least one golden fixture entry. |
RAOS-0002 · Contextual Pricing (Member + Bulk)7/7 covered
| Reason code | Source | Status | Note |
|---|---|---|---|
| BELOW_MOQ | pricing | ✅ covered | Appears in at least one golden fixture entry. |
| BULK_TIER_APPLIED | pricing | ✅ covered | Appears in at least one golden fixture entry. |
| CALL_FOR_PRICE | pricing | ✅ covered | Appears in at least one golden fixture entry. |
| MEMBER_PRICE_APPLIED | pricing | ✅ covered | Appears in at least one golden fixture entry. |
| PURCHASE_LIMIT_EXCEEDED | pricing | ✅ covered | Appears in at least one golden fixture entry. |
| QUANTITY_INCREMENT_MISMATCH | pricing | ✅ covered | Appears in at least one golden fixture entry. |
| TEASER_LOCKED | pricing | ✅ covered | Appears in at least one golden fixture entry. |
RAOS-0003 · Fulfillment Feasibility6/10 covered
| Reason code | Source | Status | Note |
|---|---|---|---|
| CUTOFF_PASSED | fulfillment_constraints | ✅ covered | Appears in at least one golden fixture entry. |
| FULFILLMENT_MODE_UNAVAILABLE | fulfillment_constraints | ✅ covered | Appears in at least one golden fixture entry. |
| HAZMAT_RESTRICTION | fulfillment_constraints | ✅ covered | Appears in at least one golden fixture entry. |
| INSUFFICIENT_TIME_BEFORE_CLOSE | fulfillment_constraints | 🔴 uncovered | No fixture coverage and no documented exception. |
| LEAD_TIME_EXCEEDS_NEED_BY | fulfillment_constraints | ✅ covered | Synthetic-only — src/lib/rules/__tests__/fulfillment.test.ts. Requires an asserted BuyerContext.needByDate — the static golden CONTEXT_GRID has none, so this can never appear in the fixture grid. |
| ORDER_ACCEPTANCE_ENDED | fulfillment_constraints | 🔴 uncovered | No fixture coverage and no documented exception. |
| OVERSIZE_RESTRICTION | fulfillment_constraints | ✅ covered | Appears in at least one golden fixture entry. |
| PREPARATION_EXCEEDS_NEED_BY | fulfillment_constraints | 🔴 uncovered | No fixture coverage and no documented exception. |
| REGION_NOT_SERVED | fulfillment_constraints | ✅ covered | Appears in at least one golden fixture entry. |
| STORE_CLOSED | fulfillment_constraints | 🔴 uncovered | No fixture coverage and no documented exception. |
RAOS-0005 · Inventory & Availability7/7 covered
| Reason code | Source | Status | Note |
|---|---|---|---|
| BACKORDER_AVAILABLE | inventory | ✅ covered | Appears in at least one golden fixture entry. |
| LOCATION_OUT_OF_STOCK | inventory | ✅ covered | Appears in at least one golden fixture entry. |
| LOW_STOCK | inventory | ✅ covered | Appears in at least one golden fixture entry. |
| OUT_OF_STOCK | inventory | ✅ covered | Appears in at least one golden fixture entry. |
| PREORDER_NOT_YET_BUYABLE | inventory | ✅ covered | Appears in at least one golden fixture entry. |
| RESERVATION_EXPIRED | inventory | ✅ covered | Synthetic-only — src/lib/rules/__tests__/inventory.test.ts. Requires an injected expired InventoryHold via setInventoryHolds() — not reachable from the static catalog fixture grid. |
| STOCK_STALE | inventory | ✅ covered | Appears in at least one golden fixture entry. |
RAOS-0007 · Quote Integrity & Price Lock7/7 covered
| Reason code | Source | Status | Note |
|---|---|---|---|
| QUOTE_CONTEXT_CHANGED | quote | ✅ covered | Synthetic-only — src/lib/rules/__tests__/quote.test.ts. Requires re-validating a quote against a changed BuyerContext — not produced by the fixture grid. |
| QUOTE_EXPIRED | quote | ✅ covered | Synthetic-only — src/lib/rules/__tests__/quote.test.ts. Requires issueQuote + validateQuote with an injected expired `now` — not produced by the fixture grid. |
| QUOTE_FORGED | quote | ✅ covered | Synthetic-only — src/lib/rules/__tests__/quote.test.ts. Requires an injected mismatched/forged quote payload — not produced by the fixture grid. |
| QUOTE_HONORED_GRACE | quote | ✅ covered | Synthetic-only — src/lib/rules/__tests__/quote.test.ts. Requires validating a quote inside its honor-grace window after nominal expiry — not produced by the fixture grid. |
| QUOTE_ISSUED | quote | ✅ covered | Synthetic-only — src/lib/rules/__tests__/quote.test.ts. Golden fixtures call rule functions directly and never invoke evaluateOffer/the QUOTE stage. |
| QUOTE_PARTIALLY_HONORED | quote | ✅ covered | Synthetic-only — src/lib/rules/__tests__/quote.test.ts. Requires a partial-honor HonorPolicy (Grocery C) exercised at validate time — not produced by the fixture grid. |
| QUOTE_STOCK_LOST | quote | ✅ covered | Synthetic-only — src/lib/rules/__tests__/quote.test.ts. Requires stock to change between quote issuance and validation — not produced by the fixture grid. |
RAOS-0008 · Trust, Provenance & Freshness6/6 covered
| Reason code | Source | Status | Note |
|---|---|---|---|
| CLOCK_SKEW_SUSPECTED | trust | ✅ covered | Synthetic-only — src/lib/rules/__tests__/trust.test.ts. Requires computedAt > now + tolerance. |
| DATA_STALE | trust | ✅ covered | Synthetic-only — src/lib/rules/__tests__/trust.test.ts. Requires a `now` past (computedAt + ttlSeconds*1000) for the outer trust envelope — the golden grid’s GOLDEN_NOW/TTL combination never crosses that boundary. |
| ISSUER_UNKNOWN | trust | ✅ covered | Synthetic-only — src/lib/rules/__tests__/trust.test.ts. Requires a keyId not present in the merchant manifest's keys[]. |
| KEY_EXPIRED | trust | ✅ covered | Synthetic-only — src/lib/rules/__tests__/trust.test.ts. Requires a signing key with validTo < now. |
| SIGNATURE_INVALID | trust | ✅ covered | Synthetic-only — src/lib/rules/__tests__/trust.test.ts. Requires injecting a mismatched payload into verifyEnvelope. |
| TRUST_SIMULATED | trust | ✅ covered | Appears in at least one golden fixture entry. |
Archetype × spec coverage
Generated from each mock merchant's published manifest (mockMerchants[].manifest.capabilities[]) — the same data served at /.well-known/ucp. A cell is derived, not asserted; cells with no capability toggle to check are marked "not derived".
| Merchant | Headline tier | RAOS-0000 | RAOS-0001 | RAOS-0002 | RAOS-0003 | RAOS-0005 | RAOS-0007 | RAOS-0008 | RAOS-0013pt1 |
|---|---|---|---|---|---|---|---|---|---|
| Boutique A | 2 | ✅ | ✅ 2 ns | ✅ 2 ns | ✅ 1 ns | ✅ 1 ns | — | ✅ 1 ns | not derived |
| Wholesale B | 2 | ✅ | ✅ 2 ns | ✅ 3 ns | ✅ 1 ns | ✅ 1 ns | ✅ 1 ns | ✅ 1 ns | not derived |
| Grocery Retail C | 3 | ✅ | ✅ 2 ns | ✅ 4 ns | ✅ 1 ns | ✅ 1 ns | ✅ 1 ns | ✅ 1 ns | not derived |
Generated at build time from: src/lib/extensions/registry.ts (byStage() -> evaluator.reasonCodes); src/lib/rules/trust.ts (TRUST_REASON_CODES, centrally attached); src/lib/rules/__tests__/__fixtures__/golden.json; src/lib/mock/merchants.ts (mockMerchants[].manifest.capabilities[].namespace). Golden fixtures last generated 2026-06-09T00:00:00.000Z.