mirror of
https://github.com/TheRealOwenRees/chess-endgame-trainer.git
synced 2026-11-18 11:42:07 +00:00
ADR 0012 states the launch bar, the deferred error tracking/metrics/log shipping with a concrete revisit trigger for each, and the accepted risk of journald plus off-box backups. The verification page walks the #162 checklist against a local MIX_ENV=prod build with forced failures: Postgres stopped, missing tablebase, empty pool, expired tokens and exhausted guest budget. 14 rows pass, 6 fail; the eight regressions are filed in #171. The audit's X1 row is corrected: an unknown play code already returns the styled 404 page.
5.0 KiB
5.0 KiB
Error-state verification
The #162 checklist, walked on 2026-11-13 against a local production-like build. Failures are filed as #171; this page is linked from the audit.
Method
- Build:
MIX_ENV=prodmix phx.serveron127.0.0.1:4010, commit021e412plus this branch's documentation. - Database: a scratch
postgres:18.6on port 55432. Empty at first, then one confirmed user and one 8+ piece endgame (inserted directly, because the admin changeset rejects positions beyond seven pieces). - Configuration:
PRELAUNCH=false,MAILING_LIST_ENABLED=true,TABLEBASE_PATHpointing at a missing directory, dummy SES credentials. - Forced failures: Postgres stopped, missing tablebase directory, empty
puzzle pool, expired reset and confirmation tokens (backdated
users_tokens.inserted_at), stale and invalid mailing-list forms, guest budget exhausted, unknown public play code. - Observation:
curlfor controller-rendered pages, headless Chrome over the DevTools Protocol for LiveView-connected pages, andmix testfor the interactive states that need a click. Each row names its evidence. - Not forced: a real Lichess 429 (the cooldown and classifier paths were
exercised by the tests), a crash after connect, and the two admin-only import
leaks (code inspection and tests). The first run rejected the socket origin
because
PHX_HOSTdefaulted toexample.com; settingPHX_HOST=127.0.0.1fixed it. That was local configuration, not a product finding.
Results
| Checklist row | Result | Evidence |
|---|---|---|
| T1 cooldown | pass | LiveView test: mount with a cooldown shows "Tablebase cooling down"; Retry re-fetches and returns to play. |
| T2 429 | pass | LiveView test: classifier maps 429 to "Tablebase rate-limited"; HTML carries no 429, too_many_requests or upstream body. |
| T3 not covered | pass | Prod run: guest page with a 12-piece endgame shows "Position not covered… can't be graded", no not_covered in the DOM, Next puzzle or back available. |
| T4 generic | pass | LiveView test: classifier returns "Tablebase unavailable"; the reason is logged and never rendered. |
| T5/T6 load and reply failure | pass | T5 covered by the cooldown-at-mount test and Retry. T6 shares the blocked panel and reset/1 path; not separately forced. |
| T8 invalid FEN | fail | Existing test: the flash still contains the client message and the raw FEN. #171. |
| S1/S2/S3/S5 empty pools | pass | S1 prod: Medium picker shows the in-page empty state and Retry. S5 prod: guest shows "No endgames are available yet" and Retry. S2/S3 tests: exhausted state, Retry and Change difficulty. |
| S4 guest limit | pass | Prod run: five visits exhaust the budget; the wall shows the reset time, Sign up free and Log in. |
| A1 reset token | pass | Prod run: an expired token flashes "Reset password link is invalid or it has expired." on the log-in page, with Forgot your password available. |
| A2 confirmation token | fail | Prod run: an expired token flashes "User not found or token is invalid." and lands on registration, not log in. #171. |
| A3/A4 login | pass | Tests: invalid credentials use one message; the throttle reports the remaining minutes. |
| M1–M5 mailing list | pass | Prod run: invalid confirmation link, removed address, stale form, invalid email and an SES send failure each show their specific copy with the form reachable. |
| W1/W2 404 and 500 | pass | Prod run: styled 404 for an unknown path; with Postgres stopped, / returns the styled 500 with no exception or stacktrace. |
| W3 crash | fail | The server-error banner has no reload action; a repeating crash has no manual escape. Not separately forced; same banner as W4. #171. |
| W4 disconnect | pass | Observed "Something went wrong! Attempting to reconnect" while the socket was rejected, with automatic retries; the banner hides on reconnect. |
| W5 database down | pass | Prod run: /health returns 503 db:down; / returns the 500 page. Note the loop: the home link also needs the database, so it 500s too. |
| D1/D2 export | fail | Prod run: an export with the database stopped returns the 500 page (no export-specific copy); /users/profile/export/xml returns plain text "Unknown export format". #171. |
| H1 empty-database home | fail | Prod run: the fallback board renders, but "Try today's puzzle" points at the auth-gated /endgames. #171. |
| X1 unknown play code | pass | Prod run: /endgames/nope/play returns the styled 404 page. This corrects the audit's earlier claim that it 500ed. |
| X2/X3 admin leaks | fail | Code inspection and tests: both importer messages still interpolate inspect(reason). Not forced. #171. |
Tally
- 14 checklist rows pass, 6 fail (8 individual regressions, because D1/D2 and X2/X3 share a row).
- Every failure row is a state that was already listed as "improve" in the audit and was outside #163; no new regression came from the #163 changes.
- The regressions are filed together in #171 rather than fixed silently.