gitoriaLog in with ident

tickets

All repositories: gitoria

ReadmeCodePull requestsReleasesTicketsSettings
Commitf12fa1bcf12fa1bcState of 2026-09-27, before the move to gitoriamref12fa1bc/STATUS.md

39.5 KB

  1. ## 2026-09-26 — ticket #23: connect protocol documented for app workers
  2. New `docs/connect-apps.md` (steps, exchange, key headers, create-ticket / comment / state calls); linked from the README. No code change.
  3. # STATUS
  4. ## 2026-09-26 — ticket #21: connect an app to a project (gitoria's tickets) — NOT deployed
  5. Done: `connections.hl` + `components/connect.hl` + routes (`/connect`, `/connect/:nonce`, `/api/connect/exchange`, `…/connections`, `…/connections/remove`), the
  6. connections line + Disconnect on the project page, per-project key `tktc_…` (create / comment / state only, roles of the NAMED person via
  7. `X-Tickets-Identity`). README section "Connecting an app to a project". `node tests/connect.mjs` → 60 passed, 0 failed. NOT run: the old gate
  8. `tests/browser.mjs` / `short-id-switch.mjs` (they need a copy of ident's code, `ident.worldapi.org` is not on this machine); the only shared-code
  9. change is `apiAuth` in `project.hl` (token users behave as before — checked in the new gate). Gitoria's side (button "Connect tickets", storing the key,
  10. sending the events) is gitoria's ticket. On Byrodin set `TICKETS_CONNECT_ORIGINS` only if a non-worldapi.org app must connect.
  11. ## 2026-09-26 — ticket #22: every event in the API carries `userId` — NOT deployed
  12. `store.hl eventRowOf` adds `userId` (the users @id of the author; `''` for events from before the login). `author` (display name) unchanged. Checked with a real write on a fresh store (`.scratch/m22/t.hl`: user, project, ticket, comment): both events show `userId` = the author's users @id. Not covered by the gate.
  13. ## 2026-09-26 — ticket #20: projects as own data, members, roles, new states — NOT deployed (architect: together with the scheduler update)
  14. Took over the unfinished worker session s-20260926T1044-278e20 (store/projects/members/settings/invites/inbox code was written, the gate not run).
  15. Fixed: the migration's replaced records left tombstones and the page realm's second open compacted the files under the first handle (every slug
  16. lookup 404'd after the first page render) → `migrate.hl` compacts the changed tables. Gate: `tests/browser.mjs` → 233 passed, 0 failed (roles,
  17. states + aliases, inbox, project create / settings / slug change / members / invite accepted through ident, layouts of the new pages);
  18. `tests/short-id-switch.mjs` (ports 8706/8707) → 19 passed, ported to the roles. The migration was also run on a copy of the dev store (5 projects,
  19. 47 tickets: 38 open, 9 done). Parked: the old browser checks (`tests/browser-pre20-parked.txt`). Not done: live push of a role change to an open page
  20. (a page needs a reload after an admin changes its role), the "answered" state of #19 is gone (replaced by these states).
  21. ## 2026-09-26 — mission 036: on hybriel master 837fe120 (hl:web, no local patch) — NOT deployed, awaiting architect
  22. Still carries the UNDEPLOYED #19 state (see Byrodin STATUS: never deploy tickets before #19 is decided).
  23. Switched: plugins/webex + both LOCAL PATCHes gone → master's plugins/web; `'hl:web'` / `'hl:web/css'` imports;
  24. NativeWebSocketServer/bindHost gone (hl:web reads HL_HOST); /login/callback uses `req.session` (still mints +
  25. Set-Cookie when the browser has none); `realSession()` gone (`session == null`); `encode` = `encodeURIComponent`;
  26. import.hl `after` = `a > b`; jsoncheck accepts a VALID \u surrogate pair (lone ones still 400 — JSON.parse still
  27. aborts on them, checked with the new binary); shared/tokens.hl = ident's/gitoria's hl:web copy. Gate: the 12 forged
  28. checks accept hl:web's own refusal (ack `ok:false`, "the `session` parameter is filled by the server"); surrogate cases
  29. updated (+2 checks: pair passes, high+non-low refused). `node tests/browser.mjs` → **423 passed, 0 failed** (incl.
  30. the #104 text-order check "the form says which ticket it opened"), no Chrome left. Served page:
  31. `/__hl/{hl-runtime.js,web/client.js,app.css}?v=ead0a6f2dfc83077`, 0 unhashed refs, hashed = immutable, bare = no-cache.
  32. Backup of the old state: `.scratch/pre-036/` (bin, plugins, src, tests). Kept: jsoncheck, localtime, hand sorts,
  33. login.js guard (JS untouched).
  34. ## 2026-09-25 — mission 035: re-vendor to hybriel master 13ef4f9b STOPPED (Hybriel bug) — code NOT touched (only this note)
  35. Probe in a copy (loreana `~/scratch-035/tickets-probe` deleted; recipe: rsync without .env/storage, bin+plugins from master,
  36. `'hl:webex'`→`'hl:web'`, `'hl:webex/css'`→`'hl:web/css'`, gitoria's `shared/tokens.hl`): gate 408 passed, 13 failed. (1) HYBRIEL
  37. BUG: an element built in the browser when its `if` turns true puts a child element BEFORE the bound text: `p { notice " " a {…} }`
  38. in ticket_list.hl renders `<a>open it</a>Opened hybriel #1. ` (server render is right). Repro: loreana
  39. `~/scratch-035/repro/home-textorder.hl`. (2) 12 forged-session checks expect an app `{error}`; hl:web now refuses the extra
  40. argument itself (ack `ok:false`) → the checks must accept that. Workarounds to drop at the real re-vendor: webex LOCAL PATCHes,
  41. NativeWebSocketServer listener (HL_HOST), realSession(), charCodeAt ordering, jsoncheck surrogate refusal (#15), hand URL encoders.
  42. ## 2026-09-25 — ticket #19 "answered" state — awaiting architect (deploy) / creator
  43. New state `answered`. When the creator comments on a ticket in `awaiting creator`, the store (`addComment`)
  44. also writes a state event → `answered` (goes back to whoever asked, leaves the inbox). Other users' comments
  45. change nothing; "confirmed" stays "tested, works". The asker sets `awaiting creator` again as before.
  46. API POST comments and the page face push both events; state badge colour + filter added. Gate: new #19 checks.
  47. DECISIONS.md not touched (architect/librarian).
  48. ## 2026-09-24 — ticket #12 Markdown source view (mission 025) — awaiting architect (deploy) / creator
  49. Follow-up to mission 024: the creator asked (ticket #12, after "awaiting creator") for "a switch
  50. source / markdown at the bottom" to copy/paste or hand-edit the raw Markdown.
  51. Done (worker; edited `/media/STORAGE/projects/worldapi-components/md-editor.js` directly — a plain
  52. JS asset, no `.hl` dev-server-reload risk — then `cp` into `shared/md-editor.js` here; no tickets
  53. `.hl`/faces/API/data changed, so nothing else needed a dev-copy round-trip):
  54. - `<md-editor>` gets a footer row at the bottom with a "Markdown source" button: swaps the visual
  55. editor for a plain textarea with the raw Markdown (copy/paste or hand-editing), "Visual editor"
  56. swaps back (re-parses the text). Same `input`/`change` events, Ctrl+Enter still sends the form.
  57. Hidden together with the toolbar when `toolbar="none"`. Details: worldapi-components README
  58. "Source view" / STATUS mission 025.
  59. - Component test (worldapi-components) → **81 passed, 0 failed** (72 before + 9 new checks), 83
  60. with `ORACLE_APP`. Screenshot `worldapi-components/.scratch/test/md-editor-source-view.png`.
  61. - This app's gate `node tests/browser.mjs` (ports 8700-8729, this session's range) → **418 passed,
  62. 0 failed**, unchanged from mission 024 (no new tickets-side checks added — the feature lives
  63. entirely in the vendored component; the existing `#12` checks already cover the enhanced/standalone
  64. editors and keep passing with the new footer present).
  65. How to verify (ports 8700-8749 only):
  66. ```bash
  67. cmp /media/STORAGE/projects/worldapi-components/md-editor.js shared/md-editor.js && echo same
  68. cd /media/STORAGE/projects/worldapi-components && HL_CHROME=/opt/google/chrome/chrome node test/run.mjs # 81 passed
  69. cd /media/STORAGE/projects/tickets.worldapi.org
  70. TICKETS_GATE_PORT=8700 TICKETS_GATE_IDENT_PORT=8701 TICKETS_GATE_EXCHANGE_PORT=8702 \
  71. TICKETS_GATE_CHROME_A=8710-8719 TICKETS_GATE_CHROME_B=8720-8729 node tests/browser.mjs # 418 passed
  72. ```
  73. Manual (creator): open a ticket → Comment field → click "Markdown source" at the bottom → the box
  74. becomes a plain textarea with the Markdown → edit it → click "Visual editor" → it renders again.
  75. Not deployed (Byrodin container untouched, live app on tickets.worldapi.org still the pre-mission-025
  76. version); the architect deploys with `./deploy.sh` after the creator confirms.
  77. ## 2026-09-24 — ticket #12 Markdown editor (mission 024) — awaiting architect (deploy) / creator
  78. Done (worker; developed in `.scratch/dev-m024`, copied back, NOT deployed):
  79. - New project `/media/STORAGE/projects/worldapi-components/` with `<md-editor>` (its README/STATUS/test).
  80. - Vendored as `shared/md-editor.js`, route `/md-editor.js`, script in the shell; new-ticket summary, edit
  81. summary, comment and state note (input → textarea rows 1) wrapped in `mdEditor { textarea {…} }`;
  82. `styles.hl` sets the `--md-*` tokens. Faces/API/data unchanged. README "Markdown editor".
  83. - Gate `node tests/browser.mjs` → **418 passed, 0 failed** (402 old + 16 new `#12` checks; dev copy and main folder).
  84. - Component test (in worldapi-components, with this app's markdown.hl as oracle) → 72 passed, 0 failed.
  85. - Old files before the copy-back: `.scratch/m024/pre-copy-backup/`.
  86. How to verify (ports 8800-8849 only):
  87. ```bash
  88. cd /media/STORAGE/projects/tickets.worldapi.org
  89. cmp shared/md-editor.js ../worldapi-components/md-editor.js && echo same
  90. bash .scratch/m024/gate-tickets.sh .scratch/m024/g.txt; tail -2 .scratch/m024/g.txt # 418 passed (ports 8810-8812, Chromes 8835-8844)
  91. cd ../worldapi-components && ORACLE_APP=../tickets.worldapi.org HL_CHROME=/opt/google/chrome/chrome node test/run.mjs # 72 passed
  92. ps -eo pid,args | grep [h]l-browser-tier | grep remote-debugging-port=88 # empty
  93. ```
  94. Screenshots: `.scratch/gate-{phone,desktop}-mdeditor.png`, `.scratch/gate-phone-newticket-mdeditor.png`,
  95. `../worldapi-components/.scratch/test/md-editor-{phone,desktop}.png`.
  96. Manual (creator): open a ticket → Comment: type `**bold**` → it turns bold; tap B / list on the phone;
  97. Ctrl+Enter sends; Edit → the summary shows formatted, Save.
  98. Lessons: `<md-editor>` is form-associated, so a wrapping `<label>` activates IT (not the textarea);
  99. Hybriel's JSON.stringify sorts object keys (compare key-sorted); a `<textarea>` turns CR LF into LF
  100. when its value is set by script.
  101. ## 2026-09-24 — design tokens AS DESCRIBED (ticket antcolony#3, mission 021) — awaiting architect (deploy) / creator
  102. Mission 018 (generated `':root'` copy + sync.sh) was REJECTED by the creator; mission 021 replaces it.
  103. Done (worker; developed in `.scratch/dev-m021`, copied back, NOT deployed):
  104. - `shared/tokens.hl` = hand-written webex `var()` tokens (`static dark = var('rgb(25, 30, 35)')`, semantic
  105. `colorText = var(light)` …, incl. `colorAccentText` moved here from the app), verbatim copy of
  106. `/media/STORAGE/projects/worldapi-tokens/tokens.hl`. `styles.hl` member-imports them and uses them as
  107. members; sets only `colorAccent = var(purple)`. README "Design tokens".
  108. - webex LOCAL PATCH (mission 021, hybriel#39) in `plugins/webex/WebFramework.hl`; XSS patch kept.
  109. - Old files: `.scratch/m021/pre-copy-backup/` (styles.hl, shared/tokens.hl, WebFramework.hl); mission 018's
  110. worldapi-tokens folder (sync.sh, tokens.css, generated tokens.hl): `tickets.worldapi.org/.scratch/m021/worldapi-tokens-m018-backup/`.
  111. - Rendered colours unchanged: `/__hl/app.css` after `:root` byte-identical old vs new (in `:root` only
  112. the order of `--color-accent-text` / the app's `--color-accent` changed); Chrome computed colours
  113. of every element + every token, tickets list/inbox/state/ticket/you + ident home/code/account/apps/inbox,
  114. 390 + 1280: 23 passed, 0 failed.
  115. - Gate `node tests/browser.mjs` (ports remapped: `.scratch/m021/gate-tickets.sh`) → **402 passed, 0 failed** (dev copy and main folder).
  116. - Deploy simulation (deploy.sh excludes + debian:12-slim container): same app.css, byte-identical.
  117. How to verify (ports 8850-8879 only; scripts in tickets.worldapi.org/.scratch/m021 unless noted):
  118. ```bash
  119. cd /media/STORAGE/projects/tickets.worldapi.org
  120. for a in tickets ident; do cmp /media/STORAGE/projects/worldapi-tokens/tokens.hl ../$a.worldapi.org/shared/tokens.hl && echo same $a; done
  121. bash .scratch/m021/cmpup.sh up; node .scratch/m021/cmpstyles.mjs; bash .scratch/m021/cmpup.sh down # 23 passed (old code: <app>/.scratch/m021/old-<app>)
  122. IDENT_GATE_DIR=/media/STORAGE/projects/ident.worldapi.org bash .scratch/m021/gate-tickets.sh .scratch/m021/g.txt; tail -2 .scratch/m021/g.txt # 402 passed
  123. cd /media/STORAGE/projects/ident.worldapi.org; bash .scratch/m021/gate-ident.sh . .scratch/m021/gates-main # 6 suites green
  124. bash /media/STORAGE/projects/tickets.worldapi.org/.scratch/m021/deploysim.sh <tickets dir> <ident dir> # needs cmpup's run/main-*.css
  125. ps -eo pid,args | grep [h]l-browser-tier # empty
  126. ```
  127. Screenshots: `tickets.worldapi.org/.scratch/m021/shots/<app>-<old|new>-<page>-<390|1280>.png`.
  128. Lesson: an imported `static` var() token works only with the mission 021 webex patch; tokens.hl changes need a restart.
  129. ## 2026-09-24 — shared design tokens (ticket antcolony#3, mission 018) — REJECTED by the creator, superseded by mission 021
  130. Done (worker; developed in `.scratch/dev-m018`, copied back, NOT deployed):
  131. - Tokens now come from `shared/tokens.hl` (generated from layouts `tokens.css` by
  132. `/media/STORAGE/projects/worldapi-tokens/sync.sh`, vendored like plugins/); `styles.hl` inherits it and
  133. sets only the accent (README "Design tokens"). Old copy of `styles.hl`: `.scratch/m018/pre-copy-backup/`.
  134. - Every rendered colour unchanged: `/__hl/app.css` after `:root` byte-identical old vs new; computed
  135. colours of every element (tickets list/inbox/state/ticket/you, ident home/code/account/apps/inbox, 390 +
  136. 1280) old == new in Chrome.
  137. - Gate `node tests/browser.mjs` → **402 passed, 0 failed** (dev copy and main folder).
  138. How to verify (ports 8850-8879 only):
  139. ```bash
  140. cd /media/STORAGE/projects/tickets.worldapi.org
  141. /media/STORAGE/projects/worldapi-tokens/sync.sh --check # ok ×3
  142. bash .scratch/m018/cmpup.sh up; node .scratch/m018/cmpstyles.mjs; bash .scratch/m018/cmpup.sh down # 23 passed (old code in .scratch/m018/old-*)
  143. IDENT_GATE_DIR=/media/STORAGE/projects/ident.worldapi.org bash .scratch/m018/gate-tickets.sh /tmp/g.txt; tail -2 /tmp/g.txt # 402 passed
  144. cd /media/STORAGE/projects/ident.worldapi.org; bash .scratch/m018/gate-ident.sh . .scratch/m018/gates-main # 6 suites green (ports remapped copies)
  145. bash /media/STORAGE/projects/tickets.worldapi.org/.scratch/m018/deploysim.sh <tickets dir> <ident dir> # deploy rsync + container: same app.css
  146. ps -eo pid,args | grep [h]l-browser-tier # empty
  147. ```
  148. Screenshots: `tickets.worldapi.org/.scratch/m018/shots/<app>-<old|new>-<page>-<390|1280>.png`.
  149. Lesson: a `var()` token of hl:webex/css can't cross an `inherit` (second instance) — use literal `':root'` strings.
  150. ## 2026-09-24 — ticket #4 (mission 017): parent / child + blocked-by — awaiting architect (deploy) / creator
  151. Done (worker; developed in `.scratch/dev-m017`, copied back, NOT deployed to Byrodin):
  152. - **Relations** (README "Relations"): a ticket has ≤ 1 parent and any number of blockers, across
  153. projects; parent page lists children + states, child shows "Part of …"; "Blocked by" / "Blocks" on
  154. both sides. New table `storage/mpackdb/links.*` (created empty — no migration); every change is a
  155. history event `kind:"link"` on the child / blocked ticket.
  156. - **Who may**: the author of either ticket or the creator (legacy tickets without author: only the
  157. creator or the other ticket's author). No self-links, no loops (also transitive), no duplicates.
  158. - **Parent state**: `allChildrenConfirmed` (children exist and all `confirmed`) → page "all children
  159. confirmed (n)" (green) / "k of n children confirmed"; the parent's state is never changed.
  160. - **API**: `POST …/parent {parent}` (`""` removes), `POST …/blocked-by {add}|{remove}`, both URL
  161. forms; rows (list + single) carry `parent`, `children`, `blockedBy`, `blocks` (refs with states),
  162. `allChildrenConfirmed`. Markdown view: Parent / Children / Blocked by / Blocks blocks + list-line tails.
  163. - **Web**: forms "Parent ticket" (Set / Remove) and "Blocked by" (Add, Remove per row) for logged-in
  164. users; live push `ticketsRelated` after relation writes, state changes and edits.
  165. - Gate ports configurable (`TICKETS_GATE_CHROME_A/B` new); a `connected()` wait added before the
  166. pre-existing token "Revoke" click (it flaked once on the bare SSR button).
  167. - Gate `node tests/browser.mjs` → **402 passed, 0 failed** (dev copy 3× in a row, main folder 3×).
  168. How to verify:
  169. ```bash
  170. cd /media/STORAGE/projects/tickets.worldapi.org
  171. bash .scratch/m017/gate.sh .scratch/m017/g.txt; tail -2 .scratch/m017/g.txt # gate on ports 8800-8819 (or plain node tests/browser.mjs)
  172. ps -eo pid,args | grep [h]l-browser-tier # empty
  173. bash .scratch/m017/compat.sh # old vs new code on store copies: JSON equal minus the 5 new keys, Markdown identical, .mpack unchanged
  174. node .scratch/m017/identmigrate.mjs # rehearsal on a store COPY: ident #3–#8 under ident #1 (creator token 201 ×6, non-creator 403)
  175. ```
  176. Look at `.scratch/gate-{phone,desktop}-{parent,blocked}.png`.
  177. For the architect (after the deploy): link the ident pieces —
  178. `for n in 3 4 5 6 7 8; do curl -s -XPOST -H "Authorization: Bearer $TOKEN" -d '{"parent":"ident.worldapi.org#1"}' https://tickets.worldapi.org/api/projects/ident.worldapi.org/tickets/$n/parent; done`
  179. — ident #1 and #3–#8 were opened BEFORE the login (authors "import" / "architect" as text), so only
  180. the CREATOR's token may (a non-creator gets 403, rehearsed). Check: `curl -s -H 'Accept: text/markdown' https://tickets.worldapi.org/api/projects/ident.worldapi.org/tickets/1 | head -20`.
  181. Manual (creator): open a ticket you opened → "Parent ticket" field → `ident.worldapi.org#1` → Set parent;
  182. the parent page lists it under "Children".
  183. Lessons (mission 017):
  184. - `from` is reserved in Hybriel (parse error "Expected parameter name") — known (hybriel#22), bit again.
  185. - A gate click right after `goto` + `waitForSelector` can hit the SSR button before hydration → wait for
  186. the socket (`connected()`) before any click.
  187. - Loreana ports 8821 and 8830 are taken by other software (llama-server) — inside the 8800-8849 range.
  188. ## 2026-09-24 — tickets #8 (edit) + #6 (Markdown) + #11 (gate under load), mission 014 — awaiting architect (deploy) / creator
  189. Done (worker; developed in `.scratch/dev-m014`, copied back, NOT deployed to Byrodin):
  190. - **SECURITY, found on the way (pre-existing, live too)**: hl:webex writes the page state (user
  191. text) into an inline `<script>` unescaped → a summary / comment containing
  192. `</script><img src=x onerror=…>` executes in every viewer's browser. Reproduced on the pre-m014
  193. code (`.scratch/m014/old-app`, probe ticket via `.scratch/m014/xssprobe.hl` on a store COPY →
  194. `xsscheck.mjs` `__pwned = 1`); fixed by a one-line LOCAL PATCH in `plugins/webex/WebFramework.hl`
  195. (`<` → `\u003c` in the seed) → `__pwned = undefined`, page hydrates. Deploy soon; ident and
  196. every other hl:webex app vendor the same code (hybriel issue to file).
  197. - **#8 editing** (README "Markdown, editing"): the author edits subject + summary (web "Edit",
  198. API `POST …/edit`); legacy tickets (no user on the created event): only the creator; else 403.
  199. Edit = history event `kind:"edit"` with old + new values, pushed live.
  200. - **#6 Markdown**: `markdown.hl` + `components/markdown.hl` render summary / comments / state
  201. notes safely (text nodes only, `safeHref`); `mdview.hl` = `Accept: text/markdown` on the ticket
  202. GETs. JSON unchanged (old vs new code on copies of the store: every GET byte-identical).
  203. - **#11 gate**: page waits × `TICKETS_GATE_SLOW` (default 3); console check before ident stops,
  204. browsers parked on `about:blank` during "ident down".
  205. - Gate `node tests/browser.mjs` → **335 passed, 0 failed** (dev copy and main folder).
  206. How to verify:
  207. ```bash
  208. cd /media/STORAGE/projects/tickets.worldapi.org
  209. node tests/browser.mjs # 335 passed; look at .scratch/gate-{phone,desktop}-{edit,markdown}.png
  210. ps -eo pid,args | grep [h]l-browser-tier # empty
  211. bash .scratch/m014/compat.sh # JSON DUMPS IDENTICAL, 47 tickets md+page 200, .mpack unchanged
  212. # #11 under load: a dev server on a store COPY (:8374), then
  213. node .scratch/m014/load.mjs http://127.0.0.1:8374 4 6 & # 4 Chromes x 6 tabs; kill %1 afterwards
  214. node tests/browser.mjs # 3x green (logs .scratch/m014/gate-load-*.txt, gate-heavy-*.txt)
  215. # old code under the same load: .scratch/m014/old-app → 274/1 (ERR_CONNECTION_REFUSED selector.js), 3 of 3 runs
  216. ```
  217. Manual (creator): open a ticket you opened after the login → "Edit" (top, under the dates) →
  218. change subject / summary (Markdown) → Save: the history shows "edited the ticket" with the
  219. previous version folded. `curl -H 'Accept: text/markdown' https://tickets.worldapi.org/api/projects/tickets.worldapi.org/tickets/6`.
  220. Old files before the copy-back: `.scratch/m014/pre-copy-backup/` (+ `.scratch/m014/old-app/plugins`).
  221. Lessons (mission 014):
  222. - A `#events li` selector (CSS or test) also hits the `<li>` of a Markdown list inside an event:
  223. use `#events > li`.
  224. - Hybriel string literals DO decode `\uXXXX` but not `\\`: a literal backslash is `'\u005c'`.
  225. - Never embed user text in an inline `<script>` without escaping `<` (webex did — see above).
  226. ## 2026-09-24 — tickets #9 + #10 (mission 012): login banner after logout, button returns to the page — awaiting architect (deploy) / creator
  227. Done (worker; developed in `.scratch/dev-m012`, copied back, NOT deployed to Byrodin):
  228. - **#9 cause (reproduced in headless Chrome, own ident + tickets, `.scratch/m012/repro.mjs`)**:
  229. hl:webex re-creates the shell header — `<ident-selector>` AND the `<script>` elements — every
  230. time the login state flips (login, logout); the browser runs the re-inserted `/login.js` again,
  231. and every run added one more `ident-login` listener to the (new) selector. After a logout the
  232. selector carried 2 listeners → one choice = 2 `change`s on `#identcode` = 2 `identLogin` faces =
  233. 2 exchanges of the SAME code at ident (200, then 400 "unknown or already used code" → banner).
  234. The first exchange had logged the session in as the chosen identity (B). Not identity-specific:
  235. A → Log out → A again showed the banner too; the first selector login after a page load never
  236. does (one listener) — that is why "with A alone" it never appeared. Navigation is NOT the cause
  237. (after an in-app click list → ticket, login.js had not run again); list, ticket page reached by
  238. click and ticket page loaded directly all showed it (old code: exchanges `[200, 400]`).
  239. - **Fix** `login.js`: installs once per document, `ident-login` listener on `document`, current
  240. `#selector` looked up each time (MutationObserver on the whole document), each code handed on
  241. once. After: exactly one exchange, no banner, logged in as B (all 3 scenarios).
  242. - **#10** the button returns to the page: `login.js` adds `?next=<path+query>` to the button's
  243. return URL at the click; `project.hl` `safeNext` + `/login/callback` → 302 there (same-origin
  244. path only, else `/`). ident keeps the return URL's query and appends `&ident_code=`.
  245. - Gate `node tests/browser.mjs` → **275 passed, 0 failed** (+25: #9 path with an exchange-counting
  246. proxy, #10 table + browser). With the OLD `login.js` the new #9/#10 checks FAIL (negative control).
  247. How to verify:
  248. ```bash
  249. cd /media/STORAGE/projects/tickets.worldapi.org
  250. node tests/browser.mjs # 275 passed; grep '#9\|#10' in the output
  251. ps -eo pid,args | grep [h]l-browser-tier # empty
  252. SCEN=ticket-nav node .scratch/m012/repro.mjs # "B login: exchanges=1 ..." ; banner null
  253. SCEN=list node .scratch/m012/repro.mjs .scratch/m012/old-app # the OLD login.js: "B login: exchanges=2", banner
  254. ```
  255. Old files before the copy-back: `.scratch/m012/pre-copy-backup/`. Gate logs `.scratch/m012/gate-*.txt`.
  256. Manual (creator): log in with the selector, Log out, choose another identity → no red banner,
  257. top right the other identity; log out on a ticket page, "Log in with ident" → back on that page.
  258. ## 2026-09-24 — ticket #7 (mission 011): login via ident — awaiting architect (deploy) / creator
  259. Done (worker; developed in `.scratch/dev-m011`, NOT deployed to Byrodin):
  260. - **Login** (README "Login (ident)"): ident's selector top right + "Log in with ident" button;
  261. the server exchanges the one-time code (`users.hl` exchangeCode, IDENT_API_KEY/SECRET) for the
  262. per-app identity id; `login.js` bridges the selector's `ident-login` event into the shell's
  263. face `identLogin` (no reload); `/login/callback` for the button. Logout resets the selector.
  264. - **Users** `storage/mpackdb/users.*` (identity id → display name, asked once at the first login,
  265. cannot be changed afterwards), **tokens** `storage/mpackdb/tokens.*` (sha256 only; `/you`:
  266. create / list / revoke; `Authorization: Bearer` on every API write, else 401).
  267. - **Reading public, writing needs a login** (web faces check the REAL session, #31; API 401).
  268. No author field (API `author` → 400 naming it); events store `user`, old events keep their
  269. author. **Confirm/reject only by `TICKETS_CREATOR_IDENTITY`** (unset = nobody; API 403).
  270. - `/you` shows the user's own per-app id (for TICKETS_CREATOR_IDENTITY) + tokens.
  271. - `import.hl` needs `TICKETS_TOKEN`. `docker-compose.yml`: `IDENT_EXCHANGE_URL=http://127.0.0.1:45002`
  272. (key/secret/creator come from `.env`, loaded by the runtime).
  273. - Gate `node tests/browser.mjs` → **250 passed, 0 failed** (own ident on :8353 from a copy of
  274. ident's code without `.env`, mail sink; see README "Test").
  275. - Live-store compatibility: old code (`.scratch/dev-m010`) and new code each on a COPY of
  276. `storage/mpackdb`, every GET dumped → byte-identical (`.scratch/m011/compat.sh`); old
  277. `.mpack` files unchanged; `users.*`/`tokens.*` appear empty. No migration step.
  278. For the architect (deploy): `.env` on Byrodin must have `IDENT_API_KEY` / `IDENT_API_SECRET`
  279. (creator set them). After the deploy: the creator logs in, opens `/you`, the architect sets
  280. `TICKETS_CREATOR_IDENTITY=<id>` in `.env`, restarts; the creator (identity "Architect") creates
  281. the architect's token on `/you`. Until then NOBODY can confirm/reject, and every API client
  282. (the architect's scripts, import) needs a token — writes without one are 401 from the deploy on.
  283. How to verify:
  284. ```bash
  285. cd /media/STORAGE/projects/tickets.worldapi.org
  286. node tests/browser.mjs # 250 passed; screenshots .scratch/gate-*-{signedout,name,loggedin,tokens}.png
  287. ps -eo pid,args | grep [h]l-browser-tier # empty
  288. bash .scratch/m011/compat.sh # DUMPS IDENTICAL (old vs new code on copies of storage/mpackdb)
  289. ```
  290. Manual (dev): own ident + tickets: `bash .scratch/m011/devup.sh` (ident :8358 from
  291. `.scratch/m011/ident` = copy WITHOUT .env, mail sink `.scratch/m011/run/mail.txt`; tickets :8359
  292. with `.scratch/m011/run/app.env`; `node .scratch/m011/devsetup.mjs` registers the app first).
  293. Query users/tokens: only on a COPY (#40): `cp -a storage/mpackdb /tmp/c` + a small hl script
  294. (`MPackDB(file = '/tmp/c/users.db', primaryKey = '@id', indexes = ['!identity'])`).
  295. ## 2026-09-24 — deploy readiness (mission 010) — awaiting architect (first deploy)
  296. Done (worker; NOT deployed to Byrodin):
  297. - `project.hl`: builds the listener itself so `HL_HOST=127.0.0.1` binds loopback (hl:webex
  298. ignores HL_HOST); `TICKETS_WATCH=0` = no dev watcher. Defaults unchanged (0.0.0.0, watcher on).
  299. - `docker-compose.yml` (container `tickets.worldapi.org`, 127.0.0.1:45003) + `deploy.sh`
  300. (README "Deploy").
  301. - Gate `node tests/browser.mjs` → 164 passed, 0 failed (dev copy `.scratch/dev-m010` and live folder).
  302. - Tested on Loreana only: local deploy into a directory + the container there (only
  303. 127.0.0.1:45003 listens, URL 200, fake storage marker untouched), and behind a local TLS
  304. nginx in real Chrome: page + wss socket, no http:// URLs (ident `.scratch/m010/`).
  305. How to verify:
  306. ```bash
  307. cd /media/STORAGE/projects/tickets.worldapi.org
  308. node tests/browser.mjs # 164 passed
  309. bash -n deploy.sh && ./deploy.sh --dry-run --target /tmp/ticketsdeploy-test # LOCAL dir only
  310. ```
  311. For the architect: the vhost needs WebSocket Upgrade headers and `proxy_pass http://127.0.0.1:45003`.
  312. ## 2026-09-24 — ticket #38 (mission 008): per-project numbers, UUID keys, storage/mpackdb/ — awaiting creator
  313. Done (worker, not yet confirmed by the creator):
  314. - **UUID keys** (`@id`) in all three tables, files in `storage/mpackdb/{projects,tickets,events}.*`.
  315. Ordering from stored times: lists by `updated`, history by (`created`, `seq`), projects by `created`.
  316. - **Per-project numbers** from 1; URL `/projects/<project>/<number>`; slug = project name as is
  317. (new names: letters, digits, `. _ -` only). List, inbox, ticket page, pushes, notice link use it.
  318. - **Old global numbers** kept as `oldNumber`: page shows "formerly #n", `/tickets/<n>` → 301,
  319. `/api/tickets/<n>[/comments|/state]` still work (also with the UUID). New tickets: no old number.
  320. - **API** per-project form `/api/projects/<slug>/tickets[/<number>[/comments|/state]]` (GET/POST),
  321. rows carry `project`, `number`, `href`, `apiHref`, `oldNumber`. `ticket.id` is now the UUID.
  322. - **Migration** `tools/migrate-008.hl` (idempotent) of the live data, deployed 2026-09-24:
  323. old tables stay in `storage/tickets-*` (untouched, md5-checked), full backup
  324. `.scratch/storage-backup-<ts>`, logs + before/after dumps in `.scratch/deploy-008-<ts>/`
  325. (`deploy-008.sh`, compare `cmp008.py`). Rehearsed on a copy first (`.scratch/rehearse.sh`).
  326. - Gate: `node tests/browser.mjs` → **164 passed, 0 failed** (in `.scratch/dev` before deploy).
  327. Test: gate (see README "Test"), then
  328. `python3 .scratch/cmp008.py .scratch/deploy-008-*/before.jsonl .scratch/deploy-008-*/after.jsonl`
  329. and open http://192.168.178.75:8350/tickets/38 (→ /projects/tickets.worldapi.org/5).
  330. Known gaps: new tickets have no global number, so `/api/tickets/<n>` works only for the
  331. migrated #1–#40 (use the UUID or the per-project form). Numbers are max+1 (a deleted ticket's
  332. number would be reused — there is no delete). Project names stay case-sensitive.
  333. ## 2026-09-24 — ticket #15 (mission 004): required author, 400 on invalid JSON, list lines — awaiting creator
  334. Done (worker, not yet confirmed by the creator):
  335. - **`author` required** on `POST /api/tickets`, `/comments`, `/state` → 400 `{error, field:"author"}`
  336. when missing/empty (`api.hl` required lists + `store.hl` `authorMissing`, so web faces too).
  337. Web forms: name fields removed, they write as `creator` until ident exists. Stored data unchanged.
  338. - **Invalid JSON → 400 `{error:"invalid JSON at character N"}`** (no source path) via
  339. `jsoncheck.hl` before `JSON.parse` — WORKAROUND for hybriel #12, remove when fixed. It also
  340. refuses `\uD800`–`\uDFFF` escapes (hl JSON.parse refuses even valid pairs → would be 500).
  341. - **Import list lines**: `ticketfile.hl` keeps `- ` / `* ` / `1. ` lines as own lines (`\n`),
  342. wrapped lines still joined; page shows them as separate lines (pre-wrap). #1–#5 have no lists
  343. → nothing to migrate.
  344. - Gate: `node tests/browser.mjs` → **119 passed, 0 failed** (in `.scratch/dev` before deploy).
  345. - Deploy 2026-09-24: backup + before/after API dumps in `.scratch/` (see `deploy-004.sh`).
  346. Known gaps: a body that passes jsoncheck but that hl JSON.parse still refuses would 500
  347. (none known besides surrogates). Nested list indentation is dropped. A wrapped line that
  348. happens to start with `12. ` is taken as a list item (same as Markdown).
  349. ## 2026-09-24 — ticket #10 (mission 002): strict API, Vienna time, paragraph import — awaiting creator
  350. Done (worker, not yet confirmed by the creator):
  351. - **Strict API** (`bodyError` in `api.hl`): every POST body must be a JSON object; unknown
  352. field / missing or empty required field / non-string value → 400 `{ error, field }`,
  353. nothing written. Semantic refusals (state, project name) carry `field` too. `POST /api/projects` → 405.
  354. - **Local time**: all shown times (pages + API `created`/`updated`/`when`) are Europe/Vienna
  355. (`localtime.hl`, userland EU DST rule — hl:time has no time zones). Storage stays epoch ms.
  356. - **Import**: `ticketfile.hl` joins hard-wrapped lines, blank line = new paragraph (`\n\n`).
  357. - **One-off data fix** 2026-09-24 00:11: `tools/fix-import-summaries.hl` rewrote only `summary`
  358. of #1–#5 (server stopped, backup `.scratch/storage-backup-20260924-001142`). Ids, states,
  359. `updatedMs`, events unchanged — compared API dumps `.scratch/{before,after}-full-20260924-001142.json`.
  360. - Gate: `node tests/browser.mjs` → **93 passed, 0 failed** (2026-09-24, run in a copy before deploy).
  361. Known gaps: invalid JSON → 500 (no way to catch `JSON.parse` in Hybriel; nothing written).
  362. `author` stays optional (defaults to `anonymous`). Vienna rule is correct from 1996 on only.
  363. Running: dev server on :8350, PID in `server.pid`, log `server.log`, data `storage/mpackdb/`.
  364. ## 2026-09-23 — MVP (AntColony ticket 0001, mission 001)
  365. Done (worker, not yet confirmed by the creator):
  366. - Data: projects, tickets (id, project, subject, summary, state, source, created, updated),
  367. append-only events (created / comment / state, free-text `author`). Six states.
  368. - Pages `/`, filters `/project/:p`, `/state/:s`, both; `/tickets/:id`; `/inbox`; new-ticket form.
  369. - Live push of comments / state changes / new tickets to every open browser (web AND API writes).
  370. - JSON API (list/get/create/comment/state/projects), import command (idempotent by file name).
  371. - Dark WorldAPI tokens, accent #c586c0, danger #f44747; works at 390px and 1280px.
  372. - Gate then: 57 passed.
  373. ## How to verify
  374. ```bash
  375. cd /media/STORAGE/projects/tickets.worldapi.org
  376. node tests/browser.mjs # the gate (see README "Test")
  377. ps -eo pid,args | grep [h]l-browser-tier # must print nothing afterwards
  378. curl -s http://127.0.0.1:8350/api/tickets | jq '.tickets[] | {project, ref, oldNumber, state, subject}'
  379. curl -s -XPOST -d '{"text":"x","bogus":"1"}' http://127.0.0.1:8350/api/tickets/1/comments # → 400 naming bogus (nothing written)
  380. curl -s -XPOST -d '{bad' http://127.0.0.1:8350/api/tickets/1/comments # → 400 invalid JSON at character 1
  381. curl -si http://127.0.0.1:8350/tickets/38 | grep Location # → /projects/tickets.worldapi.org/5
  382. node .scratch/checklive.mjs # read-only real-Chrome look at :8350: list/history times == Intl Vienna, #1/#2 summaries one paragraph
  383. ```
  384. Then open http://192.168.178.75:8350 in two browsers, comment in one, watch the other.
  385. ## Open / next
  386. - ~~No users~~ — done by ticket #7 (mission 011): creator-only confirm/reject via TICKETS_CREATOR_IDENTITY.
  387. - Not deployed (Byrodin container, nginx vhost, DNS) — out of MVP scope.
  388. - Project filter chips / datalist of a list page do not grow live when a NEW project appears
  389. (a reload shows it); ticket rows do.
  390. - No delete of tickets or comments; comments cannot be edited (only subject + summary, ticket #8).
  391. - Keywords in comments (`/confirm`, `/reject`, …) are the scheduler's job, not implemented here.
  392. - Hybriel limits met (worked around): no time zones in hl:time (localtime.hl), no catch for
  393. JSON.parse (jsoncheck.hl → 400), JSON.parse refuses \u surrogate escapes, no list `concat()` (NotCallable), no string escapes ("\r" is 2 chars).
  394. - Older Hybriel limits met (worked around): no string ordering / no list `sort()` (import sorts by
  395. char codes). (mpackdb `*id` from 0 no longer matters: UUID keys since #38.)
  396. ## Lessons
  397. - (mission 012) hl:webex re-creates elements of a View when an `if` block before/around them
  398. flips — including `script { src }`: the browser EXECUTES a re-inserted script again, and custom
  399. elements lose their internal state (the selector forgets the chosen name). A plain script in a
  400. View must be idempotent (guard per document) and must not hold element references.
  401. - (mission 011) A called function's PARAMETER NAMED LIKE AN ENTRY of the object literal it is
  402. called from reads that entry: `{ id = e.id author = nameOfUser(e.user) }` with
  403. `nameOfUser = (id) => …` got the EVENT's id. Compute such calls before the literal, avoid
  404. parameter names like `id` (Hybriel issue reported in mission 011).
  405. - (mission 011) hl:mpackdb `update(key, rec)` on an `@id` table with a record WITHOUT `id`
  406. stores it without the key: `fetch(key)` is null afterwards (the unique index still finds it)
  407. and the next update fails `CorruptRecord`. Always pass the whole record with `id`.
  408. - (mission 011) hl:webex cannot listen to a custom DOM event (`ident-login`): a plain script
  409. (`login.js`) writes the value into a hidden input and fires `change`.
  410. - (mission 011) A failed hl:fetch (connection refused) is an `Error` event; only a root
  411. `on Error(e)` in the ENTRY file (project.hl) absorbs it — one in the imported users.hl did not.
  412. - (mission 011) hl:webex ships every component member AND `session.user` to the browser:
  413. keep the identity id out of members and out of the session (only on /you, on purpose).
  414. - (mission 011) `rsync --exclude 'server.*'` also drops `plugins/*/server.hl` — anchor it (`/server.*`).
  415. - Hybriel resolves RELATIVE file paths (mpackdb too) against the ENTRY SCRIPT's directory,
  416. not the cwd: a tool in `tools/` must get an absolute `TICKETS_STORAGE`.
  417. - Saving a `.hl` file reloads the running dev server (watcher): develop in a copy
  418. (`.scratch/dev`, gate there), stop the server, then copy files in.
  419. - `JSON.parse` of a JSON array gives a Hybrid with `.length`; of an object `.length` is null.
  420. - A function route's request has `req.query` (parsed object); `req.path` carries NO query string.
  421. - `emit client …` inside a function route (API) works: with an `audience` entry it fans out to
  422. every admitted connection that has a listener mounted.
  423. - A selector group in `styles.hl` must be ONE quoted key (`'input,\ntextarea' { … }`); a bare
  424. `input, textarea` is a parse error.
  425. - Function PARAMETERS are immutable in Hybriel (`i = i + 1` on a param is a runtime error):
  426. copy into a `let` first (jsoncheck.hl).
  427. - `google-chrome` is not on PATH on Loreana; the gate uses `/opt/google/chrome/chrome`.
  428. - Opening an hl:mpackdb table REWRITES its index/meta files (`*.txt`, `*.meta.json`,
  429. `*.idxstate.json`) even with `compact = false`; only `.mpack` stays. Migrate from a COPY
  430. when the originals must stay byte-identical (deploy-008.sh does).
  431. - mpackdb `@id` keys are 12-char strings (`0mufbphip3w7`); a missing indexed field is fine
  432. (`*oldNumber` on new tickets); `!path` unique index refuses duplicate numbers.
  433. - A non-literal `static` in project.hl reads null in function routes (hybriel #16): API helpers
  434. in project.hl are plain members, not statics.
  435. ## 2026-09-24 — DEPLOYED (architect)
  436. - LIVE is now https://tickets.worldapi.org on Byrodin (/CONTAINERS/projects/tickets.worldapi.org). The live data was moved there.
  437. - This Loreana folder is DEVELOPMENT only; its storage/ is a stale copy. Dev servers were stopped. Update live with ./deploy.sh.
  438. ## 2026-09-24 — ticket #16: tidy relations block out of the edit handlers — awaiting creator
  439. Done (worker, not yet confirmed by the creator):
  440. - `components/ticket.hl`: the relations init block (`rel`, `hasRelations`, `hasParent`, …,
  441. `parentDraft`, `blockerDraft`, `linkMessage` — 16 lines) had been pasted verbatim into
  442. `startEdit`, `cancelEdit` and `saveEdit` too (ticket #4 code landing inside the ticket #8 edit
  443. handlers). Removed the three copies; the component's own init block (still there) is the only
  444. place that sets them. No behaviour change intended — clicking Edit/Cancel/Save no longer resets
  445. `parentDraft`/`blockerDraft`/`linkMessage` mid-edit, which was a side effect of the paste, not a
  446. feature. 489 → 441 lines.
  447. - Gate: `node tests/browser.mjs` → **418 passed, 0 failed**, run on this folder with
  448. `TICKETS_GATE_PORT=8700 TICKETS_GATE_IDENT_PORT=8701 TICKETS_GATE_EXCHANGE_PORT=8702
  449. TICKETS_GATE_CHROME_A=8703-8704 TICKETS_GATE_CHROME_B=8705-8706` (own storage in
  450. `.scratch/gate-store`, own ident, no live data touched). Includes the full #4 relations suite
  451. and #8 edit suite, both still green.
  452. - Not deployed (deploy.sh is the architect's job).
  453. Test: gate above, then open a ticket with relations on the live site and click Edit — the
  454. relations panel keeps showing normally, editing subject/summary still works.

Branches

Latest commits

  • f12fa1bcState of 2026-09-27, before the move to gitoriamre