| Both sides previous revisionPrevious revisionNext revision | Previous revision |
| provenance:programming:crawler:webxray:residue_pass [2026/09/11 22:43] – Refresh check_tail_figures.py (derives the hand-changed verdict count from the corrections output and asserts the superseded one absent) and the mutation harness, now 24 mutations, 0 survivors. Authored by Claude karel.kubicek.claude | provenance:programming:crawler:webxray:residue_pass [2026/09/17 07:24] (current) – Markup rendering sweep: wrap escapes, CLI flag typography, and heading quotes. Authored by Claude. karel.kubicek.claude |
|---|
| |
| **Why this is a third page.** These blocks are 392 kB and the | **Why this is a third page.** These blocks are 392 kB and the |
| random-sample appendix's are already 286 kB; putting them together would | random-sample appendix's are already 289 kB; putting them together would |
| make one 678 kB page carrying two probe logs. Both figures are computed | make one 681 kB page carrying two probe logs. Both figures are computed |
| when this page is generated, from the same file lists the two manifests use, so | when this page is generated, from the same file lists the two manifests use, so |
| neither can go stale while the other moves. That page's own "why this is a | neither can go stale while the other moves. That page's own "why this is a |
| | J | ''out/check_tail_merge_mutations-output.txt'' | 1,142 | ''ebb83f0c555d0527'' | no | | | J | ''out/check_tail_merge_mutations-output.txt'' | 1,142 | ''ebb83f0c555d0527'' | no | |
| | K | ''out/tail_probe.txt'' | 177,214 | ''5f487708ad8b7ba9'' | **yes** — one lone CR normalised to LF | | | K | ''out/tail_probe.txt'' | 177,214 | ''5f487708ad8b7ba9'' | **yes** — one lone CR normalised to LF | |
| | L | ''out/owner_tail_merge-output.txt'' | 1,042 | ''b1fe634a350c43bc'' | no | | | L | ''out/owner_tail_merge-output.txt'' | 1,042 | ''d6c7dcdf4535daa7'' | no | |
| | M | ''out/tail_verify-output.txt'' | 2,512 | ''f772acd997a598d8'' | no | | | M | ''out/tail_verify-output.txt'' | 2,512 | ''f772acd997a598d8'' | no | |
| | N | ''out/owner_tail_corrections-output.txt'' | 6,659 | ''df43d5b6edba64dd'' | no | | | N | ''out/owner_tail_corrections-output.txt'' | 6,669 | ''808c2387aea5a34c'' | no | |
| | O | ''out/owner_random_sample-tail-output.txt'' | 52,594 | ''f46dd7c6f37fb231'' | no | | | O | ''out/owner_random_sample-tail-output.txt'' | 52,594 | ''f46dd7c6f37fb231'' | no | |
| | P | ''out/owner_random_sample-tail.diff'' | 63,634 | ''07ae04745a451e50'' | no | | | P | ''out/owner_random_sample-tail.diff'' | 63,634 | ''07ae04745a451e50'' | no | |
| ===== L. Unedited output: scripts/owner_tail_merge.py ===== | ===== L. Unedited output: scripts/owner_tail_merge.py ===== |
| |
| Run as ''python3 scripts/owner_tail_merge.py --sample out/owner_sample.json --base out/adj_rows_scored.json --tail out/tail40.json --dir out/tail_adj --out out/adj_rows_tail.json''. | Run as ''python3 scripts/owner_tail_merge.py %%--sample%% out/owner_sample.json %%--base%% out/adj_rows_scored.json %%--tail%% out/tail40.json %%--dir%% out/tail_adj %%--out%% out/adj_rows_tail.json''. |
| |
| <code> | <code> |
| archived-legal 2 | archived-legal 2 |
| |
| wrote /tmp/discard_rows.json (175 rows) | wrote out/adj_rows_tail.json (175 rows) |
| </code> | </code> |
| |
| ===== M. Unedited output: scripts/owner_verify_sources.py on the second pass's rows ===== | ===== M. Unedited output: scripts/owner_verify_sources.py on the second pass's rows ===== |
| |
| Run as ''python3 scripts/owner_verify_sources.py --rows out/tail_rows_only.json --cache out/tail_verify_cache --out out/tail_verify.json''. | Run as ''python3 scripts/owner_verify_sources.py %%--rows%% out/tail_rows_only.json %%--cache%% out/tail_verify_cache %%--out%% out/tail_verify.json''. |
| |
| <code> | <code> |
| ===== N. Unedited output: scripts/owner_tail_corrections.py ===== | ===== N. Unedited output: scripts/owner_tail_corrections.py ===== |
| |
| Run as ''python3 scripts/owner_tail_corrections.py --rows out/adj_rows_tail.json --out out/adj_rows_tail_final.json''. | Run as ''python3 scripts/owner_tail_corrections.py %%--rows%% out/adj_rows_tail.json %%--out%% out/adj_rows_tail_final.json''. |
| |
| <code> | <code> |
| actions: keep=2, rescore=1, resource=3 | actions: keep=2, rescore=1, resource=3 |
| rows whose VERDICT changed: 1 (i.ua) | rows whose VERDICT changed: 1 (i.ua) |
| wrote /tmp/discard2.json (175 rows) | wrote out/adj_rows_tail_final.json (175 rows) |
| </code> | </code> |
| |
| ===== O. Unedited output: scripts/owner_random_sample.py re-run after the second pass ===== | ===== O. Unedited output: scripts/owner_random_sample.py re-run after the second pass ===== |
| |
| Run as ''python3 scripts/owner_random_sample.py --sample out/owner_sample.json --rows out/adj_rows_tail_final.json --table --wiki''. | Run as ''python3 scripts/owner_random_sample.py %%--sample%% out/owner_sample.json %%--rows%% out/adj_rows_tail_final.json %%--table%% %%--wiki%%''. |
| |
| <code> | <code> |
| ===== Q. Unedited output: scripts/report_tail_pass.py ===== | ===== Q. Unedited output: scripts/report_tail_pass.py ===== |
| |
| Run as ''python3 scripts/report_tail_pass.py --sample out/owner_sample.json --before out/adj_rows_scored.json --after out/adj_rows_tail_final.json --before-output out/owner_random_sample-output.txt --after-output out/owner_random_sample-tail-output.txt''. | Run as ''python3 scripts/report_tail_pass.py %%--sample%% out/owner_sample.json %%--before%% out/adj_rows_scored.json %%--after%% out/adj_rows_tail_final.json %%--before-output%% out/owner_random_sample-output.txt %%--after-output%% out/owner_random_sample-tail-output.txt''. |
| |
| <code> | <code> |
| * [[provenance:programming:crawler:webxray:random_sample]] — the first sitting's code: the draw, the estimator, the inter-rater pass. | * [[provenance:programming:crawler:webxray:random_sample]] — the first sitting's code: the draw, the estimator, the inter-rater pass. |
| * [[literature:corpus]] — corpus scope, the selection funnel, extraction stability. | * [[literature:corpus]] — corpus scope, the selection funnel, extraction stability. |
| | |
| | ===== Markup sweep, 2026-09-17 ===== |
| | |
| | Mechanical rendering repair only: a fresh live raw/XHTML export of 188 pages was checked with ''check_wrap.mjs'' and ''check_typography.mjs''. Affected plugin tags, CLI flags and heading markup were repaired; no figures or substantive prose were changed. The resulting source and rendered DOM were re-checked after saving. |
| |