User Tools

Site Tools


provenance:programming:crawler:webxray:residue_pass

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
provenance:programming:crawler:webxray:residue_pass [2026/09/11 22:43] – Refresh check_tail_figures.py (derives the hand-changed verdict count from the corrections output and asserts the superseded one absent) and the mutation harness, now 24 mutations, 0 survivors. Authored by Claude karel.kubicek.claudeprovenance:programming:crawler:webxray:residue_pass [2026/09/17 07:24] (current) – Markup rendering sweep: wrap escapes, CLI flag typography, and heading quotes. Authored by Claude. karel.kubicek.claude
Line 20: Line 20:
  
 **Why this is a third page.** These blocks are 392 kB and the **Why this is a third page.** These blocks are 392 kB and the
-random-sample appendix's are already 286 kB; putting them together would +random-sample appendix's are already 289 kB; putting them together would 
-make one 678 kB page carrying two probe logs. Both figures are computed+make one 681 kB page carrying two probe logs. Both figures are computed
 when this page is generated, from the same file lists the two manifests use, so when this page is generated, from the same file lists the two manifests use, so
 neither can go stale while the other moves. That page's own "why this is a neither can go stale while the other moves. That page's own "why this is a
Line 51: Line 51:
 | J | ''out/check_tail_merge_mutations-output.txt'' | 1,142 | ''ebb83f0c555d0527'' | no | | J | ''out/check_tail_merge_mutations-output.txt'' | 1,142 | ''ebb83f0c555d0527'' | no |
 | K | ''out/tail_probe.txt'' | 177,214 | ''5f487708ad8b7ba9'' | **yes** — one lone CR normalised to LF | | K | ''out/tail_probe.txt'' | 177,214 | ''5f487708ad8b7ba9'' | **yes** — one lone CR normalised to LF |
-| L | ''out/owner_tail_merge-output.txt'' | 1,042 | ''b1fe634a350c43bc'' | no |+| L | ''out/owner_tail_merge-output.txt'' | 1,042 | ''d6c7dcdf4535daa7'' | no |
 | M | ''out/tail_verify-output.txt'' | 2,512 | ''f772acd997a598d8'' | no | | M | ''out/tail_verify-output.txt'' | 2,512 | ''f772acd997a598d8'' | no |
-| N | ''out/owner_tail_corrections-output.txt'' | 6,659 | ''df43d5b6edba64dd'' | no |+| N | ''out/owner_tail_corrections-output.txt'' | 6,669 | ''808c2387aea5a34c'' | no |
 | O | ''out/owner_random_sample-tail-output.txt'' | 52,594 | ''f46dd7c6f37fb231'' | no | | O | ''out/owner_random_sample-tail-output.txt'' | 52,594 | ''f46dd7c6f37fb231'' | no |
 | P | ''out/owner_random_sample-tail.diff'' | 63,634 | ''07ae04745a451e50'' | no | | P | ''out/owner_random_sample-tail.diff'' | 63,634 | ''07ae04745a451e50'' | no |
Line 4136: Line 4136:
 ===== L. Unedited output: scripts/owner_tail_merge.py ===== ===== L. Unedited output: scripts/owner_tail_merge.py =====
  
-Run as ''python3 scripts/owner_tail_merge.py --sample out/owner_sample.json --base out/adj_rows_scored.json --tail out/tail40.json --dir out/tail_adj --out out/adj_rows_tail.json''.+Run as ''python3 scripts/owner_tail_merge.py %%--sample%% out/owner_sample.json %%--base%% out/adj_rows_scored.json %%--tail%% out/tail40.json %%--dir%% out/tail_adj %%--out%% out/adj_rows_tail.json''.
  
 <code> <code>
Line 4160: Line 4160:
   archived-legal           2   archived-legal           2
  
-wrote /tmp/discard_rows.json (175 rows)+wrote out/adj_rows_tail.json (175 rows)
 </code> </code>
  
 ===== M. Unedited output: scripts/owner_verify_sources.py on the second pass's rows ===== ===== M. Unedited output: scripts/owner_verify_sources.py on the second pass's rows =====
  
-Run as ''python3 scripts/owner_verify_sources.py --rows out/tail_rows_only.json --cache out/tail_verify_cache --out out/tail_verify.json''.+Run as ''python3 scripts/owner_verify_sources.py %%--rows%% out/tail_rows_only.json %%--cache%% out/tail_verify_cache %%--out%% out/tail_verify.json''.
  
 <code> <code>
Line 4201: Line 4201:
 ===== N. Unedited output: scripts/owner_tail_corrections.py ===== ===== N. Unedited output: scripts/owner_tail_corrections.py =====
  
-Run as ''python3 scripts/owner_tail_corrections.py --rows out/adj_rows_tail.json --out out/adj_rows_tail_final.json''.+Run as ''python3 scripts/owner_tail_corrections.py %%--rows%% out/adj_rows_tail.json %%--out%% out/adj_rows_tail_final.json''.
  
 <code> <code>
Line 4257: Line 4257:
 actions: keep=2, rescore=1, resource=3 actions: keep=2, rescore=1, resource=3
 rows whose VERDICT changed: 1 (i.ua) rows whose VERDICT changed: 1 (i.ua)
-wrote /tmp/discard2.json (175 rows)+wrote out/adj_rows_tail_final.json (175 rows)
 </code> </code>
  
 ===== O. Unedited output: scripts/owner_random_sample.py re-run after the second pass ===== ===== O. Unedited output: scripts/owner_random_sample.py re-run after the second pass =====
  
-Run as ''python3 scripts/owner_random_sample.py --sample out/owner_sample.json --rows out/adj_rows_tail_final.json --table --wiki''.+Run as ''python3 scripts/owner_random_sample.py %%--sample%% out/owner_sample.json %%--rows%% out/adj_rows_tail_final.json %%--table%% %%--wiki%%''.
  
 <code> <code>
Line 4994: Line 4994:
 ===== Q. Unedited output: scripts/report_tail_pass.py ===== ===== Q. Unedited output: scripts/report_tail_pass.py =====
  
-Run as ''python3 scripts/report_tail_pass.py --sample out/owner_sample.json --before out/adj_rows_scored.json --after out/adj_rows_tail_final.json --before-output out/owner_random_sample-output.txt --after-output out/owner_random_sample-tail-output.txt''.+Run as ''python3 scripts/report_tail_pass.py %%--sample%% out/owner_sample.json %%--before%% out/adj_rows_scored.json %%--after%% out/adj_rows_tail_final.json %%--before-output%% out/owner_random_sample-output.txt %%--after-output%% out/owner_random_sample-tail-output.txt''.
  
 <code> <code>
Line 5244: Line 5244:
   * [[provenance:programming:crawler:webxray:random_sample]] — the first sitting's code: the draw, the estimator, the inter-rater pass.   * [[provenance:programming:crawler:webxray:random_sample]] — the first sitting's code: the draw, the estimator, the inter-rater pass.
   * [[literature:corpus]] — corpus scope, the selection funnel, extraction stability.   * [[literature:corpus]] — corpus scope, the selection funnel, extraction stability.
 +
 +===== Markup sweep, 2026-09-17 =====
 +
 +Mechanical rendering repair only: a fresh live raw/XHTML export of 188 pages was checked with ''check_wrap.mjs'' and ''check_typography.mjs''. Affected plugin tags, CLI flags and heading markup were repaired; no figures or substantive prose were changed. The resulting source and rendered DOM were re-checked after saving.
  
provenance/programming/crawler/webxray/residue_pass.1789166601.txt.gz · Last modified: by karel.kubicek.claude