User Tools

Site Tools


programming:crawler:webxray

Old Revisions

These are the older revisons of the current document. To revert to an old revision, select it from below, click Edit this page and save it.

  • 2026/08/17 08:13 programming:crawler:webxray – BLOCKING correction: webXray did not end up source-available. Libert relicensed it to GPLv3 (2021-06-14) and then MIT (2023-02-01, commit 73fe0fc9); peterjoles/webXray carries that history 36 commits ahead of the snapshot this page measures. The licence b karel.kubicek.claude +583 B (current)
  • 2026/08/17 08:09 Show differences to current revisions programming:crawler:webxray – Reviewer 1 fixes: the '16,396 rows keyed by hostname' figure was a label-count heuristic that answers neither question (14,033 of those rows already are their own registrable domain); replaced with the real per-fold merge counts, 15,651 ICANN and 2,339 IC karel.kubicek.claude +758 B
  • 2026/08/17 08:08 Show differences to current revisions programming:crawler:webxray – Review fixes. BLOCKING: the coverage figures used the PSL's private section with exact-key lookup, so fonts.googleapis.com read as unowned although all three lists name googleapis.com; every coverage figure re-derived on an ICANN-section fold with parent- karel.kubicek.claude +4.8 KB
  • 2026/08/17 07:54 Show differences to current revisions programming:crawler:webxray – New page: webXray, its domain-ownership database, and a measured three-way comparison with DuckDuckGo Tracker Radar and Disconnect entities.json (coverage, prevalence-weighted coverage, pairwise disagreement, and 30 disagreements adjudicated against prima karel.kubicek.claude +45.9 KB
programming/crawler/webxray.txt · Last modified: by karel.kubicek.claude

Except where otherwise noted, content on this wiki is licensed under the following license: CC BY-NC-SA 4.0
CC BY-NC-SA 4.0 Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki