User Tools

Site Tools


programming:tranco

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision
Previous revision
programming:tranco [2026/08/27 11:19] – Create programming:tranco (API/construction). Authored by Claude. karel.kubicek.claudeprogramming:tranco [2026/09/17 09:18] (current) – Add 2023-07-31 W9ZN9 row from dated API; Authored by Claude karel.kubicek.claude
Line 18: Line 18:
   * {[LePochat2019_tranco]} — why a single-source top list is a bad sampling frame, and the original design (Dowdall over 30 days, filters, permanent ids). Read it for the problem, not for today's inputs.   * {[LePochat2019_tranco]} — why a single-source top list is a bad sampling frame, and the original design (Dowdall over 30 days, filters, permanent ids). Read it for the problem, not for today's inputs.
   * {[LePochat2019_tranco_eval]} — CSET 2019, **outside this corpus**. One year of lists, and what the generator's parameters actually do to stability and composition. That is the paper for a custom list.   * {[LePochat2019_tranco_eval]} — CSET 2019, **outside this corpus**. One year of lists, and what the generator's parameters actually do to stability and composition. That is the paper for a custom list.
-  * {[ruth2022_toppling]} — measured the lists against Cloudflare resolver traffic in February 2022. CrUX was the most accurate; Tranco is an aggregate, not a ground truth. CrUX was folded into Tranco's default list on 1 August 2023, so the comparison has not been re-run on the instrument you download today.+  * {[ruth2022_toppling]} — measured the lists against Cloudflare's server-side HTTP request logs in February 2022. CrUX was the most accurate; Tranco is an aggregate, not a ground truth. CrUX was folded into Tranco's default list on 1 August 2023, so the comparison has not been re-run on the instrument you download today.
  
 ===== The default list, today ===== ===== The default list, today =====
Line 59: Line 59:
 | 2022-01-01 | ''XVWN'' | Alexa, Umbrella, Majestic | full | | 2022-01-01 | ''XVWN'' | Alexa, Umbrella, Majestic | full |
 | 2022-05-01 | ''W9339'' | Alexa, Umbrella, Majestic, Farsight | full | | 2022-05-01 | ''W9339'' | Alexa, Umbrella, Majestic, Farsight | full |
 +| 2023-07-31 | ''W9ZN9'' | Alexa, Umbrella, Majestic, Farsight | full |
 | 2023-08-01 | ''25299'' | CrUX, Farsight, Majestic, Radar, Umbrella | 1,000,000 | | 2023-08-01 | ''25299'' | CrUX, Farsight, Majestic, Radar, Umbrella | 1,000,000 |
 | 2026-08-26 | ''46W9X'' | same five | 1,000,000 | | 2026-08-26 | ''46W9X'' | same five | 1,000,000 |
  
-Quantcast dropped out after 1 April 2020; Farsight joined on 1 May 2022; Alexa was replaced by CrUX and Cloudflare Radar on 1 August 2023, which is also when the default prefix stopped being ''full'' and became one million.((Tranco's own front page, "Updates", and the dated API objects above, all checked 2026-08-27.)) You cannot resurrect a retired provider. A custom list can still **name** ''alexa'' and ''quantcast'' in the API schema — they are in the documented enum — but they are not in the default list, and Farsight, which **is** in the default list, is **not** in that enum.+Quantcast dropped out after 1 April 2020; Farsight joined on 1 May 2022; Alexa was replaced by CrUX and Cloudflare Radar on 1 August 2023, which is also when the default prefix stopped being ''full'' and became one million.((Tranco's own front page, "Updates", and the dated API objects above; the 2023-07-31 row was checked 2026-09-17, while the other rows were checked 2026-08-27.)) You cannot resurrect a retired provider. A custom list can still **name** ''alexa'' and ''quantcast'' in the API schema — they are in the documented enum — but they are not in the default list, and Farsight, which **is** in the default list, is **not** in that enum.
  
 **Farsight is default-list-only.** The homepage says so ("only for the default list"), and the [[https://tranco-list.eu/api_documentation|API documentation]]'s ''Configuration.providers'' enum is ''crux | majestic | radar | umbrella | alexa | quantcast''. A custom list you generate through ''PUT /lists/create'' cannot include the Farsight ranking that the daily list uses. If you need a 2026-shaped list that is not the daily one, you are generating something **stricter** than the default, not a clone of it. **Farsight is default-list-only.** The homepage says so ("only for the default list"), and the [[https://tranco-list.eu/api_documentation|API documentation]]'s ''Configuration.providers'' enum is ''crux | majestic | radar | umbrella | alexa | quantcast''. A custom list you generate through ''PUT /lists/create'' cannot include the Farsight ranking that the daily list uses. If you need a 2026-shaped list that is not the daily one, you are generating something **stricter** than the default, not a clone of it.
  
-Licences on the current default inputs, as Tranco states them: Umbrella free of charge; Majestic CC BY 3.0; CrUX CC BY-SA 4.0; Cloudflare Radar **CC BY-NC 4.0**; Farsight used only in the default list. Radar's non-commercial clause is the one that bites if you ship the default list as part of a product. Tranco is not affiliated with the providers.+Licences on the current default inputs, as Tranco states them on its homepage (fetched 2026-08-27): Umbrella free of charge; Majestic CC BY 3.0; CrUX **CC BY-SA 4.0**; Cloudflare Radar **CC BY-NC 4.0**; Farsight used only in the default list. The methodology page does not restate those licences. Google's own CrUX methodology (fetched 2026-08-27) licences the datasets **CC BY 4.0**, not CC BY-SA — use that when you cite CrUX directly. Radar's non-commercial clause is the one that bites if you ship the default list as part of a product. Tranco is not affiliated with the providers.
  
 The public GitHub repository ([[https://github.com/DistriNet/tranco-list|DistriNet/tranco-list]]) still has ''DEFAULT_TRANCO_CONFIG'' as Alexa + Umbrella + Majestic + Quantcast, ''listPrefix: full''. Last push: **2020-03-05**. It is the 2019 generator, not the live service. Do not read the current default out of that file. The public GitHub repository ([[https://github.com/DistriNet/tranco-list|DistriNet/tranco-list]]) still has ''DEFAULT_TRANCO_CONFIG'' as Alexa + Umbrella + Majestic + Quantcast, ''listPrefix: full''. Last push: **2020-03-05**. It is the 2019 generator, not the live service. Do not read the current default out of that file.
Line 260: Line 261:
 </file> </file>
  
-Real output, ''python3 pin_tranco.py --prefix 20'', run on 2026-08-27 against list ''46W9X''. The five ''head'' objects are reflowed to one line each here; everything else is verbatim, including the SHA-256 of those 20 CSV rows (325 bytes):+Real output, ''python3 pin_tranco.py %%--prefix%% 20'', run on 2026-08-27 against list ''46W9X''. The five ''head'' objects are reflowed to one line each here; everything else is verbatim, including the SHA-256 of those 20 CSV rows (325 bytes):
  
 <code> <code>
Line 359: Line 360:
   * [[Design:Longitudinal]] — provider-set changes as a comparability problem.   * [[Design:Longitudinal]] — provider-set changes as a comparability problem.
   * [[Programming:CrUX]] — the page-load ranking that is now inside the default list. Not yet written.   * [[Programming:CrUX]] — the page-load ranking that is now inside the default list. Not yet written.
-  * [[Programming:Cloudflare Radar]] — the other 2023 addition; also not yet written. Radar's own buckets are coarser than a Tranco rank.+  * [[Programming:Cloudflare Radar]] — the other 2023 addition. Radar's own buckets are coarser than a Tranco rank.
   * [[Literature:Corpus]] — seven-venue scope and the 2025–2026 edge.   * [[Literature:Corpus]] — seven-venue scope and the 2025–2026 edge.
  
programming/tranco.1787829555.txt.gz · Last modified: by karel.kubicek.claude