Measure The Web

User Tools

Site Tools

Trace:
privacy:requests

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
privacy:requests [2025/01/03 17:42] – Added discussion karelkubicekprivacy:requests [2025/10/09 07:18] (current) – [Programming: Using Lists] added adblock-rust karelkubicek
Line 21: Line 21:
  
   * DNS-blocking lists   * DNS-blocking lists
 +    * Some information can be found on [[design:website_classification|Website classification page]]
   * [[https://web.archive.org/web/20241231165520/https://help.adblockplus.org/hc/en-us/articles/360062733293-How-to-write-filters|AdBlock-syntax]] filters. The most established are [[https://easylist.to/index.html|EasyList filters]]:   * [[https://web.archive.org/web/20241231165520/https://help.adblockplus.org/hc/en-us/articles/360062733293-How-to-write-filters|AdBlock-syntax]] filters. The most established are [[https://easylist.to/index.html|EasyList filters]]:
     * **EasyList**: Blocks advertisements except for self-promotion (first-party ads such as featured articles). See the full [[https://easylist.to/pages/policy.html|policy]].     * **EasyList**: Blocks advertisements except for self-promotion (first-party ads such as featured articles). See the full [[https://easylist.to/pages/policy.html|policy]].
Line 28: Line 29:
       * 3rd-party tracking: Hosted by another provider hosting a tracking script but not actually a tracking company.       * 3rd-party tracking: Hosted by another provider hosting a tracking script but not actually a tracking company.
       * Tracking servers: Servers with the sole purpose of tracking/analyzing users are blocked at the URL level.       * Tracking servers: Servers with the sole purpose of tracking/analyzing users are blocked at the URL level.
 +  * [[https://spreadprivacy.com/duckduckgo-tracker-radar/|DuckDuckGo Tracker Radar]] automatically constructed list of tracking domains and their association with advertising industry vendors.
 +    * The included domains were identified by crawling the top sites on the Internet, and looking for 3rd party resource requests that are on several different sites which set cookies or access browser APIs known to be used in fingerprinting.
 +    * [[https://github.com/duckduckgo/tracker-radar/blob/main/docs/DATA_MODEL.md|Datamodel documentation]]
   * [[https://easylist.to/pages/other-supplementary-filter-lists-and-easylist-variants.html|Country-specific lists]]: Mostly block advertising.   * [[https://easylist.to/pages/other-supplementary-filter-lists-and-easylist-variants.html|Country-specific lists]]: Mostly block advertising.
   * Technology-specific lists:   * Technology-specific lists:
Line 43: Line 47:
   * [[https://github.com/scrapinghub/adblockparser|adblockparser]]:   * [[https://github.com/scrapinghub/adblockparser|adblockparser]]:
     * An older parser with some [[https://github.com/scrapinghub/adblockparser#limitations|limitations]].     * An older parser with some [[https://github.com/scrapinghub/adblockparser#limitations|limitations]].
 +  * [[https://github.com/brave/adblock-rust]]
 +    * Used by Brave, so it is frequently updated, supports uBlock parsing features
  
 The advantage of these libraries is that they can classify which resources would have been blocked in post-processing. You can run a crawl allowing all resources and later use the filters to analyze the data. The advantage of these libraries is that they can classify which resources would have been blocked in post-processing. You can run a crawl allowing all resources and later use the filters to analyze the data.
Line 80: Line 86:
  
 Additionally, it offers a [[https://github.com/uiowa-irl/Khaleesi?tab=readme-ov-file#browser-extension|Firefox extension]] that blocks advertising chains. While not directly suitable for crawls (the current implementation blocks requests), you can disable the functionality [[https://github.com/uiowa-irl/Khaleesi/blob/main/browser_extension/background/background.js#L52|here]] and collect logs to classify ads. Additionally, it offers a [[https://github.com/uiowa-irl/Khaleesi?tab=readme-ov-file#browser-extension|Firefox extension]] that blocks advertising chains. While not directly suitable for crawls (the current implementation blocks requests), you can disable the functionality [[https://github.com/uiowa-irl/Khaleesi/blob/main/browser_extension/background/background.js#L52|here]] and collect logs to classify ads.
 +
 +==== Classification of Link Decorators ====
 +
 +<wrap todo>TODO add PURL: Safe and Effective Sanitization of Link Decoration {[shaoor2024purl]}</wrap>
  
  
 ==== Classification of Cookie Notices and Their Interactive Elements ==== ==== Classification of Cookie Notices and Their Interactive Elements ====
  
-TODO+<wrap todo>TODO add Automated Large-Scale Analysis of Cookie Notice Compliance</wrap>
  
 ===== Use in Publications ===== ===== Use in Publications =====
  
-TODO+<wrap todo>TODO literature review</wrap>
  
 ====== References ====== ====== References ======
privacy/requests.1735926135.txt.gz · Last modified: by karelkubicek