| |
| practices:public_relations [2026/08/18 15:41] – New page: how to present web-measurement results to journalists without overclaiming. Corpus-backed (5,859 papers): the denominator query, legal.foundViolations, and the near-total absence of documented press practice; three documented cases; imported pre karel.kubicek.claude | practices:public_relations [2026/08/21 14:50] (current) – Boxes: <wrap> renders a span, use uppercase <WRAP>; one box per list, not per bullet karel.kubicek.claude |
|---|
| So: **the extraction's ethics fields, over 4,472 papers, contain no description of how any of them handled their own results going public.** That is a statement about a 20-word structured field, and the right response to it is to go and read the papers. A separate sweep of the full text of all 5,869 files, with a deliberately broad self-reference regex, produced 80 candidates; **every one was read, and three survived** — one from 2023, one from 2024, one from 2026. The other 77 are the regex matching ''our median'' as ''our media'', //Mediatek//, "reporters" meaning users who file abuse reports, "dedicated website" meaning somebody else's, press releases in a reference list, and journalists as a study population rather than as an audience. | So: **the extraction's ethics fields, over 4,472 papers, contain no description of how any of them handled their own results going public.** That is a statement about a 20-word structured field, and the right response to it is to go and read the papers. A separate sweep of the full text of all 5,869 files, with a deliberately broad self-reference regex, produced 80 candidates; **every one was read, and three survived** — one from 2023, one from 2024, one from 2026. The other 77 are the regex matching ''our median'' as ''our media'', //Mediatek//, "reporters" meaning users who file abuse reports, "dedicated website" meaning somebody else's, press releases in a reference list, and journalists as a study population rather than as an audience. |
| |
| <wrap todo>**Three, not two — and the third was found by a reviewer, not by the sweep.** The first version of the regex demanded ''reporters (who|seeking|contacted|reached out)'' and so missed {[vlummens2026_bridges]}, which says "reporters asked" and thanks a colleague "for helping with media outreach" — and which has an entire //Public Disclosure// subsection, making it the best-documented case of the three. It was caught because a sibling page, [[Practices:Legal enforcement]], already cited the same paper for its disclosure timeline. The regex has been widened and the sweep re-run; the count went 59 → 80 candidates and 2 → 3 real hits. **Take the "three" as a floor, not a census**: a keyword sweep under-recalls by construction, and this one demonstrably did.</wrap> | <WRAP todo>**Three, not two — and the third was found by a reviewer, not by the sweep.** The first version of the regex demanded ''reporters (who|seeking|contacted|reached out)'' and so missed {[vlummens2026_bridges]}, which says "reporters asked" and thanks a colleague "for helping with media outreach" — and which has an entire //Public Disclosure// subsection, making it the best-documented case of the three. It was caught because a sibling page, [[Practices:Legal enforcement]], already cited the same paper for its disclosure timeline. The regex has been widened and the sweep re-run; the count went 59 → 80 candidates and 2 → 3 real hits. **Take the "three" as a floor, not a census**: a keyword sweep under-recalls by construction, and this one demonstrably did.</WRAP> |
| |
| <WRAP info> | <WRAP info> |
| | 2025–2026* | 2,217 | 44.2% | 2.1% | 21.9% | 51.3% (n=1,732) | | | 2025–2026* | 2,217 | 44.2% | 2.1% | 21.9% | 51.3% (n=1,732) | |
| |
| <wrap todo>* 2025–2026 is provisional: CCS 2026 and IMC 2026 have not been held, and IEEE S&P 2026 and TheWebConf 2026 abstracts are not in OpenAlex, so those venue-years are under-represented by construction. See [[Literature:Corpus]].</wrap> | <WRAP todo>* 2025–2026 is provisional: CCS 2026 and IMC 2026 have not been held, and IEEE S&P 2026 and TheWebConf 2026 abstracts are not in OpenAlex, so those venue-years are under-represented by construction. See [[Literature:Corpus]].</WRAP> |
| |
| The obvious explanation for the fall is that the field publishes more model-performance figures than it used to, and a precision score has no population to be a percentage of. The last two columns test that, and it is only part of the story: performance figures do rise from 12.9% to 21.9% of the sentences, **but denomination falls just as steeply within the sentences that are not performance figures** — 67.8% to 51.3%. Whatever is happening is happening to prevalence sentences too. | The obvious explanation for the fall is that the field publishes more model-performance figures than it used to, and a precision score has no population to be a percentage of. The last two columns test that, and it is only part of the story: performance figures do rise from 12.9% to 21.9% of the sentences, **but denomination falls just as steeply within the sentences that are not performance figures** — 67.8% to 51.3%. Whatever is happening is happening to prevalence sentences too. |
