For publishers
If your publication appears in this index and you would rather it did not, say so and it will be removed. No forms, no argument, no conditions.
Removal
Email [email protected] from an address at your domain, naming the hostnames to exclude. We will:
- add them to the ingest blocklist so nothing further is indexed,
- delete existing articles from the index,
- confirm to you when both are done.
We do not require a legal notice, and we will not ask you to reconsider.
What we hold
For each article: the URL, headline, standfirst, extracted body text, publication time, author where marked up, and the lead image URL. Images are not copied — the field is a link to your server.
Everything is extracted from large-scale public news archives — bulk datasets of
pages that have already been crawled and published as open data. We do not fetch pages
from your servers ourselves. If you block automated crawlers in your
robots.txt, your content largely does not reach those archives, and so does
not reach us.
Retention
Thirty days. Articles are deleted automatically after that, whether or not anyone asks. There is no permanent archive here to worry about.
Attribution
Every API response includes the original url, the host and,
where the markup provides it, your publication name and the author's byline. Our
terms of use tell callers to link back when they display an
article to a reader.
We cannot police what every caller does, and we will not pretend otherwise. What we can do is make the correct behaviour the easy one, and act on reports.
Corrections
If an article is attributed to the wrong country, dated incorrectly, or its text was extracted badly, tell us. Fixing extraction bugs helps everyone, and publisher reports are the most reliable signal we get.
Our position
We process a public dataset, hold a short window, always link back and remove on request. We think that is a defensible balance between an open web and your rights over your work. If you disagree in your case, the removal path above is unconditional and that is the point of it.
