Dataarchiveslink rot

How long does a link live?

We resolved 41,000 URLs cited in technology writing between 2010 and 2024. A quarter of them are already gone.

Rows of old books receding down a library shelf
Rows of old books receding down a library shelfUnsplash

A citation is a promise that someone else can check your work. We wanted to know how long that promise holds on the web, so we took every external URL cited in a corpus of 3,900 technology articles published between 2010 and 2024 — 41,208 links after deduplication — and tried to fetch all of them in May of this year.

Twenty-six per cent failed outright. Another nine per cent resolved to something that was not the cited document: a homepage, a paywall, a domain parked by a registrar, a “this content is no longer available” shell. So a little over a third of the evidentiary base of fifteen years of technology writing has quietly detached from the writing.

Share of cited links still resolving, by year of publicationLinks published in 2010 resolve 46 per cent of the time; links published in 2024 resolve 92 per cent of the time, with a steady decline as articles age.506070809020102012201420162018202020222024
Share of cited links still resolving, by year of publication
Year publishedStill resolving
201046
201253
201461
201668
201875
202081
202287
202492
Figure 1 Percentage of cited URLs still returning the original document in May 2026, by the year the citing article was published. The curve is roughly a half-life of nine years.

It is not evenly distributed

Institutional domains hold up. University pages, government records and the large newspapers cleared eighty per cent even in the oldest cohort. What died was everything else: personal sites, company blogs from companies that were acquired, documentation for products that were sunset, and — worst by a distance — anything hosted on a platform that has since shut down.

Link survival by host type, 2010 to 2016 cohortGovernment and university domains survive at 84 and 81 per cent. News organisations at 72, personal sites at 44, company blogs at 38 and defunct platforms at 6 per cent.020406080GovernmentUniversityNewsPersonalCompany blogDead platform84817244386
Link survival by host type, 2010 to 2016 cohort
Host typeStill resolving (%)
Government84
University81
News72
Personal44
Company blog38
Dead platform6
Figure 2 Survival rate for links published between 2010 and 2016, grouped by the kind of host they pointed at.

The web does not forget slowly and evenly. It forgets the independent parts first.

That last bar is the one that should worry anyone who writes for a living. Six per cent. An entire generation of technical writing — thoughtful, specific, often better than the coverage that survived — was published on services that no longer exist, and the citations pointing at it now point at nothing.

What a writer can actually do

Archive as you cite rather than as you remember to. Prefer a stable identifier where one exists. And quote generously in your own text, because your document is the only server in the chain that you control. A link is a promise about someone else’s infrastructure; a quotation is a promise about yours.

Quick answers

The short version

The questions readers send us about this piece, answered in a sentence or three.

What counts as a dead link in this analysis?

Any URL that returned a 4xx or 5xx status, failed to resolve, or redirected to a domain-level landing page rather than the cited document. That last category matters: roughly a third of our “dead” links technically return 200, they just return something else entirely.

Does the Internet Archive solve this?

Partly, and less than people assume. It had a usable capture for 61 per cent of the dead URLs in our sample. Coverage is far worse for anything behind a paywall, anything served from a single-page application, and anything that was only ever linked from one place.

What is the single most effective fix?

Quote the passage you are citing in your own text. A link is a pointer to someone else’s server and you control none of it; a quotation lives in your document. Everything else — archiving, DOIs, permalinks — helps, but only the quotation survives unconditionally.

Comments

Be the first to write in

No letters on this piece yet. The Ledger is a template, so comments are a placeholder — wire this block up to your own backend.