{
  "schema_version": "1.0",
  "id": "archive:https://openai.com/index/core-dump-epidemiology-data-infrastructure-bug",
  "slug": "core-dump-epidemiology-data-infrastructure-bug-1vwhgy3",
  "url": "https://feed7.dev/p/core-dump-epidemiology-data-infrastructure-bug-1vwhgy3",
  "title": "Core dump epidemiology: fixing an 18-year-old bug",
  "why_included": "OpenAI debugged rare infrastructure crashes by analyzing core dumps at fleet scale, tracing them to a hardware fault plus an 18-year-old software bug. A useful pattern for hunting non-reproducible failures.",
  "summary": "**The gist** OpenAI engineers ran **large-scale core dump analysis** — treating crashes as an epidemiology problem — to chase rare failures in their data infrastructure. The hunt surfaced two root causes: a **hardware fault** and a software bug that had survived for **18 years**.",
  "practical_implication": "**Why it matters** The method is the takeaway: when a crash is too rare to reproduce, aggregating **core dumps across a fleet** turns anecdotes into statistics you can correlate against hardware, kernel, and workload. The pattern scales down to any team running enough machines for **rare, non-reproducible failures** to show up.",
  "agent_context": "**The gist** OpenAI engineers ran **large-scale core dump analysis** — treating crashes as an epidemiology problem — to chase rare failures in their data infrastructure. The hunt surfaced two root causes: a **hardware fault** and a software bug that had survived for **18 years**.\n\n**Why it matters** The method is the takeaway: when a crash is too rare to reproduce, aggregating **core dumps across a fleet** turns anecdotes into statistics you can correlate against hardware, kernel, and workload. The pattern scales down to any team running enough machines for **rare, non-reproducible failures** to show up.\n\n**Watch out** The article couldn't be fetched, so the specifics — **which component** hosted the 18-year-old bug, the tooling used, and whether fixes were upstreamed — aren't covered here; read the original for the actual diagnosis.",
  "source": {
    "name": "OpenAI",
    "url": "https://openai.com/index/core-dump-epidemiology-data-infrastructure-bug",
    "published_at": null
  },
  "source_class": "blog_post",
  "content_type": "Official Release",
  "layer": "infra",
  "domains": [
    "data"
  ],
  "topics": [
    "observability"
  ],
  "verification": {
    "status": "official_source",
    "label": "Official Source",
    "method": "source_feed",
    "verified_at": null
  },
  "uncertainty": [
    "The article couldn't be fetched, so the specifics — **which component** hosted the 18-year-old bug, the tooling used, and whether fixes were upstreamed — aren't covered here; read the original for the actual diagnosis."
  ],
  "lifecycle": "Current",
  "published_at": null,
  "modified_at": null,
  "supersedes": [],
  "expires_at": null,
  "formats": {
    "html": "https://feed7.dev/p/core-dump-epidemiology-data-infrastructure-bug-1vwhgy3",
    "json": "https://feed7.dev/p/core-dump-epidemiology-data-infrastructure-bug-1vwhgy3.json",
    "markdown": "https://feed7.dev/p/core-dump-epidemiology-data-infrastructure-bug-1vwhgy3.md"
  }
}