From 6f643ffe2a70bb4d2f7f503e854a6dc0eb348fdc Mon Sep 17 00:00:00 2001 From: deeddy Date: Tue, 16 Jun 2026 11:59:11 +0200 Subject: [PATCH] docs: date snapshot files, add /data link + staleness notice --- README.md | 26 ++++++++++--------- ...e-afr.csv => backblaze-afr-2026-06-16.csv} | 0 ...rence.csv => cmr-reference-2026-06-16.csv} | 0 data/{drives.csv => drives-2026-06-16.csv} | 0 data/{drives.json => drives-2026-06-16.json} | 0 ....csv => series-reliability-2026-06-16.csv} | 0 6 files changed, 14 insertions(+), 12 deletions(-) rename data/{backblaze-afr.csv => backblaze-afr-2026-06-16.csv} (100%) rename data/{cmr-reference.csv => cmr-reference-2026-06-16.csv} (100%) rename data/{drives.csv => drives-2026-06-16.csv} (100%) rename data/{drives.json => drives-2026-06-16.json} (100%) rename data/{series-reliability.csv => series-reliability-2026-06-16.csv} (100%) diff --git a/README.md b/README.md index 8abcea6..b22ce19 100644 --- a/README.md +++ b/README.md @@ -2,17 +2,19 @@ An open dataset of NAS hard drives: full specs, **CMR vs SMR**, and real-world **Backblaze annualized failure rates (AFR)**. 140+ drives, with a measured failure rate for the models Backblaze tracks. Our drive specs and CMR/SMR data are free to use - including commercially - under [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) with credit; the Backblaze failure-rate fields stay under [Backblaze's own terms](#licence--attribution) (cite Backblaze; don't sell the data itself). -Maintained at [nasdisks.com](https://www.nasdisks.com), where the same data drives a live price comparison across seven Amazon regions. +Maintained at [nasdisks.com](https://www.nasdisks.com/), where the same data powers a [live, browsable dataset](https://www.nasdisks.com/data/) and a price comparison across seven Amazon regions. + +> **These files are a dated snapshot and may be out of date.** The current, always-up-to-date dataset lives at **[nasdisks.com/data/](https://www.nasdisks.com/data/)** - download the latest there, or call the CORS-enabled endpoints below. Each file in `data/` carries its export date in the filename so you always know how old your copy is. ## What's inside | File | Rows | What it is | |------|------|------------| -| [`data/drives.csv`](data/drives.csv) | 140+ | The headline file: one flat row per drive, specs joined to failure rate. | -| [`data/drives.json`](data/drives.json) | 140+ | The same rows as JSON (mirror of the live API). | -| [`data/cmr-reference.csv`](data/cmr-reference.csv) | 140+ | Source of truth for specs + CMR/SMR classification, with a per-row `confidence` flag. | -| [`data/backblaze-afr.csv`](data/backblaze-afr.csv) | 36 | Full-year 2025 Backblaze failure rates per model (the models Backblaze runs at scale). | -| [`data/series-reliability.csv`](data/series-reliability.csv) | - | Manufacturer series specs (warranty, rated workload, MTBF) used as context where Backblaze has no data. | +| [`data/drives-2026-06-16.csv`](data/drives-2026-06-16.csv) | 140+ | The headline file: one flat row per drive, specs joined to failure rate. | +| [`data/drives-2026-06-16.json`](data/drives-2026-06-16.json) | 140+ | The same rows as JSON (mirror of the live API). | +| [`data/cmr-reference-2026-06-16.csv`](data/cmr-reference-2026-06-16.csv) | 140+ | Source of truth for specs + CMR/SMR classification, with a per-row `confidence` flag. | +| [`data/backblaze-afr-2026-06-16.csv`](data/backblaze-afr-2026-06-16.csv) | 36 | Full-year 2025 Backblaze failure rates per model (the models Backblaze runs at scale). | +| [`data/series-reliability-2026-06-16.csv`](data/series-reliability-2026-06-16.csv) | - | Manufacturer series specs (warranty, rated workload, MTBF) used as context where Backblaze has no data. | ## Quick start @@ -26,7 +28,7 @@ curl -s https://www.nasdisks.com/data/drives.json | jq '.drives[0]' curl -s https://www.nasdisks.com/data/drives.csv ``` -## Columns (`drives.csv` / `drives.json`) +## Columns (`drives-2026-06-16.csv` / `drives-2026-06-16.json`) | Column | Meaning | |--------|---------| @@ -47,9 +49,9 @@ curl -s https://www.nasdisks.com/data/drives.csv ## Methodology -- **CMR vs SMR** is classified from manufacturer datasheets and model-number decoding. SMR drives shingle their tracks, which cripples random-write and RAID-rebuild performance, so the distinction is the single most important spec for a NAS - and manufacturers do not always advertise it. The `confidence` column in `cmr-reference.csv` flags how certain each call is. +- **CMR vs SMR** is classified from manufacturer datasheets and model-number decoding. SMR drives shingle their tracks, which cripples random-write and RAID-rebuild performance, so the distinction is the single most important spec for a NAS - and manufacturers do not always advertise it. The `confidence` column in `cmr-reference-2026-06-16.csv` flags how certain each call is. - **Failure rates** are computed from Backblaze's raw 2025 quarterly Drive Stats, aggregated to a full-year annualized rate and validated against Backblaze's own published fleet figure (~1.36% for 2025). Only the catalog models that exactly match a Backblaze-tracked model carry an `afr_pct`; the rest are left null rather than guessed. -- **`series-reliability.csv`** gives manufacturer-rated context (warranty years, workload TB/year, MTBF) for lines Backblaze doesn't run, so you have *something* to reason about beyond a blank cell. +- **`series-reliability-2026-06-16.csv`** gives manufacturer-rated context (warranty years, workload TB/year, MTBF) for lines Backblaze doesn't run, so you have *something* to reason about beyond a blank cell. ## Licence & attribution @@ -64,11 +66,11 @@ Our own work (every field *except* the failure-rate ones). Licensed under [Creat ``` Drive specs & CMR/SMR by nasdisks.com, CC BY 4.0 ``` - A link back to https://www.nasdisks.com is enough. + A link back to https://www.nasdisks.com/ is enough. ### 2. Failure-rate data - Backblaze's terms (NOT CC BY 4.0) -The fields `afr_pct`, `reliability_drive_count`, `reliability_drive_days`, `reliability_failures` (in `drives.csv` / `drives.json`) and all of `backblaze-afr.csv` come from Backblaze Drive Stats. +The fields `afr_pct`, `reliability_drive_count`, `reliability_drive_days`, `reliability_failures` (in `drives-2026-06-16.csv` / `drives-2026-06-16.json`) and all of `backblaze-afr-2026-06-16.csv` come from Backblaze Drive Stats. - **You can:** use it for free, and build (and even sell) derivative works from it. - **You must:** credit Backblaze as the source. @@ -77,4 +79,4 @@ The fields `afr_pct`, `reliability_drive_count`, `reliability_drive_days`, `reli ## Updates -The dataset is refreshed as the catalogue and Backblaze data change. The live endpoints above always reflect the current state; this repo is re-exported periodically. +This repo is a point-in-time snapshot; the date in each filename is its export date and it can fall behind. For current data use [nasdisks.com/data/](https://www.nasdisks.com/data/) or the endpoints above, which always reflect the latest catalogue and Backblaze figures. diff --git a/data/backblaze-afr.csv b/data/backblaze-afr-2026-06-16.csv similarity index 100% rename from data/backblaze-afr.csv rename to data/backblaze-afr-2026-06-16.csv diff --git a/data/cmr-reference.csv b/data/cmr-reference-2026-06-16.csv similarity index 100% rename from data/cmr-reference.csv rename to data/cmr-reference-2026-06-16.csv diff --git a/data/drives.csv b/data/drives-2026-06-16.csv similarity index 100% rename from data/drives.csv rename to data/drives-2026-06-16.csv diff --git a/data/drives.json b/data/drives-2026-06-16.json similarity index 100% rename from data/drives.json rename to data/drives-2026-06-16.json diff --git a/data/series-reliability.csv b/data/series-reliability-2026-06-16.csv similarity index 100% rename from data/series-reliability.csv rename to data/series-reliability-2026-06-16.csv