Release v1.0.2 (2026-06-26): sync to live catalog (149 drives)
This commit is contained in:
deeddy
parent
27879ec941
commit
789f3b6c02
9 changed files with 28 additions and 24 deletions
25
README.md
25
README.md
|
|
@ -1,6 +1,6 @@
|
|||
# NAS drive dataset
|
||||
|
||||
An original dataset of NAS and enterprise hard drives: full specs, **CMR vs SMR classification**, and **annualized failure rates** derived from Backblaze Drive Stats. 153 drives.
|
||||
An original dataset of NAS and enterprise hard drives: full specs, **CMR vs SMR classification**, and **annualized failure rates** derived from Backblaze Drive Stats. 149 drives.
|
||||
|
||||
The core of this dataset - the CMR/SMR classification and drive specs - is our own original research, compiled from manufacturer datasheets and model-number analysis. Manufacturers do not publish a unified CMR/SMR list; we built one. The failure-rate column enriches it with rates derived from Backblaze's raw Drive Stats data (our computation, their underlying counts).
|
||||
|
||||
|
|
@ -12,11 +12,11 @@ Maintained at [nasdisks.com](https://www.nasdisks.com/), where the same data pow
|
|||
|
||||
| File | Rows | What it is |
|
||||
|------|------|------------|
|
||||
| [`data/drives-2026-06-21.csv`](data/drives-2026-06-21.csv) | 153 | The headline file: one flat row per drive, all specs and failure rate combined. |
|
||||
| [`data/drives-2026-06-21.json`](data/drives-2026-06-21.json) | 153 | The same rows as JSON (mirror of the live API). |
|
||||
| [`data/cmr-reference-2026-06-21.csv`](data/cmr-reference-2026-06-21.csv) | 149 | Source of truth for specs and CMR/SMR classification (including idle/seek noise and helium fill), with a per-row `confidence` flag. Our original research. |
|
||||
| [`data/backblaze-afr-2026-06-21.csv`](data/backblaze-afr-2026-06-21.csv) | 36 | Full-year 2025 annualized failure rates, computed from Backblaze raw Drive Stats. |
|
||||
| [`data/series-reliability-2026-06-21.csv`](data/series-reliability-2026-06-21.csv) | - | Manufacturer series specs (warranty, rated workload, MTBF) used as context where Backblaze has no data. |
|
||||
| [`data/drives-2026-06-26.csv`](data/drives-2026-06-26.csv) | 149 | The headline file: one flat row per drive, all specs and failure rate combined. |
|
||||
| [`data/drives-2026-06-26.json`](data/drives-2026-06-26.json) | 149 | The same rows as JSON (mirror of the live API). |
|
||||
| [`data/cmr-reference-2026-06-26.csv`](data/cmr-reference-2026-06-26.csv) | 149 | Source of truth for specs and CMR/SMR classification (including idle/seek noise and helium fill), with a per-row `confidence` flag. Our original research. |
|
||||
| [`data/backblaze-afr-2026-06-26.csv`](data/backblaze-afr-2026-06-26.csv) | 36 | Full-year 2025 annualized failure rates, computed from Backblaze raw Drive Stats. |
|
||||
| [`data/series-reliability-2026-06-26.csv`](data/series-reliability-2026-06-26.csv) | - | Manufacturer series specs (warranty, rated workload, MTBF) used as context where Backblaze has no data. |
|
||||
|
||||
## Quick start
|
||||
|
||||
|
|
@ -30,7 +30,7 @@ curl -s https://www.nasdisks.com/data/drives.json | jq '.drives[0]'
|
|||
curl -s https://www.nasdisks.com/data/drives.csv
|
||||
```
|
||||
|
||||
## Columns (`drives-2026-06-21.csv` / `drives-2026-06-21.json`)
|
||||
## Columns (`drives-2026-06-26.csv` / `drives-2026-06-26.json`)
|
||||
|
||||
| Column | Meaning |
|
||||
|--------|---------|
|
||||
|
|
@ -54,10 +54,10 @@ curl -s https://www.nasdisks.com/data/drives.csv
|
|||
|
||||
## Methodology
|
||||
|
||||
- **CMR vs SMR** is our original classification, built from manufacturer datasheets and model-number decoding. Manufacturers ship SMR drives into NAS lines without labelling them as such; this dataset exists because there was no single authoritative per-model reference. The `confidence` column in `cmr-reference-2026-06-21.csv` flags certainty per row.
|
||||
- **CMR vs SMR** is our original classification, built from manufacturer datasheets and model-number decoding. Manufacturers ship SMR drives into NAS lines without labelling them as such; this dataset exists because there was no single authoritative per-model reference. The `confidence` column in `cmr-reference-2026-06-26.csv` flags certainty per row.
|
||||
- **Noise and helium** are read from manufacturer datasheets (idle/seek A-weighted sound power; helium-seal designation). Our compilation; licensed CC BY 4.0 alongside the other specs.
|
||||
- **Failure rates** are computed from Backblaze's raw 2025 quarterly Drive Stats: we aggregate drive-days and failure counts across quarters into a single full-year annualized rate and validate against Backblaze's published fleet figure (~1.36% for 2025). The computation and methodology are ours; the underlying counts are Backblaze's (see licence section). Models Backblaze doesn't track are left null rather than guessed.
|
||||
- **`series-reliability-2026-06-21.csv`** gives manufacturer-rated context (warranty, workload TB/year, MTBF) for lines Backblaze doesn't run.
|
||||
- **`series-reliability-2026-06-26.csv`** gives manufacturer-rated context (warranty, workload TB/year, MTBF) for lines Backblaze doesn't run.
|
||||
|
||||
## Licence & attribution
|
||||
|
||||
|
|
@ -76,7 +76,7 @@ Our original work (every field *except* the failure-rate ones). Licensed under [
|
|||
|
||||
### 2. Failure-rate data - Backblaze's terms (NOT CC BY 4.0)
|
||||
|
||||
The fields `afr_pct`, `reliability_drive_count`, `reliability_drive_days`, `reliability_failures` (in `drives-2026-06-21.csv` / `drives-2026-06-21.json`) and all of `backblaze-afr-2026-06-21.csv` are derived from Backblaze Drive Stats. The computation is ours; the underlying counts are Backblaze's.
|
||||
The fields `afr_pct`, `reliability_drive_count`, `reliability_drive_days`, `reliability_failures` (in `drives-2026-06-26.csv` / `drives-2026-06-26.json`) and all of `backblaze-afr-2026-06-26.csv` are derived from Backblaze Drive Stats. The computation is ours; the underlying counts are Backblaze's.
|
||||
|
||||
- **You can:** use it for free, and build (and even sell) derivative works from it.
|
||||
- **You must:** credit Backblaze as the source.
|
||||
|
|
@ -89,5 +89,6 @@ This repo is a point-in-time snapshot; the date in each filename is its export d
|
|||
|
||||
## Changelog
|
||||
|
||||
- **2026-06-21** - Added per-drive noise (idle / seek A-weighted sound power, dB) and helium-fill fields. Corrected WD40EZAX / WD60EZAX to CMR (the newer EZAX revision is CMR; only the older EZAZ is SMR).
|
||||
- **2026-06-16** - Initial public dataset: full specs, CMR/SMR classification, and full-year 2025 Backblaze annualized failure rates.
|
||||
- **2026-06-26 - v1.0.2** - Refreshed to the current live catalog (149 drives); minor catalog reconciliation since v1.0.1.
|
||||
- **2026-06-21 - v1.0.1** - Added per-drive noise (idle/seek A-weighted sound power, dB) and helium fields. Corrected WD40EZAX / WD60EZAX to CMR (newer EZAX is CMR; only older EZAZ is SMR).
|
||||
- **2026-06-16 - v1.0.0** - Initial public dataset: full specs, CMR/SMR classification, full-year 2025 Backblaze annualized failure rates.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue