fshy

fshy / Storage

HDX

humdata.org · Storage · 1 record · JSON

HDX — Humanitarian Data Exchange (UN OCHA) Storage

caveatemailno cardRwrite-gated

data.humdata.org/ · gov-igo-data-portal · storage/hdx-humanitarian-data-exchange · JSON · compare

Free tierNo published per-user or per-file quota anywhere in the docs. The platform hosts the files itself ('upload the data file directly to the HDX platform'), S3-backed. Aggregate catalog is 28,359 datasets and growing at organisational pace.
unit mixed; metered on unstated
Pricenone stated
Per-object capnot stated
Retentionnot stated
Egressunmetered public download. Direct GET on /dataset/<slug>/resource/<id>/download/<file>; no egress counter, no rate card, no CDN token. Files are anonymous to read — no login to download.
Identityemail email
Limits
  • write-gated reviewed by OCHA source
  • write-gated approval, not identity or payment source
write-gated: you must belong to an HDX organisation with publishing rights. Any registered user may REQUEST a new organisation (/org/request/new) and the request is human-reviewed by OCHA. So the gate is editorial approval, not identity or payment.
Bindingwrite-gated the write is a queue with a person or a rule in it, so the upload rate is set by somebody else
Interfaceunknown CKAN 2.x action API (package_search / package_create / resource_create) plus the hdx-python-api wrapper, which is the documented write path.
Toolingcurl + API token, or pip install hdx-python-api. Write operations need an API token from the user profile; token is per-user, free, issued on signup.
Composes withCKAN resource_create accepts a URL as well as a local file, so HDX can act as a metadata+mirror layer over another host. Public download URLs are stable and content-addressable by resource id — reasonable as a serving tier.
ReliabilityUN-operated, 10+ years of uptime, but editorial review means a rejection is silent and unbounded — no SLA on org approval, and an org can be removed for content outside humanitarian scope. Do not treat as primary durable storage.
NotesNo published per-user or per-file quota anywhere in the docs. The platform hosts the files itself ('upload the data file directly to the HDX platform'), S3-backed. Aggregate catalog is 28,359 datasets and growing at organisational pace.
Evidence rungreported One page read moves it to documented.
Checked2026-10-21 (inherited); stale on 2026-11-04
Evidence (4)
datesourcewhat it proved
2026-10-21docs.humdata.org/publish/publish-data/organizations-on-hdx'Only registered users can request to create a new organization. Open: https://data.humdata.org/org/request/new. If you are not logged in, you will see an error page.'
2026-10-21docs.humdata.org/publish/publish-data/preparing-and-publishi'To publish manually, you will need to upload the data file directly to the HDX platform... you must be logged in and belong to an HDX organization with publishing permissions.'
2026-10-21data.humdata.org/api/3/action/package_search?rows=0HTTP 200, success:true, count 28359, i.e. the CKAN write API family is live on the same host
2026-10-21docs.humdata.org/build/hdx-python-library'Your organization must exist on HDX, and you need to be an editor or admin of it' — confirms programmatic publish is real, not UI-only
Unknown or withheld values (6)
  • $.free_tier.notes process
  • $.interface interface-unknown
  • $.per_object_cap.notes not-extracted
  • $.per_object_cap.stated not-extracted
  • $.retention.notes not-extracted
  • $.retention.stated not-extracted