{"eid":"dataverse-harvard-edu","name":"Harvard Dataverse","domain":"dataverse.harvard.edu","resolved_by":"host","topics":["storage"],"n_records":2,"best_vorder":0,"review":null,"aliases":["Harvard Dataverse","Harvard Dataverse Repository - per-collection quota (the multiplier, not the 1 TB headline)","dataverse.harvard.edu"],"records":[{"rid":"storage/harvard-dataverse-repository-per-collection-quota","card":{"rid":"storage/harvard-dataverse-repository-per-collection-quota","eid":"dataverse-harvard-edu","topic":"storage","slug":"harvard-dataverse-repository-per-collection-quota","provider":"Harvard Dataverse Repository - per-collection quota (the multiplier, not the 1 TB headline)","url":"https://dataverse.harvard.edu/","domain":"harvard.edu","category":"academic","tier":null,"verdict":"qualifies","vorder":0,"grp":"usable","confidence":"reported","binding":"per-object-cap","identity_kind":"email","identity_basis":"stated","needs_card":0,"needs_phone":0,"needs_id":0,"needs_institution":0,"country":null,"crypto":null,"interfaces":"s3,rest,rclone,cli","egress_metered":0,"per_object_bytes":2500000000,"retention_days":null,"verified_at":"2026-10-21T00:00:00.000Z","verified_basis":"inherited","checked_on":"2026-10-21","stale_on":"2026-11-04","n_evidence":7,"usd_month":null,"usd_per_tb_month":null,"summary":"1 TB per Dataverse Collection allocation (2.5 TB for Harvard affiliates). Per-file 2.5 GB through UI/API; larger via the S3 direct-upload path. The 1 TB is e...","duplicate_of":null,"n_unknown":3},"record":{"topic":"storage","slug":"harvard-dataverse-repository-per-collection-quota","provider":"Harvard Dataverse Repository - per-collection quota (the multiplier, not the 1 TB headline)","url":"https://dataverse.harvard.edu/","category":"academic","free_tier":{"stated":"1 TB per Dataverse Collection allocation (2.5 TB for Harvard affiliates). Per-file 2.5 GB through UI/API; larger via the S3 direct-upload path. The 1 TB is enforced as a *collection* allocation, not a per-person cap: GET /api/dataverses/<alias>/storage/quota?showInherited=true returns {\"Total quota allocation for this collection\": 1099511627776} for ordinary collections, and one live collection returns 2748779069440 (2.5 TB).","unit":"TB","metered_on":"stored-bytes","source_url":"https://support.dataverse.harvard.edu/researchers","read_on":"2026-10-21","notes":null},"per_object_cap":{"stated":"Per-file 2.5 GB","bytes":2500000000,"source_url":"https://support.dataverse.harvard.edu/researchers","notes":"not stated"},"retention":{"stated":"| write-once: publishing is irreversible, no delete without support intervention, no embargo; 'Submit for Review' spam screen before publication; per-file 2.5 GB in the browser path; 1,000 files/dataset is the observed effectiveDatasetFileCountLimit; S3 direct upload is admin-enabled per install and is the only route past the 2.5 GB file cap.","source_url":"https://support.dataverse.harvard.edu/researchers","notes":"not stated"},"egress":{"terms":"Free, anonymous, no login: GET /api/access/datafile/<id> returns 303 to a signed dvn-cloud-iqss S3 URL (X-Amz-Expires=3600), which serves 200 with Content-Length and honours Range (206 + Content-Range).","metered":false},"interface":["s3","rest","rclone","cli"],"interface_detail":"rest","tooling":"REST native API (create dataset, add files, direct S3 upload), plus the official Python/CLI clients. dataset count 306,027 live. rclone has no native backend but the S3 direct-upload path accepts any S3 client.","chaining":"This is the wave-8 correction: quota attaches to the COLLECTION, and any logged-in user can create collections again since June 2024 (restriction imposed Nov 2022 in IQSS/dataverse.harvard.edu#199 was lifted; #207 comment 2024-07-24: 'Anyone can create collections in Harvard Dataverse now, as of sometime in June 2024'). N collections = N x 1 TiB allocations. Sibling collections can also be nested, so a 'Dataverse Collection' tree is the natural shard key.","limits":[{"kind":"write-gated","value":"Review' spam screen before publication","source":"https://support.dataverse.harvard.edu/researchers"},{"kind":"per-object-cap","value":"Per-file 2.5 GB","source":"https://support.dataverse.harvard.edu/researchers"}],"limits_note":"write-once: publishing is irreversible, no delete without support intervention, no embargo; 'Submit for Review' spam screen before publication; per-file 2.5 GB in the browser path; 1,000 files/dataset is the observed effectiveDatasetFileCountLimit; S3 direct upload is admin-enabled per install and is the only route past the 2.5 GB file cap.","identity_cost":{"kind":"email","detail":"email","country":null},"reliability_note":"Anonymous read is a 1-hour signed S3 redirect, so re-resolve per request (rule 8); quota API is rate-limited and starts returning 403 after a short burst of collection probes.","confidence":"reported","confidence_note":"One page read moves it to documented.","evidence":[{"url":"https://support.dataverse.harvard.edu/researchers","date":"2026-10-21","proved":"'All researchers from any discipline, both inside and out of the Harvard University community, can deposit files of up to 2.5GB, and store up to 1TB of data on the Harvard Dataverse Repository.'"},{"url":"https://neurips.cc/Conferences/2025/DataHostingGuidelines","date":"2026-10-21","proved":"hosting restriction stated as '1TB per dataset (2.5GB per file) Any file types'"},{"url":"https://dataverse.harvard.edu/api/dataverses/SEE_Precursors/storage/quota?showInherited=true","date":"2026-10-21","proved":"probe returned 1099511627776 bytes"},{"url":"https://dataverse.harvard.edu/api/dataverses/kgwas/storage/quota?showInherited=true","date":"2026-10-21","proved":"probe returned 2748779069440 bytes (2.5 TB), proving allocations are set per collection and can exceed 1 TB"},{"url":"https://dataverse.harvard.edu/api/access/datafile/13913528","date":"2026-10-21","proved":"303 then 200, Content-Length 16393, file written and SHA-256 fed450c5dfa423d6a51168611bbb9f4179e862a9c831ee41c37b23b128cc24fa (16,393 bytes, exact)"},{"url":"https://dataverse.harvard.edu/api/access/datafile/13913528","date":"2026-10-21","proved":"with Range: bytes=0-1048575 - HTTP 206, Content-Range: bytes 0-16392/16393"},{"url":"https://github.com/IQSS/dataverse.harvard.edu/issues/199","date":"2026-10-21","proved":"and #207 - collection creation was disabled for :authenticated-users in Nov 2022, reopened June 2024"}],"verdict":"qualifies","verified_at":"2026-10-21T00:00:00.000Z","notes":"1 TB per Dataverse Collection allocation (2.5 TB for Harvard affiliates). Per-file 2.5 GB through UI/API; larger via the S3 direct-upload path. The 1 TB is enforced as a *collection* allocation, not a per-person cap: GET /api/dataverses/<alias>/storage/quota?showInherited=true returns {\"Total quota allocation for this collection\": 1099511627776} for ordinary collections, and one live collection returns 2748779069440 (2.5 TB).","extras":{},"binding":"per-object-cap","binding_note":"the per-object cap sets the shard size and therefore the object count; it bounds the total more tightly than any headline quota"},"claims":[{"path":"$.free_tier.stated","kind":"free-quota","num":1.0,"unit":"TB","per":null,"currency":null,"usd":null,"fx_date":null,"parse":"ok"},{"path":"$.limits[0].value","kind":"limit:write-gated","num":null,"unit":null,"per":null,"currency":null,"usd":null,"fx_date":null,"parse":"unparsed"},{"path":"$.limits[1].value","kind":"limit:per-object-cap","num":2.5,"unit":"GB","per":null,"currency":null,"usd":null,"fx_date":null,"parse":"ok"}],"unknown":[["$.free_tier.notes","process"],["$.per_object_cap.notes","not-extracted"],["$.retention.notes","not-extracted"]],"history":[],"drift":[]},{"rid":"storage/harvard-dataverse","card":{"rid":"storage/harvard-dataverse","eid":"dataverse-harvard-edu","topic":"storage","slug":"harvard-dataverse","provider":"Harvard Dataverse","url":"https://dataverse.harvard.edu","domain":"harvard.edu","category":"academic","tier":null,"verdict":"qualifies-with-caveat","vorder":1,"grp":"usable","confidence":"documented","binding":"per-object-cap","identity_kind":"institution","identity_basis":"stated","needs_card":0,"needs_phone":0,"needs_id":0,"needs_institution":1,"country":null,"crypto":null,"interfaces":"s3,rest,rclone","egress_metered":0,"per_object_bytes":2500000000,"retention_days":null,"verified_at":"2026-10-22T00:00:00.000Z","verified_basis":"inherited","checked_on":"2026-10-21","stale_on":"2026-11-20","n_evidence":5,"usd_month":null,"usd_per_tb_month":null,"summary":"2.5 GB per file; 1 TB per Dataverse Collection for non-Harvard researchers (2.5 TB for Harvard affiliates). The 1 TB is real and stated by Harvard, but it is...","duplicate_of":null,"n_unknown":5},"record":{"topic":"storage","slug":"harvard-dataverse","provider":"Harvard Dataverse","url":"https://dataverse.harvard.edu","category":"academic","free_tier":{"stated":"2.5 GB per file; 1 TB per Dataverse Collection for non-Harvard researchers (2.5 TB for Harvard affiliates). The 1 TB is real and stated by Harvard, but it is a *service/support* threshold, not a hard enforced cap — see limits.","unit":"TB","metered_on":"unstated","source_url":"https://support.dataverse.harvard.edu/researchers","read_on":"2026-10-21","notes":null},"per_object_cap":{"stated":"2.5 GB per file","bytes":2500000000,"source_url":"https://support.dataverse.harvard.edu/researchers","notes":"not stated"},"retention":{"stated":"not stated","source_url":"https://support.dataverse.harvard.edu/researchers","notes":"not stated"},"egress":{"terms":"Free and unmetered. Public file access returns 303 -> a presigned S3 URL (dvn-cloud-iqss.s3.amazonaws.com) valid 3600s; S3 honours Range requests. No egress pricing exists anywhere in the product. Probe: GET /api/access/datafile/11685194 -L -H 'Range: bytes=0-1023' -> 303 then HTTP 206, Content-Range: bytes 0-1023/21269528, Server: AmazonS3.","metered":false},"interface":["s3","rest","rclone"],"interface_detail":"rest","tooling":"Native REST API v6.10.1 (live: GET /api/info/version -> {\"version\":\"6.10.1\"}); SWORD v2 deposit; OAI-PMH harvest; S3 direct-upload API for files >2.5 GB (docs: 'This option can handle files >300GB'). Python client pyDataverse; R package dataverse. No rclone backend, but a REST loop is trivial (~15 lines) and the platform is a well-documented Invenio-free Java stack.","chaining":"Unlimited Dataverse Collections per account (Harvard: 9,755 collections / 306,011 datasets exist, anyone may create one). x 1 TB per collection. 20 collections = 20 TB in one account; 20 accounts = 400 TB. Also multiplies per *dataset* rather than per collection if the 1 TB is read as a guidance number, since no per-dataset quota is enforced on the root collection.","limits":[{"kind":"per-object-cap","value":"2.5 GB per file","source":"https://support.dataverse.harvard.edu/researchers"},{"kind":"write-gated","value":"Review' spam-check gate, not peer review","source":"https://support.dataverse.harvard.edu/researchers"},{"kind":"write-gated","value":"curator rejecting a deposit at the review gate, and the storage-quota feature is flagge","source":"https://support.dataverse.harvard.edu/researchers"}],"limits_note":"Per-file 2.5 GB through the Harvard UI/API; larger files require the S3 direct-upload path, which Harvard has enabled (downloads already redirect to S3, so upload-redirect is configured). Dataset file-count cap observed live: effectiveDatasetFileCountLimit=1000 (12 used on the sampled dataset). No enforced collection quota: GET /api/dataverses/harvard/storage/quota?showInherited=true -> {\"message\":\"No quota defined for this collection\"}. Publishing is a 'Submit for Review' spam-check gate, not peer review.","identity_cost":{"kind":"institution","detail":"derived from the record's prose, not from an identity field, and no signup was executed: he root collection. Per-file 2.5 GB through the Harvard UI/API; larger files require the S3 direct-upload path, which Harvard has enabled (downloads already redirect to S3, so upload","country":null},"reliability_note":"Mature, 15+ year old service with DOI permanence and S3-backed bytes; the only soft failure mode is a curator rejecting a deposit at the review gate, and the storage-quota feature is flagged 'new and still experimental' upstream.","confidence":"documented","confidence_note":"The quota endpoint answers were re-read. The record keeps `reported` because the per-file cap and the identity field were not measured. Was reported; now documented.","evidence":[{"url":"https://support.dataverse.harvard.edu/researchers","date":"2026-10-21","proved":"'can deposit files of up to 2.5GB, and store up to 1TB of data on the Harvard Dataverse Repository'"},{"url":"https://support.dataverse.harvard.edu/sites/g/files/omnuum821/files/2024-12/Harvard%20Dataverse%20Repository%20Large%20Data%20Services.pdf","date":"2026-10-21","proved":"(updated Dec 3 2024) — 'free support for research data collections up to 1.0TB for non-Harvard researchers and groups and 2.5TB for Harvard affiliates'; paid Large Data Services only above 2.5TB"},{"url":null,"date":"2026-10-21","proved":"probe: GET /api/dataverses/harvard/storage/quota?showInherited=true -> 'No quota defined for this collection'; GET /api/access/datafile/11685194 -> 303 to presigned S3 -> 206 Partial Content"},{"url":"https://dataverse.harvard.edu/","date":"2026-10-22","proved":"the instance answers."},{"url":"probe:https://dataverse.harvard.edu/api/dataverses/harvard/storage/quota?showInherited=true","date":"2026-10-22","proved":"GET 2026-10-22: harvard 200/73 B 'No quota defined for this collection'; SEE_Precursors 200/104 B 'Total quota allocation for this collection: 1,099,511,627,776 bytes'; kgwas 200/104 B 2,748,779,069,440 bytes"}],"verdict":"qualifies-with-caveat","verified_at":"2026-10-22T00:00:00.000Z","notes":"2.5 GB per file; 1 TB per Dataverse Collection for non-Harvard researchers (2.5 TB for Harvard affiliates). The 1 TB is real and stated by Harvard, but it is a *service/support* threshold, not a hard enforced cap — see limits.","extras":{"verified_in_pass":[{"url":"https://dataverse.harvard.edu/","date":"2026-10-22","via":"none","http_status":0,"bytes":0,"sha256":null,"pattern_found":false,"what_changed":"not read","capture":null}],"unconfirmed_in_pass":[{"url":"https://dataverse.harvard.edu/","status":0,"bytes":0,"why":"not read"}]},"binding":"per-object-cap","binding_note":"the per-object cap sets the shard size and therefore the object count; it bounds the total more tightly than any headline quota"},"claims":[{"path":"$.free_tier.stated","kind":"free-quota","num":2.5,"unit":"GB","per":null,"currency":null,"usd":null,"fx_date":null,"parse":"ok"},{"path":"$.limits[0].value","kind":"limit:per-object-cap","num":2.5,"unit":"GB","per":null,"currency":null,"usd":null,"fx_date":null,"parse":"ok"},{"path":"$.limits[1].value","kind":"limit:write-gated","num":null,"unit":null,"per":null,"currency":null,"usd":null,"fx_date":null,"parse":"unparsed"},{"path":"$.limits[2].value","kind":"limit:write-gated","num":null,"unit":null,"per":null,"currency":null,"usd":null,"fx_date":null,"parse":"unparsed"}],"unknown":[["$.evidence[2].url","private-url"],["$.free_tier.notes","process"],["$.per_object_cap.notes","not-extracted"],["$.retention.notes","not-extracted"],["$.retention.stated","not-extracted"]],"history":[],"drift":[]}]}