fshy

fshy / Storage

ena

ebi.ac.uk · Storage · 3 records · JSON

BioStudies / ArrayExpress (EMBL-EBI) Storage

★ qualifiesanonymousno cardRper-ip-shaping

www.ebi.ac.uk/biostudies · academic · storage/biostudies-arrayexpress · JSON · compare

Free tierFree deposit, no published cap. 'Is there a cost to deposit data in BioStudies? No, both deposition of data to BioStudies and data access are free of charge.' Docs discuss 'larger data volumes (hundreds of GiB)' as routine.
unit unlimited; metered on unstated
Pricenone stated
Per-object capnot stated
RetentionBinding constraint on read is per-ip-shaping — 1 stream 7 KB/s, 16 parallel 25 KB/s against the EBI FTP edge. Retention: permanent, DOI auto-assigned; files can sit 'hold until published' indefinitely before release.
EgressFree and anonymous. 'Anonymous downloads are enabled' over FTP; also HTTPS. No egress meter anywhere in the docs.
Identityanonymous derived from the record's prose, not from an identity field, and no signup was executed: ount; each accession gets its own directory tree. Read side anonymous per-file HTTP, so it fronts to a CDN trivially. per-object-cap: none stated; Aspera recommended above 10 GiB. Binding c
Limits
per-object-cap: none stated; Aspera recommended above 10 GiB. Binding constraint on read is per-ip-shaping — 1 stream 7 KB/s, 16 parallel 25 KB/s against the EBI FTP edge. Retention: permanent, DOI auto-assigned; files can sit 'hold until published' indefinitely before release.
Bindingper-ip-shaping one stream is shaped, and a user's throughput is the shaped rate times the number of streams
Interfaceftp, nfs ftp
ToolingSubmission Tool + FTP + Aspera (ascp) in; anonymous FTP/HTTPS out. Path is predictable: /biostudies/<mode>/<COLL>/<COLL0-99>/<ACC>/Files/ where mode is fire or nfs.
Composes withArrayExpress is a BioStudies collection, so one account covers both. Unlimited accessions per account; each accession gets its own directory tree. Read side anonymous per-file HTTP, so it fronts to a CDN trivially.
ReliabilityRead edge is slow per connection and stalls connections under parallel load (one of 16 timed out with 0 bytes). Fetches from the same EBI edge as ENA/PRIDE, so they are one throughput pool, not three.
NotesFree deposit, no published cap. 'Is there a cost to deposit data in BioStudies? No, both deposition of data to BioStudies and data access are free of charge.' Docs discuss 'larger data volumes (hundreds of GiB)' as routine.
Evidence rungreported One page read moves it to documented.
Checked2026-10-21 (inherited); stale on 2026-11-04
Parsed numbers
  • $.limits[0].value limit:per-ip-shaping 7.0 KB
  • $.limits[1].value limit:per-ip-shaping 25.0 KB
Evidence (4)
datesourcewhat it proved
2026-10-21www.ebi.ac.uk/biostudies/submit'both deposition of data to BioStudies and data access are free of charge', 'Aspera transfer for medium to large (10 GiB+)', 'hundreds of GiB'
2026-10-21www.ebi.ac.uk/biostudies/help#download'Anonymous downloads are enabled', exact FTP path scheme
2026-10-21ftp.ebi.ac.uk/biostudies/fire/S-BSST/S-BSST0-99/S-BSST7/Fileprobe: GET -> 200, Apache directory index listing 10 files
2026-10-21withheldprobe: GET .../Files/1_TCGA_signature_A_top_10percent.txt -> 200, Content-Length 1282965, downloaded 1282965 bytes, sha256 aff47b60a0ccec2bbf433186a933627f01f54f43a2c2d326fac431a3a961e028, body is the real TSV
Unknown or withheld values (5)
  • $.evidence[3].url private-url
  • $.free_tier.notes process
  • $.per_object_cap.notes not-extracted
  • $.per_object_cap.stated not-extracted
  • $.retention.notes not-extracted

ENA (European Nucleotide Archive) — Webin Storage

★ qualifiesanonymousno cardRretention-clampeddisagrees

www.ebi.ac.uk/ena · academic · storage/ena-webin · JSON · compare

Sibling records disagree:

Free tierNo fixed quota. Own fair-use policy: 'We place no absolute limit within the 2-month period on the total volume of user data that may exist in a data upload area at any one time' and 'we ... expect that volumes would not exceed 10 Terabytes under normal circumstances.'
unit mixed; metered on unstated
Pricenone stated
Per-object capnot stated
RetentionRetention: transit area purged after 2 months if not submitted; once submitted, ENA is permanent (60 days)
EgressUnmetered and anonymous. ftp.sra.ebi.ac.uk is CORS-open (Access-Control-Allow-Origin: *) and already served through Cloudflare (Server: cloudflare), so CF is in front by default.
Identityanonymous derived from the record's prose, not from an identity field, and no signup was executed: ead side. Multiply across accounts/centres; read side needs no account at all, so the fetch workload is uncapped regardless of how many deposit accounts exist. per-object-cap: none documente
Limits
  • per-ip-shaping 45 KB/s source
  • per-ip-shaping 430 KB/s source
  • retention-clamped Retention: transit area purged after 2 months source
per-object-cap: none documented per file; per-request volume soft-capped at ~10 TB per 2-month window per upload area, and upload areas are not backed up. Retention: transit area purged after 2 months if not submitted; once submitted, ENA is permanent. Binding constraint on READ is per-ip-shaping: single stream 45 KB/s, 8 parallel ranged GETs 430 KB/s (9.6x).
Bindingretention-clamped a clock, not a quota: bytes leave whether or not the client is finished with them
Interfacesftp, ftp, rclone, cli sftp
ToolingWebin-CLI (github.com/enasequence/webin-cli), plus plain FTP/Aspera. Read side is plain HTTPS/FTP with HTTP range support — works with rclone's http/sftp remotes and curl.
Composes withOne Webin account = unlimited studies. The upload area is a transit buffer (10 TB documented expectation), while *published* accessions are permanent and unmetered on the read side. Multiply across accounts/centres; read side needs no account at all, so the fetch workload is uncapped regardless of how many deposit accounts exist.
ReliabilityUpload path is the weak side — FTP sessions drop out, Aspera recommended; upload area is explicitly 'not backed up'.
NotesNo fixed quota. Own fair-use policy: 'We place no absolute limit within the 2-month period on the total volume of user data that may exist in a data upload area at any one time' and 'we ... expect that volumes would not exceed 10 Terabytes under normal circumstances.'
Evidence rungreported One page read moves it to documented.
Checked2026-10-21 (inherited); stale on 2026-11-04
Parsed numbers
  • $.limits[0].value limit:per-ip-shaping 45.0 KB
  • $.limits[1].value limit:per-ip-shaping 430.0 KB
Evidence (3)
datesourcewhat it proved
2026-10-21ena-docs.readthedocs.io/en/latest/submit/fileprep/upload.htmquotes 'no absolute limit within the 2-month period', 'would not exceed 10 Terabytes under normal circumstances', 'temporary transit area which is not backed up'
2026-10-21ftp.sra.ebi.ac.uk/vol1/fastq/SRR000/SRR000001/SRR000001_1.faprobe: GET -r 0-1023 -> 206 Partial Content, Content-Range: bytes 0-1023/23319983, body starts 1f 8b 08 00 (real gzip magic), Server: cloudflare
2026-10-21withheldprobe: 8 parallel ranged GETs -> 8,000,000 bytes in 18.6s (430 KB/s) vs 1 connection 1,001,024 bytes in 22.2s (45 KB/s)
Unknown or withheld values (5)
  • $.evidence[2].url private-url
  • $.free_tier.notes process
  • $.per_object_cap.notes not-extracted
  • $.per_object_cap.stated not-extracted
  • $.retention.notes not-extracted

ena (european nucleotide archive) Storage

fails: quotaemail?card?Rdisagrees

www.ebi.ac.uk/ena/browser/submit · rejected-provider · storage/ena · JSON · compare

Sibling records disagree:

Free tierFree and effectively unlimited, but Webin accounts are for nucleotide sequence submission only; the upload area is 'a temporary transit area which is not backed up and subject to a fair use
unit none; metered on none
Pricenone stated
Per-object capnot recorded
Retentionnot recorded
Egressnot recorded
Identityemail (placeholder) not published
Bindingnone no constraint of a named kind was recorded; the verdict rests on the quota sentence rather than on a named limit
Interfaceunknown
Toolingnot recorded
Composes withnot recorded
ReliabilityFree and effectively unlimited, but Webin accounts are for nucleotide sequence submission only; the upload area is 'a temporary transit area which is not backed up and subject to a fair use
NotesFree and effectively unlimited, but Webin accounts are for nucleotide sequence submission only; the upload area is 'a temporary transit area which is not backed up and subject to a fair use
Evidence rungreported
Checked2026-10-21 (inherited); stale on 2026-11-04
Evidence (2)
datesourcewhat it proved
2026-10-21www.ebi.ac.uk/ena/browser/submitFree and effectively unlimited, but Webin accounts are for nucleotide sequence submission only the upload area is 'a temporary transit area which is not backed up and subject to a fair use
2026-10-21ena-docs.readthedocs.io/en/latest/submit/general-guide/progrcited as the basis of the rejection: Free and effectively unlimited, but Webin accounts are for nucleotide sequence submission only; the upload area is 'a temporary transit area which is not backed up and subject to a fair use
More fields (1)
{
 "dead_end": {
  "failure_class": "quota",
  "why": "Free and effectively unlimited, but Webin accounts are for nucleotide sequence submission only; the upload area is 'a temporary transit area which is not backed up and subject to a fair use",
  "retry_when": null,
  "first_recorded": "2026-10-21"
 }
}
Unknown or withheld values (15)
  • $.chaining not-recorded
  • $.confidence_note withheld
  • $.egress.terms not-recorded
  • $.extras.dead_end.retry_when process
  • $.free_tier.notes process
  • $.identity_cost.detail defaulted
  • $.identity_cost.kind identity-defaulted
  • $.interface interface-unknown
  • $.interface_detail withheld
  • $.limits_note process
  • $.per_object_cap.notes not-recorded
  • $.per_object_cap.stated not-recorded
  • $.retention.notes process
  • $.retention.stated not-recorded
  • $.tooling not-recorded