fshy

fshy / Storage

Internet Archive

Storage · 1 record · JSON

Internet Archive (IAS3 / petabox item upload) Storage

★ qualifiesinstitutionno cardDper-object-cap

archive.org · academic · storage/internet-archive · JSON · compare

Free tier1 TB hard limit per item page ("Currently, there is a 1TB size limit for item pages"), recommended 500 GB / 1,000 files per item; items per account unlimited. Single file "should not be larger than ~500 to ~700 GB".
unit TB; metered on unstated
Pricenone stated
Per-object cap1 TB/item (1000000000000 bytes)
Retentionnot stated
EgressUnmetered and free: every file in every item is a world-readable HTTP URL (https://archive.org/download/<id>/<file>) with no auth and no egress bill; IAS3 doc states "ACLs are fake. permissions are: World readable, Item uploader writable." Every public item additionally gets an _archive.torrent with IA webseeding as a second free distribution path.
Identityinstitution derived from the record's prose, not from an identity field, and no signup was executed: ems (zip counts as 1); recommended <=10,000 files/item but API accepts 250,000; DELETE bucket not allowed; S3 Range headers ignored; only HTTP/1.1 REST, no ACLs; every upload enters
Limits
  • per-object-cap 1 TB/item source
  • per-object-cap 500 GB/item source
1 TB/item hard, 500 GB/item recommended; 500-700 GB single-file ceiling; 5,000 files/day across all items (zip counts as 1); recommended <=10,000 files/item but API accepts 250,000; DELETE bucket not allowed; S3 Range headers ignored; only HTTP/1.1 REST, no ACLs; every upload enters a per-item catalog queue plus a global derive queue that can block writes (503-slowdown-spam). Use x-archive-queue-derive:0 to skip expensive derivation.
Bindingper-object-cap the per-object cap sets the shard size and therefore the object count; it bounds the total more tightly than any headline quota
Interfaces3-compatible, rest, rclone, cli s3
ToolingIAS3 = S3-compatible REST (PUT = create item, multipart, x-archive-auto-make-bucket, x-archive-queue-derive:0, x-archive-size-hint); rclone backend 'internetarchive' (Tier 3, added v1.59, github.com/rclone/rclone 60.4k stars); official CLI/Python 'ia' github.com/jjjake/internetarchive (1,923 stars, pushed 2026-10-20); Rust client github.com/LucaCappelletti94/internetarchive-rs. S3 keys from archive.org/account/s3.php.
Composes withUnlimited items per account x 1 TB/item = unbounded per single free account. Also unlimited free accounts. 10 TiB hot set = 10-20 items of 500 GB-1 TB. 20 TiB archive = ~20-40 items. Zip many small files ("a zip file is considered one file" for the daily cap).
ReliabilityWrites are asynchronous through a per-item queue; the global derive queue can stall uploads and deletes for hours during backlogs, and large/high-file-count items time out and fail to derive. Items are permanent (no TTL) but nothing is guaranteed private.
Notes1 TB hard limit per item page ("Currently, there is a 1TB size limit for item pages"), recommended 500 GB / 1,000 files per item; items per account unlimited. Single file "should not be larger than ~500 to ~700 GB".
Evidence rungdocumented re-read from read-broker on 2026-10-22 (HTTP 200, 5433 bytes, sha256 48c2cd2e54f5effa). The page states the number in the record; the claim is documented, not measured.
Checked2026-10-21 (inherited); stale on 2026-11-20
Parsed numbers
  • $.limits[0].value limit:per-object-cap 1.0 TB
  • $.limits[1].value limit:per-object-cap 500.0 GB
Evidence (8)
datesourcewhat it proved
2026-10-22help.archive.org/help/uploading-tips/1 TB per item, 500 GB recommended. Re-read https://help.archive.org/help/uploading-tips/: HTTP 200, 5433 bytes, sha256 48c2cd2e54f5effa. Quoted: impact such as the type and size of the files you are uploading. ## **Is there a limit to the number of files or the size of the file that I can upload?** Currently, there is a 1TB size limit for item pages. However, from a systems perspective, we recommend a maximum of 1000 files or 500GB of data per item page. Keep in mind that most data files that are upload are used to derive multiple files that are used for the site and to allow us
2026-10-21help.archive.org/help/uploading-tips/'Currently, there is a 1TB size limit for item pages... we recommend a maximum of 1000 files or 500GB of data per item page'
2026-10-21web.archive.org/web/20260113031534/https://archive.org/develPUT creates item, multipart, x-archive-auto-make-bucket, 'ACLs are fake... World readable', item->bucket mapping, https://s3.us.archive.org
2026-10-21archivesupport.zendesk.com/hc/en-us/articles/360016700691-Up'single file ... should not be larger than ~500 to ~700 GB'; 'less than 10,000 files, and where the files do not exceed 1TB'; 'API will allow up to 250,000 files'
2026-10-21rclone.org/internetarchive/rclone backend exists (Tier 3), notes per-item write queue and derive queue backpressure
2026-10-21help.archive.org/help/archive-bittorrents/1.4M items / ~1 PB distributed by BitTorrent as extra free egress
2026-10-21s3.us.archive.org/the IAS3 contract above is from the docs page only.
2026-10-22probe:https://archive.org/download/nasa/__ia_thumb.jpgranged GET 2026-10-22: 302 to a storage node then 206 Partial Content, 1,024 bytes, Content-Range bytes 0-1023/5399; anonymous
More fields (1)
{
 "verified_in_pass": [
  {
   "url": "https://help.archive.org/help/uploading-tips/",
   "date": "2026-10-22",
   "via": "read-broker",
   "http_status": 200,
   "bytes": 5433,
   "sha256": "48c2cd2e54f5effa68cd5fced7c6b5fb3d5045a2323827fd720e78345b324a82",
   "pattern_found": true,
   "what_changed": "no change: the page still states the claim",
   "capture": "captures\\internet-archive-host-help-archive-org-help-uploading-tips-.txt"
  }
 ]
}
Unknown or withheld values (4)
  • $.free_tier.notes process
  • $.per_object_cap.notes not-extracted
  • $.retention.notes not-extracted
  • $.retention.stated not-extracted