{"id":25114,"date":"2026-04-10T05:16:07","date_gmt":"2026-04-09T20:16:07","guid":{"rendered":"https:\/\/aireviewirush.com\/?p=25114"},"modified":"2026-04-10T05:16:07","modified_gmt":"2026-04-09T20:16:07","slug":"launching-s3-recordsdata-making-s3-buckets-accessible-as-file-techniques","status":"publish","type":"post","link":"https:\/\/aireviewirush.com\/?p=25114","title":{"rendered":"Launching S3 Recordsdata, making S3 buckets accessible as file techniques"},"content":{"rendered":"


\n<\/p>\n

\n\n\n\n
\n
\n \"Voiced<\/a>\n <\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

I\u2019m excited to announce Amazon S3 Recordsdata<\/a>, a brand new file system that seamlessly connects any AWS compute useful resource with Amazon Easy Storage Service (Amazon S3)<\/a>.<\/p>\n

Greater than a decade in the past, as an AWS coach, I spent numerous hours explaining the elemental variations between object storage and file techniques. My favourite analogy was evaluating S3 objects to books in a library (you’ll be able to\u2019t edit a web page, it’s essential to change the entire e-book) versus information in your laptop that you would be able to modify web page by web page. I drew diagrams, created metaphors, and helped clients perceive why they wanted totally different storage varieties for various workloads. Nicely, in the present day that distinction turns into a bit extra versatile.<\/p>\n

With S3 Recordsdata, Amazon S3 is the primary and solely cloud object retailer that provides fully-featured, high-performance file system entry to your knowledge. It makes your buckets accessible as file techniques. This implies modifications to knowledge on the file system are routinely mirrored within the S3 bucket and you’ve got fine-grained management over synchronization. S3 Recordsdata will be hooked up to a number of compute sources enabling knowledge sharing throughout clusters with out duplication.<\/p>\n

Till now, you had to decide on between Amazon S3 value, sturdiness, and the companies that may natively devour knowledge from it or a file system\u2019s interactive capabilities. S3 Recordsdata eliminates that tradeoff. S3 turns into the central hub for all of your group\u2019s knowledge. It\u2019s accessible immediately from any AWS compute occasion, container, or operate, whether or not you\u2019re operating manufacturing purposes, coaching ML fashions, or constructing agentic AI techniques.<\/p>\n

You possibly can entry any basic goal bucket as a local file system in your Amazon Elastic Compute Cloud (Amazon EC2)<\/a> cases, containers operating on Amazon Elastic Container Service (Amazon ECS)<\/a> or Amazon Elastic Kubernetes Service (Amazon EKS)<\/a>, or AWS Lambda<\/a> features. The file system presents S3 objects as information and directories, supporting all Community File System<\/a> (NFS) v4.1+ operations like creating, studying, updating, and deleting information.<\/p>\n

As you’re employed with particular information and directories by way of the file system, related file metadata and contents are positioned onto the file system\u2019s high-performance storage. By default, information that profit from low-latency entry are saved and served from the excessive efficiency storage. For information not saved on excessive efficiency storage resembling these needing giant sequential reads, S3 Recordsdata routinely serves these information immediately from Amazon S3 to maximise throughput. For byte-range reads, solely the requested bytes are transferred, minimizing knowledge motion and prices.<\/p>\n

The system additionally helps clever pre-fetching to anticipate your knowledge entry wants. You’ve gotten fine-grained management over what will get saved on the file system\u2019s excessive efficiency storage. You possibly can resolve whether or not to load full file knowledge or metadata solely, which implies you’ll be able to optimize on your particular entry patterns.<\/p>\n

Below the hood, S3 Recordsdata makes use of Amazon Elastic File System (Amazon EFS)<\/a> and delivers ~1ms latencies for energetic knowledge. The file system helps concurrent entry from a number of compute sources with NFS close-to-open consistency, making it very best for interactive, shared workloads that mutate knowledge, from agentic AI brokers collaborating by way of file-based instruments to ML coaching pipelines processing datasets.<\/p>\n

Let me present you methods to get began.
\n
<\/strong><\/span>Creating my first Amazon S3 file system, mounting, and utilizing it from an EC2 occasion is easy.<\/p>\n

I’ve an EC2 occasion and a basic goal bucket. On this demo, I configure an S3 file system and entry the bucket from an EC2 occasion, utilizing common file system instructions.<\/p>\n

For this demo, I exploit the AWS Administration Console<\/a>. You can too use the AWS Command Line Interface (AWS CLI)<\/a> or infrastructure as code<\/a> (IaC).<\/p>\n

Right here is the structure diagram for this demo.<\/p>\n

\"S3<\/a>Step 1: <\/strong>Create an S3 file system.<\/p>\n

On the Amazon S3 part of the console, I select File techniques<\/strong> after which Create file system<\/strong>.<\/p>\n

\"S3<\/a><\/p>\n

I enter the title of the bucket I need to expose as a file system and select Create file system<\/strong>.<\/p>\n

\"S3<\/a><\/p>\n

Step 2: <\/strong>Uncover the mount goal.<\/p>\n

A mount goal is a community endpoint that may reside in my digital non-public cloud (VPC). It permits my EC2 occasion to entry the S3 file system.<\/p>\n

The console creates the mount targets routinely. I take notes of the Mount goal ID<\/strong>s on the Mount targets<\/strong> tab.<\/p>\n

\"\"<\/a><\/p>\n

When utilizing the CLI<\/a>, two separate instructions are essential to create the file system and its mount targets. First, I create the S3 file system with create-file-system<\/code>. Then, I create the mount goal with create-mount-target.<\/code><\/p>\n

Step 3: <\/strong>Mount the file system on my EC2 occasion.<\/p>\n

After it\u2019s linked to an EC2 occasion, I kind:<\/p>\n

sudo mkdir \/residence\/ec2-user\/s3files<\/code> sudo mount -t s3files fs-0aa860d05df9afdfe:\/ \/residence\/ec2-user\/s3files<\/code><\/p>\n

I can now work with my S3 knowledge immediately by way of the mounted file system in ~\/s3files<\/code>, utilizing normal file operations.<\/p>\n

After I make updates to my information within the file system, S3 routinely manages and exports all updates as a brand new object or a brand new model on an present object again in my S3 bucket inside minutes.<\/p>\n

Modifications made to things on the S3 bucket are seen within the file system inside just a few seconds however can typically take a minute or longer.<\/p>\n

# Create a file on the EC2 file system \necho \"Good day S3 Recordsdata\" > s3files\/good day.txt \n\n# and confirm it is right here \nls -al s3files\/good day.txt\n -rw-r--r--. 1 ec2-user ec2-user 15 Oct 22 13:03 s3files\/good day.txt \n\n# See? the file can be on S3 \naws s3 ls s3:\/\/s3files-aws-news-blog\/good day.txt \n2025-10-22 13:04:04 15 good day.txt \n\n# And the content material is similar! \naws s3 cp s3:\/\/s3files-aws-news-blog\/good day.txt . && cat good day.txt\nGood day S3 Recordsdata<\/code><\/pre>\n
Issues to know
\n          
<\/strong><\/span>Let me share some necessary technical particulars that I feel you\u2019ll discover helpful.<\/p>\n
One other query I steadily hear in buyer conversations is about choosing the proper file service on your workloads. Sure, I do know what you\u2019re pondering: AWS and its seemingly overlapping companies, retaining cloud architects entertained throughout their structure evaluation conferences. Let me assist demystify this one.<\/p>\n
S3 Recordsdata works greatest if you want interactive, shared entry to knowledge that lives in Amazon S3 by way of a excessive efficiency file system interface. It\u2019s very best for workloads the place a number of compute sources\u2014whether or not manufacturing purposes, agentic AI brokers utilizing Python libraries and CLI instruments, or machine studying (ML) coaching pipelines\u2014have to learn, write, and mutate knowledge collaboratively. You get shared entry throughout compute clusters with out knowledge duplication, sub-millisecond latency, and computerized synchronization together with your S3 bucket.<\/p>\n
For workloads migrating from on-premises NAS environments, Amazon FSx<\/a> supplies the acquainted options and compatibility you want. Amazon FSx can be very best for high-performance computing (HPC) and GPU cluster storage with Amazon FSx for Lustre<\/a>. It\u2019s notably worthwhile when your purposes require particular file system capabilities from Amazon FSx for NetApp ONTAP<\/a>, Amazon FSx for OpenZFS<\/a>, or Amazon FSx for Home windows File Server<\/a>.<\/p>\n
Pricing and availability
\n          
<\/strong><\/span>S3 Recordsdata is out there in the present day in all business AWS Areas<\/a>.<\/p>\n
You pay for the portion of information saved in your S3 file system, for small file learn and all write operations to the file system, and for S3 requests throughout knowledge synchronization between the file system and the S3 bucket. The Amazon S3 pricing web page has all the small print<\/a>.<\/p>\n
From discussions with clients, I imagine S3 Recordsdata helps simplify cloud architectures by eliminating knowledge silos, synchronization complexity, and guide knowledge motion between objects and information. Whether or not you\u2019re operating manufacturing instruments that already work with file techniques, constructing agentic AI techniques that depend on file-based Python libraries and shell scripts, or getting ready datasets for ML coaching, S3 Recordsdata lets these interactive, shared, hierarchical workloads entry S3 knowledge immediately with out selecting between the sturdiness of Amazon S3 and value advantages and a file system\u2019s interactive capabilities. Now you can use Amazon S3 because the place for all of your organizations\u2019 knowledge, figuring out the info is accessible immediately from any AWS compute occasion, container, and performance.<\/p>\n
To study extra and get began, go to the S3 Recordsdata documentation<\/a>.<\/p>\n
I\u2019d love to listen to how you employ this new functionality. Be happy to share your suggestions within the feedback beneath.<\/p>\n
       \u2014 seb<\/a> \n      <\/div>\n\n","protected":false},"excerpt":{"rendered":"
I\u2019m excited to announce Amazon S3 Recordsdata, a brand new file system that seamlessly connects any AWS compute useful resource with Amazon Easy Storage Service (Amazon S3). Greater than a decade in the past, as an AWS coach, I spent numerous hours explaining the elemental variations between object storage and file techniques. My favourite analogy […]<\/p>\n","protected":false},"author":1,"featured_media":25116,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[],"class_list":["post-25114","post","type-post","status-publish","format-standard","has-post-thumbnail","category-cloud-computing"],"_links":{"self":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts\/25114","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=25114"}],"version-history":[{"count":1,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts\/25114\/revisions"}],"predecessor-version":[{"id":25115,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/posts\/25114\/revisions\/25115"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=\/wp\/v2\/media\/25116"}],"wp:attachment":[{"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=25114"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=25114"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aireviewirush.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=25114"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}