Transforming Your Data with Amazon S3 Object Lambda
Description
Amazon Simple Storage Service (S3) allows you to store and share data to be used by multiple applications. However, certain applications require specific formats or views of your data. In order to accommodate the various applications accessing your data, you could either store multiple copies of your data in different formats or provide an additional layer to the object retrieval process that transforms your data to match the required format.
With Amazon S3 Object Lambda, you can now add your own custom AWS Lambda function code to intercept data being retrieved from S3 before returning it to an application. This Lambda function can transform your data to meet your application's requirements without modifying the original object stored in your S3 bucket. Amazon S3 Object Lambda allows you to enrich your data with additional properties as well as redact any data that is critical to security such as personally identifiable information (PII).
In this lab, you will configure an Amazon S3 Object Lamdba Access Point and write a custom Lambda function to retrieve CSV files stored in an S3 bucket and transform that data into JSON before returning it to the application.
Learning Objectives
Upon completion of this intermediate-level lab, you will be able to:
- Create an Amazon S3 Access Point
- Create an Amazon S3 Object Lambda Access Point
- Configure an AWS Lambda function to automatically transform data retrieved from an Amazon S3 bucket
Intended Audience
- Cloud Architects
- Software Engineers
Prerequisites
Familiarity with the following will be beneficial but is not required:
- Amazon Simple Storage Service (S3)
- AWS Lambda
- JavaScript Object Notation (JSON)
The following content can be used to fulfill the prerequisites:
Updates
November 27th, 2022 - Updated screenshots & instructions to reflect latest UI