Amazon Kinesis Data Firehose Data Transformation with AWS Lambda
This pattern deploys a Kinesis Data Firehose that invokes a Lambda function to transform incoming source data and deliver the transformed data to destinations.
Important: this application uses various AWS services and there are costs associated with these services after the Free Tier usage - please see the AWS Pricing page for details. You are responsible for any AWS costs incurred. No warranty is implied in this example.
Requirements
Create an AWS account if you do not already have one and log in. The IAM user that you use must have sufficient permissions to make necessary AWS service calls and manage AWS resources.
From the command line, use AWS SAM to build and deploy the AWS resources for the pattern as specified in the template.yml file:
sam build
sam deploy --guided
During the prompts:
Enter a stack name
Enter the desired AWS Region
Allow SAM CLI to create IAM roles with the required permissions.
Once you have run sam deploy -guided mode once and saved arguments to a configuration file (samconfig.toml), you can use sam deploy in future to use these defaults.
Note the outputs from the SAM deployment process. These contain the resource names and/or ARNs which are used for testing.
How it works
Delete stack
sam delete
Copyright 2023 Amazon.com, Inc. or its affiliates. All Rights Reserved.