Last updated on June 23, 2023
Amazon AppFlow Cheat Sheet
-
An integration service that automates data flows by securely integrating third-party applications and AWS services without writing any code.
Features
-
Run flows on-demand or on a schedule to keep data in sync across SaaS applications and AWS services.
-
Aggregate data from multiple sources to train analytics tools more effectively and save money.
-
Use flow management tools to track where and when data has moved.
-
Data is encrypted at rest and in transit.
-
Integrates with AWS PrivateLink to allow private data transfer over AWS rather than public data transfer over the internet.
-
Use custom connectors to transfer data between private APIs, on-premise systems, and cloud services.
-
Publish events related to the status of a flow using Amazon Event Bridge.
Concepts
-
Connections
-
Provide access to the source and destination to enable data flow.
-
Stores configuration details and credentials to transfer data with applications.
-
Usernames
-
Passwords
-
Secret keys
-
API access tokens
-
-
In AWS CLI and AppFlow API, connections are called connector profiles.
-
-
Flows enable data transfer between the source and destination.
-
Data mapping
-
Specifies how data from the source is transferred to the destination.
-
Fields in each source object are mapped to fields in the destination.
-
Multiple fields in a source object are concatenated to a single field in the destination.
-
Mask sensitive field values so that only an asterisk appears in the destination field.
-
Allows you to truncate fields to a specific length.
-
-
Using filters, you can control which data records are transferred to the destination.
-
Trigger determines how a flow runs.
-
Run on-demand – run this flow every time you want to transfer data.
-
Run on event – for SaaS apps with change events.
-
Run on schedule – runs the flow on a recurring schedule.
-
Full transfer – transfers a snapshot of all records at the time of the flow run.
-
Incremental transfer – only records that have been added or updated since the last successful flow run are transferred.
-
-
Amazon AppFlow Pricing
-
You are charged per flow run and the maximum number of flow runs.
-
You are charged for data processing for flows whose destinations are:
-
Hosted on AWS
-
Integrated with AWS PrivateLink
-
-
You are charged per standard request and storage to read and write from AWS services.
-
You are charged for the use of AWS KMS CMKs to encrypt access tokens and data in transit.