Amazon Managed Workflows for Apache Airflow (MWAA) Cheat Sheet
- Amazon MWAA is a service that helps you manage and automate your data workflows using Apache Airflow.
- Workflows are designed as Directed Acyclic Graphs (DAGs) using Python.
Use Cases
- Complex Data Workflows: Handles complex data processing tasks.
- ETL Jobs: Coordinates Extract, Transform, Load (ETL) processes.
- Machine Learning: Prepares datasets for machine learning models.
Key Features
- Deployment: Easy setup and operation.
- Scaling: Automatically adjusts to match workload demands.
- Security: Built-in measures for data protection.
- Monitoring: Comprehensive tracking of workflows.
- Cost-Effectiveness: Reduces operational costs due to its managed nature.
Security
- Network Isolation: Operates within Amazon’s Virtual Private Cloud (VPC).
- Data Encryption: Uses AWS Key Management Service for automatic data encryption.
Pricing
- Environment Pricing: Billed hourly based on environment size.
- Additional Worker Instance Pricing: Billed hourly based on task load.
- Additional Scheduler Instance Pricing: Billed hourly based on availability.
- Database Storage: Billed per GB-month for storage consumed.
Amazon Managed Workflows for Apache Airflow References:
https://aws.amazon.com/managed-workflows-for-apache-airflow/
https://aws.amazon.com/managed-workflows-for-apache-airflow/features/
https://aws.amazon.com/managed-workflows-for-apache-airflow/pricing/