Amazon Augmented AI Cheat Sheet

• Amazon A2I is a service that helps you easily integrate human reviews in a machine learning workflow.
• Simplifies managing a large number of human reviewers at scale.
• Has direct integration with Amazon Textract and Amazon Rekognition.
• A2I workflow structure: HumanLoop → Human Review Workflow → Output Consolidation.
• You can define when a human review should be triggered (e.g., below 80% confidence).

• A2I plugs directly into SageMaker pipelines and SageMaker Ground Truth.

Common Use Cases:

• Content Moderation where human oversight is required to judge uncertain results from a machine learning model.
• Manual reviews of low confidence predictions due to documents that are scanned poorly or contain bad handwriting. 
• Human validation of PII redaction to ensure sensitive information is accurately identified and properly masked, especially in compliance-driven workflows.
• Human verification of borderline or low-confidence model predictions to monitor for model drift and maintain long-term model performance and reliability.
• Human review of OCR outputs for clinical and medical documents to correct misread text, handwriting errors, and formatting issues where accuracy is critical.

Concepts

• Task Type
  • Type of task to be reviewed.
  • Available task types
    • Key-value pairs extracted by Amazon Textract
    • Unsafe content flagged by Amazon Rekognition
    • Custom machine learning workflows
  • Document Classification Review (custom workflow)
    
    For validating category assignments in large document sets.
  • Text Extraction Accuracy Review (Textract AnalyzeDocument)
    
    Specifically for forms, tables, handwriting.
• Worker task template
  • This template lets you define a set of instructions for your workers whenever they perform a task.
• Worker types
  • Amazon Mechanical Turk – a crowdsourcing service that allows you to outsource jobs to an on-demand 24×7 distributed workforce online.
  • Private – A group of workers that you have sourced yourself (e.g., internal employees)
  • Vendor – Third-party vendors from AWS Marketplace that offer human review services. 
  • UI Customization Options:
    
    Support for:
    • Dropdowns
    • Bounding boxes
    • Multi-select
    • Free-text fields
  • HTML + Liquid templating:
    
    You can fully customize worker UIs with HTML, CSS, and Liquid.

Amazon Augmented AI Pricing

• $0.02 – $0.03 per reviewed image from Amazon Rekognition
• $0.02 – $0.03 per reviewed page from Amazon Textract
• $0.02 – $0.08 per reviewed objects from Custom workflows

Note: If you are studying for the AWS Certified Machine Learning Specialty exam, we highly recommend that you take our AWS Certified Machine Learning – Specialty Practice Exams and read our Machine Learning Specialty exam study guide.

Amazon Augmented AI Cheat Sheet References:

https://aws.amazon.com/augmented-ai/faqs/
https://aws.amazon.com/blogs/awsmarketplace/using-amazon-augmented-ai-with-aws-marketplace-machine-learning-models
https://docs.aws.amazon.com/textract/latest/dg/a2i-textract.html