Amazon Elastic Inference

Home » AWS Cheat Sheets » AWS Machine Learning & AI » Amazon Elastic Inference

Amazon Elastic Inference

Last updated on June 23, 2023

Amazon Elastic Inference Cheat Sheet

  • Allows attaching low-cost GPU-powered inference acceleration to EC2 instances, SageMaker instances, or ECS tasks.
  • Reduce machine learning inference costs by up to 75%.

Common Use Cases

  • Computer vision
  • Natural language processing
  • Speech recognition
  • Tutorials dojo strip

Concepts

  • Accelerator
    • A GPU-powered hardware device provisioned. 
    • It is not a part of the hardware where your instance is hosted.
    • Uses AWS PrivateLink endpoint service to attach to the instance over the network.
  • Only a single endpoint service is required in every Availability Zone to connect Elastic Inference accelerator to instances.

Features

  • Supports TensorFlow, Apache MXNet, PyTorch, and ONNX models.
  • Can provide 1 to 32 trillion floating-point operations per second (TFLOPS) per accelerator.
  • The accelerator attached to each instance in an auto-scaling group scales accordingly to your application’s compute demand.

Amazon Elastic Inference Pricing

  • You are charged for the accelerator hours you consume.

Note: If you are studying for the AWS Certified Machine Learning Specialty exam, we highly recommend that you take our AWS Certified Machine Learning – Specialty Practice Exams and read our Machine Learning Specialty exam study guide.

AWS Certified Machine Learning Specialty Practice Exams

Amazon Elastic Inference Cheat Sheet References:

https://aws.amazon.com/machine-learning/elastic-inference/features/
https://docs.aws.amazon.com/elastic-inference/latest/developerguide/basics.html
https://aws.amazon.com/machine-learning/elastic-inference/pricing/

Tutorials Dojo portal

Be Inspired and Mentored with Cloud Career Journeys!

Tutorials Dojo portal

Enroll Now – Our Azure Certification Exam Reviewers

azure reviewers tutorials dojo

Enroll Now – Our Google Cloud Certification Exam Reviewers

Tutorials Dojo Exam Study Guide eBooks

tutorials dojo study guide eBook

FREE AWS Exam Readiness Digital Courses

Subscribe to our YouTube Channel

Tutorials Dojo YouTube Channel

FREE Intro to Cloud Computing for Beginners

FREE AWS, Azure, GCP Practice Test Samplers

Recent Posts

Written by: Carlo Acebedo

Carlo is a cloud engineer and a content creator at Tutorials Dojo. He's also a member of the AWS Community builder and holds 5 AWS Certifications. Carlo specializes in building and automating solutions in the Amazon Web Services Cloud.

AWS, Azure, and GCP Certifications are consistently among the top-paying IT certifications in the world, considering that most companies have now shifted to the cloud. Earn over $150,000 per year with an AWS, Azure, or GCP certification!

Follow us on LinkedIn, YouTube, Facebook, or join our Slack study group. More importantly, answer as many practice exams as you can to help increase your chances of passing your certification exams on your first try!

View Our AWS, Azure, and GCP Exam Reviewers Check out our FREE courses

Our Community

~98%
passing rate
Around 95-98% of our students pass the AWS Certification exams after training with our courses.
200k+
students
Over 200k enrollees choose Tutorials Dojo in preparing for their AWS Certification exams.
~4.8
ratings
Our courses are highly rated by our enrollees from all over the world.

What our students say about us?