Amazon Bedrock

Amazon Bedrock Cheat Sheet

Amazon Bedrock enables you to construct and expand applications powered by generative AI. These applications have the capability to produce text, images, audio, and artificial data in reaction to specific prompts.

Key Features

• Model Choice: Amazon Bedrock provides access to a variety of high-performing foundation models from leading AI companies such as AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon. You can easily experiment with and evaluate these models for your use case.
• Customization: You can privately customize the models with your data using techniques like fine-tuning and Retrieval Augmented Generation (RAG).
• Agents: You can build agents that execute tasks using your enterprise systems and data sources.
• Serverless: Since Amazon Bedrock is serverless, you don’t have to manage any infrastructure.
• Integration: You can securely incorporate and implement generative AI features into your applications using the AWS services you already know.

Additional Capabilities

• Text, Image, and Chat playgrounds: Amazon Bedrock provides playgrounds for text, chat, and image models. In these playgrounds, you can experiment with models before deciding to use them in an application.
• Examples library: Amazon Bedrock provides a code example library that includes AWS SDK examples available in the AWS Doc SDK Examples GitHub repo.
• Amazon Bedrock API: Amazon Bedrock provides a detailed API that includes actions and their parameters. It can be accessed using various AWS SDKs.
• Embeddings: Amazon Bedrock provides text and image embeddings that represent meaningful vector representations of unstructured text, such as documents, paragraphs, and sentences.
• Agents for Amazon Bedrock: These are AI-powered helpers that are constructed on the base models provided by Amazon Bedrock. They have the capability to perform tasks that involve multiple steps across various systems and data sources within an organization.
• Knowledge base for Amazon Bedrock: The knowledge base for Amazon Bedrock provides the capability of amassing data sources into a repository of information. With knowledge bases, you can easily build an application that takes advantage of retrieval augmented generation (RAG), a technique in which the retrieval of information from data sources augments the generation of model responses.
• Provisioned Throughput: When you configure Provisioned Throughput for a model in Amazon Bedrock, you receive a level of throughput at a fixed cost. You can use Provisioned Throughput with Amazon and third-party base models, as well as with customized models.
• Fine-tuning and Continued Pre-training: Amazon Bedrock provides a new capability that allows you to train Amazon Titan Text Express and Amazon Titan Text Lite foundation models and customize them using your own unlabeled data in a secure and managed environment.
• Model invocation logging: Model invocation logging is an optional feature in Amazon Bedrock that can be used to collect invocation logs, model input data, and model output data for all invocations in your AWS account used in Amazon Bedrock.
• Model versioning: Amazon Bedrock supports model versioning, allowing you to manage and use different versions of a model.

Pricing

• On-Demand and Batch: Pay-as-you-go, charged per input token processed and output token generated or image generated.
• Provisioned Throughput: Fixed cost for a certain throughput, suitable for large, consistent inference workloads.
• Model Customization: Charged for model training based on the total number of tokens processed by the model and for model storage per month per model.

Amazon Bedrock Cheat Sheet References:

https://aws.amazon.com/bedrock/
https://aws.amazon.com/bedrock/pricing/