Amazon Bedrock Runtime code examples for the SDK for Python

Overview

Shows how to use the AWS SDK for Python (Boto3) to work with Amazon Bedrock Runtime.

Amazon Bedrock Runtime is a fully managed service that makes it easy to use foundation models from third-party providers and Amazon.

⚠ Important

• Running this code might result in charges to your AWS account. For more details, see AWS Pricing and Free Tier.
• Running the tests might result in charges to your AWS account.
• We recommend that you grant your code least privilege. At most, grant only the minimum permissions required to perform the task. For more information, see Grant least privilege.
• This code is not tested in every AWS Region. For more information, see AWS Regional Services.

Code examples

Prerequisites

For prerequisites, see the README in the python folder.

Install the packages required by these examples by running the following in a virtual environment:

python -m pip install -r requirements.txt

⚠ You must request access to a model before you can use it. If you try to use the model (with the API or console) before you have requested access to it, you will receive an error message. For more information, see Model access.

Single actions

Code excerpts that show you how to call individual service functions.

• Image generation with Amazon Titan Image Generator G1 (InvokeModel)
• Image generation with Stability.ai Stable Diffusion XL (InvokeModel)
• Text generation with AI21 Labs Jurassic-2 (InvokeModel)
• Text generation with Anthropic Claude 2 (InvokeModel)
• Text generation with Anthropic Claude 2 with a response stream (InvokeModelWithResponseStream)
• Text generation with Meta Llama 2 Chat (InvokeModel)

Run the examples

Instructions

Run the example by executing the following command inside the example_code folder:

python bedrock_runtime_wrapper.py

Tests

⚠ Running tests might result in charges to your AWS account.

To find instructions for running these tests, see the README in the python folder.

Additional resources

• Amazon Bedrock Runtime User Guide
• Amazon Bedrock Runtime API Reference
• SDK for Python Amazon Bedrock Runtime reference

---

Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved.

SPDX-License-Identifier: Apache-2.0