AWS bedrock documentation change
Summary
Updated documentation to standardize capitalization from 'cross-region' to 'cross-Region' throughout the file
Security assessment
Changes are purely stylistic capitalization updates (Region vs region) without modifying security-related content. The existing security statement about encrypted transmission remains unchanged except for capitalization.
Diff
diff --git a/bedrock/latest/userguide/cross-region-inference.md b/bedrock/latest/userguide/cross-region-inference.md index 67a1472a7..8493db37b 100644 --- a/bedrock/latest/userguide/cross-region-inference.md +++ b/bedrock/latest/userguide/cross-region-inference.md @@ -5 +5 @@ -Use a cross-region (system-defined) inference profile +Use a cross-Region (system-defined) inference profile @@ -7 +7 @@ Use a cross-region (system-defined) inference profile -# Increase throughput with cross-region inference +# Increase throughput with cross-Region inference @@ -9 +9 @@ Use a cross-region (system-defined) inference profile -Cross-region inference automatically selects the optimal AWS Region within your geography to process your inference request. This improves customer experience by maximizing available resources and model availability. +Cross-Region inference automatically selects the optimal AWS Region within your geography to process your inference request. This improves customer experience by maximizing available resources and model availability. @@ -11 +11 @@ Cross-region inference automatically selects the optimal AWS Region within your -When running model inference in on-demand mode, your requests might be restricted by service quotas or during peak usage times. Cross-region inference enables you to seamlessly manage unplanned traffic bursts by utilizing compute across different AWS Regions. With cross-region inference, you can distribute traffic across multiple AWS Regions, enabling higher throughput. +When running model inference in on-demand mode, your requests might be restricted by service quotas or during peak usage times. Cross-Region inference enables you to seamlessly manage unplanned traffic bursts by utilizing compute across different AWS Regions. With cross-Region inference, you can distribute traffic across multiple AWS Regions, enabling higher throughput. @@ -15 +15 @@ You can also increase throughput for a model by purchasing [Provisioned Throughp -To see the Regions and models with which you can use inference profiles to run cross-region inference, refer to [Supported Regions and models for inference profiles](./inference-profiles-support.html). +To see the Regions and models with which you can use inference profiles to run cross-Region inference, refer to [Supported Regions and models for inference profiles](./inference-profiles-support.html). @@ -45 +45 @@ Inference profiles are immutable, meaning that we don't add new Regions to an ex -Note the following information about cross-region inference: +Note the following information about cross-Region inference: @@ -47 +47 @@ Note the following information about cross-region inference: - * There's no additional routing cost for using cross-region inference. The price is calculated based on the region from which you call an inference profile. For information about pricing, see [Amazon Bedrock pricing](https://aws.amazon.com/bedrock/pricing/). + * There's no additional routing cost for using cross-Region inference. The price is calculated based on the Region from which you call an inference profile. For information about pricing, see [Amazon Bedrock pricing](https://aws.amazon.com/bedrock/pricing/). @@ -49 +49 @@ Note the following information about cross-region inference: - * When using cross-region inference, your throughput can reach up to double the default quotas in the region that the inference profile is in. The increase in throughput only applies to invocation performed via inference profiles, the regular quota still applies if you opt for in-region model invocation request. For example, if you invoke the US Anthropic Claude 3 Sonnet inference profile in us-east-1, your throughput can reach up to 1,000 requests per minute and 2,000,000 tokens per minute. To see the default quotas for on-demand throughput, refer to the **Runtime quotas** section in [Quotas for Amazon Bedrock](./quotas.html) or use the Service Quotas console. + * When using cross-Region inference, your throughput can reach up to double the default quotas in the Region that the inference profile is in. The increase in throughput only applies to invocation performed via inference profiles, the regular quota still applies if you opt for in-Region model invocation request. For example, if you invoke the US Anthropic Claude 3 Sonnet inference profile in us-east-1, your throughput can reach up to 1,000 requests per minute and 2,000,000 tokens per minute. To see the default quotas for on-demand throughput, refer to the **Runtime quotas** section in [Quotas for Amazon Bedrock](./quotas.html) or use the Service Quotas console. @@ -51 +51 @@ Note the following information about cross-region inference: - * Cross-region inference requests are kept within the AWS Regions that are part of the geography where the data originally resides. For example, a request made within the US is kept within the AWS Regions in the US. Although the data remains stored only in the source region, your input prompts and output results might move outside of your source region during cross-region inference. All data will be transmitted encrypted across Amazon’s secure network. + * Cross-Region inference requests are kept within the AWS Regions that are part of the geography where the data originally resides. For example, a request made within the US is kept within the AWS Regions in the US. Although the data remains stored only in the source Region, your input prompts and output results might move outside of your source Region during cross-Region inference. All data will be transmitted encrypted across Amazon’s secure network. @@ -56 +56 @@ Note the following information about cross-region inference: -## Use a cross-region (system-defined) inference profile +## Use a cross-Region (system-defined) inference profile @@ -58 +58 @@ Note the following information about cross-region inference: -To use cross-region inference, you include an [inference profile](./inference-profiles.html) when running model inference in the following ways: +To use cross-Region inference, you include an [inference profile](./inference-profiles.html) when running model inference in the following ways: @@ -60 +60 @@ To use cross-region inference, you include an [inference profile](./inference-pr - * **On-demand model inference** – Specify the ID of the inference profile as the `modelId` when sending an [InvokeModel](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModel.html), [InvokeModelWithResponseStream](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModelWithResponseStream.html), [Converse](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html), or [ConverseStream](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_ConverseStream.html) request. An inference profile defines one or more Regions to which it can route inference requests originating from your source Region. Use of cross-region inference increases throughput and performance by dynamically routing model invocation requests across the regions defined in inference profile. Routing factors in user traffic, demand and utilization of resources. For more information, see [Submit prompts and generate responses with model inference](./inference.html) + * **On-demand model inference** – Specify the ID of the inference profile as the `modelId` when sending an [InvokeModel](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModel.html), [InvokeModelWithResponseStream](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModelWithResponseStream.html), [Converse](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html), or [ConverseStream](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_ConverseStream.html) request. An inference profile defines one or more Regions to which it can route inference requests originating from your source Region. Use of cross-Region inference increases throughput and performance by dynamically routing model invocation requests across the Regions defined in inference profile. Routing factors in user traffic, demand and utilization of resources. For more information, see [Submit prompts and generate responses with model inference](./inference.html) @@ -62 +62 @@ To use cross-region inference, you include an [inference profile](./inference-pr - * **Batch inference** – Submit requests asynchronously with batch inference by specifying the ID of the inference profile as the `modelId` when sending a [CreateModelInvocationJob](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_CreateModelInvocationJob.html) request. Using an inference profile lets you utilize compute across multiple AWS Regions and achieve faster processing times for your batch jobs. After the job is complete, you can retrieve the output files from the Amazon S3 bucket in the source region. + * **Batch inference** – Submit requests asynchronously with batch inference by specifying the ID of the inference profile as the `modelId` when sending a [CreateModelInvocationJob](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_CreateModelInvocationJob.html) request. Using an inference profile lets you utilize compute across multiple AWS Regions and achieve faster processing times for your batch jobs. After the job is complete, you can retrieve the output files from the Amazon S3 bucket in the source Region. @@ -64 +64 @@ To use cross-region inference, you include an [inference profile](./inference-pr - * **Knowledge base response generation** – You can use cross-region inference when generating a response after querying a knowledge base. For more information, see [Test your knowledge base with queries and responses](./knowledge-base-test.html). + * **Knowledge base response generation** – You can use cross-Region inference when generating a response after querying a knowledge base. For more information, see [Test your knowledge base with queries and responses](./knowledge-base-test.html). @@ -68 +68 @@ To use cross-region inference, you include an [inference profile](./inference-pr - * **Prompt management** – You can use cross-region inference when generating a response for a prompt you created in Prompt management. For more information, see [Construct and store reusable prompts with Prompt management in Amazon Bedrock](./prompt-management.html) + * **Prompt management** – You can use cross-Region inference when generating a response for a prompt you created in Prompt management. For more information, see [Construct and store reusable prompts with Prompt management in Amazon Bedrock](./prompt-management.html) @@ -70 +70 @@ To use cross-region inference, you include an [inference profile](./inference-pr - * **Prompt flows** – You can use cross-region inference when generating a response for a prompt you define inline in a prompt node in a prompt flow. For more information, see [Build an end-to-end generative AI workflow with Amazon Bedrock Flows](./flows.html). + * **Prompt flows** – You can use cross-Region inference when generating a response for a prompt you define inline in a prompt node in a prompt flow. For more information, see [Build an end-to-end generative AI workflow with Amazon Bedrock Flows](./flows.html). @@ -77 +77 @@ To learn how to use an inference profile to send model invocation requests acros -To learn more about cross-region inference, see [Getting started with cross-region inference in Amazon Bedrock](https://aws.amazon.com/blogs/machine-learning/getting-started-with-cross-region-inference-in-amazon-bedrock/). +To learn more about cross-Region inference, see [Getting started with cross-Region inference in Amazon Bedrock](https://aws.amazon.com/blogs/machine-learning/getting-started-with-cross-region-inference-in-amazon-bedrock/).