AWS general documentation change
Summary
Updated regional endpoints for Asia Pacific (Hyderabad) and Osaka to include bedrock-runtime URLs and specify HTTPS protocol.
Security assessment
Change adds service endpoint details without mentioning security controls, encryption, or vulnerabilities.
Diff
diff --git a/general/latest/gr/bedrock.md index 051e562c9..2ba687cf1 100644 --- a/general/latest/gr/bedrock.md +++ b/general/latest/gr/bedrock.md @@ -52 +52 @@ US West (Oregon) | us-west-2 | bedrock-runtime.us-west-2.amazonaws.com bedrock -Asia Pacific (Hyderabad) | ap-south-2 | | +Asia Pacific (Hyderabad) | ap-south-2 | bedrock-runtime.ap-south-2.amazonaws.com | HTTPS @@ -54 +54 @@ Asia Pacific (Mumbai) | ap-south-1 | bedrock-runtime.ap-south-1.amazonaws.com -Asia Pacific (Osaka) | ap-northeast-3 | | +Asia Pacific (Osaka) | ap-northeast-3 | bedrock-runtime.ap-northeast-3.amazonaws.com | HTTPS @@ -124,42 +124,42 @@ Associated knowledge bases per Agent | Each supported Region: 2 | [Yes](https:/ -Batch inference input file size (in GB) for Claude 3 Haiku | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-42ABE687) | The maximum size of a single file (in GB) submitted for batch inference for Claude 3 Haiku. -Batch inference input file size (in GB) for Claude 3 Opus | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-0E729086) | The maximum size of a single file (in GB) submitted for batch inference for Claude 3 Opus. -Batch inference input file size (in GB) for Claude 3 Sonnet | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-067F7E01) | The maximum size of a single file (in GB) submitted for batch inference for Claude 3 Sonnet. -Batch inference input file size (in GB) for Claude 3.5 Haiku | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-B688EFA5) | The maximum size of a single file (in GB) submitted for batch inference for Claude 3.5 Haiku. -Batch inference input file size (in GB) for Claude 3.5 Sonnet | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-934360E8) | The maximum size of a single file (in GB) submitted for batch inference for Claude 3.5 Sonnet. -Batch inference input file size (in GB) for Claude 3.5 Sonnet v2 | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-5CBDB5BC) | The maximum size of a single file (in GB) submitted for batch inference for Claude 3.5 Sonnet v2. -Batch inference input file size (in GB) for Llama 3.1 405B Instruct | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-BCF9AED9) | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.1 405B Instruct. -Batch inference input file size (in GB) for Llama 3.1 70B Instruct | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-1CF3E033) | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.1 70B Instruct. -Batch inference input file size (in GB) for Llama 3.1 8B Instruct | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-F3A3096C) | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.1 8B Instruct. -Batch inference input file size (in GB) for Llama 3.2 11B Instruct | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-8E129B28) | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.2 11B Instruct. -Batch inference input file size (in GB) for Llama 3.2 1B Instruct | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-B8DED09F) | The maximum size of a single file (in GB) submitted for batch inference Llama 3.2 1B Instruct. -Batch inference input file size (in GB) for Llama 3.2 3B Instruct | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-8111AFAC) | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.2 3B Instruct. -Batch inference input file size (in GB) for Llama 3.2 90B Instruct | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-ACA7B6C2) | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.2 90B Instruct. -Batch inference input file size (in GB) for Llama 3.3 70B Instruct | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-CBAEEDF6) | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.3 70B Instruct. -Batch inference input file size (in GB) for Mistral Large 2 (24.07) | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-9F13DDE7) | The maximum size of a single file (in GB) submitted for batch inference for Mistral Large 2 (24.07). -Batch inference input file size (in GB) for Mistral Small | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-D32CEBC2) | The maximum size of a single file (in GB) submitted for batch inference for Mistral Small. -Batch inference input file size (in GB) for Nova Lite V1 | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-F60B56CC) | The maximum size of a single file (in GB) submitted for batch inference for Nova Lite V1. -Batch inference input file size (in GB) for Nova Micro V1 | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-F36E54E0) | The maximum size of a single file (in GB) submitted for batch inference for Nova Micro V1. -Batch inference input file size (in GB) for Nova Pro V1 | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-68FC8D47) | The maximum size of a single file (in GB) submitted for batch inference for Nova Pro V1. -Batch inference input file size (in GB) for Titan Multimodal Embeddings G1 | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-447BB329) | The maximum size of a single file (in GB) submitted for batch inference for Titan Multimodal Embeddings G1. -Batch inference input file size for Titan Text Embeddings V2 (in GB) | Each supported Region: 1 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-3CAACDCF) | The maximum size of a single file (in GB) submitted for batch inference for Titan Text Embeddings V2. -Batch inference job size (in GB) for Claude 3 Haiku | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-79301C5B) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Claude 3 Haiku. -Batch inference job size (in GB) for Claude 3 Opus | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-320F5AFC) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Claude 3 Opus. -Batch inference job size (in GB) for Claude 3 Sonnet | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-AB971C9B) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Claude 3 Sonnet. -Batch inference job size (in GB) for Claude 3.5 Haiku | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-987C98F5) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Claude 3.5 Haiku. -Batch inference job size (in GB) for Claude 3.5 Sonnet | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-6284B54D) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Claude 3.5 Sonnet. -Batch inference job size (in GB) for Claude 3.5 Sonnet v2 | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-A3D5E9F8) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Claude 3.5 Sonnet v2. -Batch inference job size (in GB) for Llama 3.1 405B Instruct | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-D50EA4E4) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.1 405B Instruct. -Batch inference job size (in GB) for Llama 3.1 70B Instruct | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-B2ADD004) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.1 70B Instruct. -Batch inference job size (in GB) for Llama 3.1 8B Instruct | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-8F302008) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.1 8B Instruct. -Batch inference job size (in GB) for Llama 3.2 11B Instruct | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-8D4EA85C) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.2 11B Instruct. -Batch inference job size (in GB) for Llama 3.2 1B Instruct | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-F777E93B) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.2 1B Instruct. -Batch inference job size (in GB) for Llama 3.2 3B Instruct | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-4090E58E) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.2 3B Instruct. -Batch inference job size (in GB) for Llama 3.2 90B Instruct | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-CAF2175F) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.2 90B Instruct. -Batch inference job size (in GB) for Llama 3.3 70B Instruct | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-3A7ED9C0) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.3 70B Instruct. -Batch inference job size (in GB) for Mistral Large 2 (24.07) | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-A83ECA24) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Mistral Large 2 (24.07). -Batch inference job size (in GB) for Mistral Small | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-0F052E16) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Mistral Small. -Batch inference job size (in GB) for Nova Lite V1 | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-19E52681) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Nova Lite V1. -Batch inference job size (in GB) for Nova Micro V1 | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-C79C2150) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Nova Micro V1. -Batch inference job size (in GB) for Nova Pro V1 | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-26B15D4D) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Nova Pro V1. -Batch inference job size (in GB) for Titan Multimodal Embeddings G1 | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-4C584163) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Titan Multimodal Embeddings G1. -Batch inference job size for Titan Text Embeddings V2 (in GB) | Each supported Region: 5 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-F687AD4D) | The maximum cumulative size of all input files (in GB) included in the batch inference job for Titan Text Embeddings V2. +Batch inference input file size (in GB) for Claude 3 Haiku | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Claude 3 Haiku. +Batch inference input file size (in GB) for Claude 3 Opus | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Claude 3 Opus. +Batch inference input file size (in GB) for Claude 3 Sonnet | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Claude 3 Sonnet. +Batch inference input file size (in GB) for Claude 3.5 Haiku | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Claude 3.5 Haiku. +Batch inference input file size (in GB) for Claude 3.5 Sonnet | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Claude 3.5 Sonnet. +Batch inference input file size (in GB) for Claude 3.5 Sonnet v2 | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Claude 3.5 Sonnet v2. +Batch inference input file size (in GB) for Llama 3.1 405B Instruct | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.1 405B Instruct. +Batch inference input file size (in GB) for Llama 3.1 70B Instruct | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.1 70B Instruct. +Batch inference input file size (in GB) for Llama 3.1 8B Instruct | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.1 8B Instruct. +Batch inference input file size (in GB) for Llama 3.2 11B Instruct | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.2 11B Instruct. +Batch inference input file size (in GB) for Llama 3.2 1B Instruct | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference Llama 3.2 1B Instruct. +Batch inference input file size (in GB) for Llama 3.2 3B Instruct | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.2 3B Instruct. +Batch inference input file size (in GB) for Llama 3.2 90B Instruct | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.2 90B Instruct. +Batch inference input file size (in GB) for Llama 3.3 70B Instruct | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Llama 3.3 70B Instruct. +Batch inference input file size (in GB) for Mistral Large 2 (24.07) | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Mistral Large 2 (24.07). +Batch inference input file size (in GB) for Mistral Small | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Mistral Small. +Batch inference input file size (in GB) for Nova Lite V1 | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Nova Lite V1. +Batch inference input file size (in GB) for Nova Micro V1 | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Nova Micro V1. +Batch inference input file size (in GB) for Nova Pro V1 | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Nova Pro V1. +Batch inference input file size (in GB) for Titan Multimodal Embeddings G1 | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Titan Multimodal Embeddings G1. +Batch inference input file size for Titan Text Embeddings V2 (in GB) | Each supported Region: 1 | No | The maximum size of a single file (in GB) submitted for batch inference for Titan Text Embeddings V2. +Batch inference job size (in GB) for Claude 3 Haiku | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Claude 3 Haiku. +Batch inference job size (in GB) for Claude 3 Opus | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Claude 3 Opus. +Batch inference job size (in GB) for Claude 3 Sonnet | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Claude 3 Sonnet. +Batch inference job size (in GB) for Claude 3.5 Haiku | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Claude 3.5 Haiku. +Batch inference job size (in GB) for Claude 3.5 Sonnet | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Claude 3.5 Sonnet. +Batch inference job size (in GB) for Claude 3.5 Sonnet v2 | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Claude 3.5 Sonnet v2. +Batch inference job size (in GB) for Llama 3.1 405B Instruct | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.1 405B Instruct. +Batch inference job size (in GB) for Llama 3.1 70B Instruct | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.1 70B Instruct. +Batch inference job size (in GB) for Llama 3.1 8B Instruct | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.1 8B Instruct. +Batch inference job size (in GB) for Llama 3.2 11B Instruct | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.2 11B Instruct. +Batch inference job size (in GB) for Llama 3.2 1B Instruct | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.2 1B Instruct. +Batch inference job size (in GB) for Llama 3.2 3B Instruct | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.2 3B Instruct. +Batch inference job size (in GB) for Llama 3.2 90B Instruct | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.2 90B Instruct. +Batch inference job size (in GB) for Llama 3.3 70B Instruct | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Llama 3.3 70B Instruct. +Batch inference job size (in GB) for Mistral Large 2 (24.07) | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Mistral Large 2 (24.07). +Batch inference job size (in GB) for Mistral Small | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Mistral Small. +Batch inference job size (in GB) for Nova Lite V1 | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Nova Lite V1. +Batch inference job size (in GB) for Nova Micro V1 | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Nova Micro V1. +Batch inference job size (in GB) for Nova Pro V1 | Each supported Region: 100 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Nova Pro V1. +Batch inference job size (in GB) for Titan Multimodal Embeddings G1 | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Titan Multimodal Embeddings G1. +Batch inference job size for Titan Text Embeddings V2 (in GB) | Each supported Region: 5 | No | The maximum cumulative size of all input files (in GB) included in the batch inference job for Titan Text Embeddings V2. @@ -196,0 +197 @@ Cross-Region InvokeModel tokens per minute for Anthropic Claude 3.5 Sonnet V2 | +Cross-region model inference requests per minute for Anthropic Claude 3.7 Sonnet V1 | Each supported Region: 250 | No | The maximum number of cross-region requests that you can submit for model inference in one minute for Anthropic Claude 3.7 Sonnet V1. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -197,0 +199 @@ Cross-region model inference requests per minute for Meta Llama 3.3 70B Instruct +Cross-region model inference tokens per minute for Anthropic Claude 3.7 Sonnet V1 | Each supported Region: 1,000,000 | No | The maximum number of cross-region tokens that you can submit for model inference in one minute for Anthropic Claude 3.7 Sonnet V1. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -264,21 +266,21 @@ Minimum number of prompts for distillation customization jobs | Each supported R -Minimum number of records per batch inference job for Claude 3 Haiku | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-AE7F26D4) | The minimum number of records across all input files in a batch inference job for Claude 3 Haiku. -Minimum number of records per batch inference job for Claude 3 Opus | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-FA9A1EBB) | The minimum number of records across all input files in a batch inference job for Claude 3 Opus. -Minimum number of records per batch inference job for Claude 3 Sonnet | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-FE6BC3E4) | The minimum number of records across all input files in a batch inference job for Claude 3 Sonnet. -Minimum number of records per batch inference job for Claude 3.5 Haiku | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-B48488BD) | The minimum number of records across all input files in a batch inference job for Claude 3.5 Haiku. -Minimum number of records per batch inference job for Claude 3.5 Sonnet | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-1E0DA3DF) | The minimum number of records across all input files in a batch inference job for Claude 3.5 Sonnet. -Minimum number of records per batch inference job for Claude 3.5 Sonnet v2 | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-1FA30AE7) | The minimum number of records across all input files in a batch inference job for Claude 3.5 Sonnet v2. -Minimum number of records per batch inference job for Llama 3.1 405B Instruct | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-A5CEDB91) | The minimum number of records across all input files in a batch inference job for Llama 3.1 405B Instruct. -Minimum number of records per batch inference job for Llama 3.1 70B Instruct | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-1EC9C5DF) | The minimum number of records across all input files in a batch inference job for Llama 3.1 70B Instruct. -Minimum number of records per batch inference job for Llama 3.1 8B Instruct | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-87482B04) | The minimum number of records across all input files in a batch inference job for Llama 3.1 8B Instruct. -Minimum number of records per batch inference job for Llama 3.2 11B Instruct | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-5BF45557) | The minimum number of records across all input files in a batch inference job for Llama 3.2 11B Instruct. -Minimum number of records per batch inference job for Llama 3.2 1B Instruct | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-539B5996) | The minimum number of records across all input files in a batch inference job Llama 3.2 1B Instruct. -Minimum number of records per batch inference job for Llama 3.2 3B Instruct | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-185CB521) | The minimum number of records across all input files in a batch inference job for Llama 3.2 3B Instruct. -Minimum number of records per batch inference job for Llama 3.2 90B Instruct | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-D4C72CE2) | The minimum number of records across all input files in a batch inference job for Llama 3.2 90B Instruct. -Minimum number of records per batch inference job for Llama 3.3 70B Instruct | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-E06E7FD6) | The minimum number of records across all input files in a batch inference job for Llama 3.3 70B Instruct. -Minimum number of records per batch inference job for Mistral Large 2 (24.07) | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-F12318F0) | The minimum number of records across all input files in a batch inference job for Mistral Large 2 (24.07). -Minimum number of records per batch inference job for Mistral Small | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-DE0A7679) | The minimum number of records across all input files in a batch inference job for Mistral Small. -Minimum number of records per batch inference job for Nova Lite V1 | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-39FA8DCA) | The minimum number of records across all input files in a batch inference job for Nova Lite V1. -Minimum number of records per batch inference job for Nova Micro V1 | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-534E6885) | The minimum number of records across all input files in a batch inference job for Nova Micro V1. -Minimum number of records per batch inference job for Nova Pro V1 | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-2A3EB975) | The minimum number of records across all input files in a batch inference job for Nova Pro V1. -Minimum number of records per batch inference job for Titan Multimodal Embeddings G1 | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-1A69C08F) | The minimum number of records across all input files in a batch inference job for Titan Multimodal Embeddings G1. -Minimum number of records per batch inference job for Titan Text Embeddings V2 | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-6F2B2616) | The minimum number of records across all input files in a batch inference job for Titan Text Embeddings V2. +Minimum number of records per batch inference job for Claude 3 Haiku | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Claude 3 Haiku. +Minimum number of records per batch inference job for Claude 3 Opus | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Claude 3 Opus. +Minimum number of records per batch inference job for Claude 3 Sonnet | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Claude 3 Sonnet. +Minimum number of records per batch inference job for Claude 3.5 Haiku | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Claude 3.5 Haiku. +Minimum number of records per batch inference job for Claude 3.5 Sonnet | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Claude 3.5 Sonnet. +Minimum number of records per batch inference job for Claude 3.5 Sonnet v2 | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Claude 3.5 Sonnet v2. +Minimum number of records per batch inference job for Llama 3.1 405B Instruct | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Llama 3.1 405B Instruct. +Minimum number of records per batch inference job for Llama 3.1 70B Instruct | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Llama 3.1 70B Instruct. +Minimum number of records per batch inference job for Llama 3.1 8B Instruct | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Llama 3.1 8B Instruct. +Minimum number of records per batch inference job for Llama 3.2 11B Instruct | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Llama 3.2 11B Instruct. +Minimum number of records per batch inference job for Llama 3.2 1B Instruct | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job Llama 3.2 1B Instruct. +Minimum number of records per batch inference job for Llama 3.2 3B Instruct | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Llama 3.2 3B Instruct. +Minimum number of records per batch inference job for Llama 3.2 90B Instruct | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Llama 3.2 90B Instruct. +Minimum number of records per batch inference job for Llama 3.3 70B Instruct | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Llama 3.3 70B Instruct. +Minimum number of records per batch inference job for Mistral Large 2 (24.07) | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Mistral Large 2 (24.07). +Minimum number of records per batch inference job for Mistral Small | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Mistral Small. +Minimum number of records per batch inference job for Nova Lite V1 | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Nova Lite V1. +Minimum number of records per batch inference job for Nova Micro V1 | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Nova Micro V1. +Minimum number of records per batch inference job for Nova Pro V1 | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Nova Pro V1. +Minimum number of records per batch inference job for Titan Multimodal Embeddings G1 | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Titan Multimodal Embeddings G1. +Minimum number of records per batch inference job for Titan Text Embeddings V2 | Each supported Region: 100 | No | The minimum number of records across all input files in a batch inference job for Titan Text Embeddings V2. @@ -323,0 +326 @@ Model units per provisioned model for Cohere Embed Multilingual | Each supported +Model units per provisioned model for DeepSeek R1 Distill Llama 3.3 70B | Each supported Region: 0 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-8519D248) | The maximum number of model units that can be allotted to a provisioned model for DeepSeek R1 Distill Llama 3.3 70B. @@ -331,0 +335 @@ Model units per provisioned model for Meta Llama 3.1 8B Instruct | Each supporte +Model units per provisioned model for Meta Llama 3.3 70B Instruct | Each supported Region: 0 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-52A668E3) | The maximum number of model units that can be allotted to a provisioned model for Meta Llama 3.3 70B Instruct. @@ -339,0 +344 @@ Number of custom prompt datasets in a human-based model evaluation job | Each su +Number of custom prompt routers per account | Each supported Region: 500 | No | The maximum number of custom prompt routers that you can create per account per region. @@ -361,0 +367 @@ On-demand InvokeModel requests per minute for Amazon Nova Pro | Each supported R +On-demand InvokeModel requests per minute for Amazon Rerank 1.0 | Each supported Region: 200 | No | The maximum number of times that you can call InvokeModel in one minute for Amazon Rerank 1.0. @@ -373 +379 @@ On-demand InvokeModel requests per minute for Anthropic Claude 3 Sonnet | us-ea -On-demand InvokeModel requests per minute for Anthropic Claude 3.5 Haiku | us-east-1: 1,000 us-west-2: 1,000 Each of the other supported Regions: 400 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Anthropic Claude 3.5 Haiku. +On-demand InvokeModel requests per minute for Anthropic Claude 3.5 Haiku | us-west-1: 400 Each of the other supported Regions: 1,000 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Anthropic Claude 3.5 Haiku. @@ -383,0 +390 @@ On-demand InvokeModel requests per minute for Cohere Embed Multilingual | Each s +On-demand InvokeModel requests per minute for Cohere Rerank 3.5 | Each supported Region: 250 | No | The maximum number of times that you can call InvokeModel in one minute for Cohere Rerank 3.5. @@ -420 +427 @@ On-demand InvokeModel tokens per minute for Anthropic Claude 3 Sonnet | us-east -On-demand InvokeModel tokens per minute for Anthropic Claude 3.5 Haiku | us-east-1: 2,000,000 us-west-2: 2,000,000 Each of the other supported Regions: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Anthropic Claude 3.5 Haiku. +On-demand InvokeModel tokens per minute for Anthropic Claude 3.5 Haiku | us-west-1: 300,000 Each of the other supported Regions: 2,000,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Anthropic Claude 3.5 Haiku. @@ -544,21 +551,2 @@ Sum of in-progress and submitted batch inference jobs using a base model for Tit -Sum of in-progress and submitted batch inference jobs using a custom model for Claude 3 Haiku | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-5B70DA89) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Claude 3 Haiku. -Sum of in-progress and submitted batch inference jobs using a custom model for Claude 3 Opus | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-0853875C) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Claude 3 Opus. -Sum of in-progress and submitted batch inference jobs using a custom model for Claude 3 Sonnet | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-DAF8F218) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Claude 3 Sonnet. -Sum of in-progress and submitted batch inference jobs using a custom model for Claude 3.5 Haiku | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-B88C24E2) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Claude 3.5 Haiku. -Sum of in-progress and submitted batch inference jobs using a custom model for Claude 3.5 Sonnet | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-ADCF6A0C) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Claude 3.5 Sonnet. -Sum of in-progress and submitted batch inference jobs using a custom model for Claude 3.5 Sonnet v2 | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-13874CC5) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Claude 3.5 Sonnet v2. -Sum of in-progress and submitted batch inference jobs using a custom model for Llama 3.1 405B Instruct | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-4827D78B) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Llama 3.1 405B Instruct. -Sum of in-progress and submitted batch inference jobs using a custom model for Llama 3.1 70B Instruct | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-F50F762B) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Llama 3.1 70B Instruct. -Sum of in-progress and submitted batch inference jobs using a custom model for Llama 3.1 8B Instruct | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-47A662DA) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Llama 3.1 8B Instruct. -Sum of in-progress and submitted batch inference jobs using a custom model for Llama 3.2 11B Instruct | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-EF8C45C9) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Llama 3.2 11B Instruct. -Sum of in-progress and submitted batch inference jobs using a custom model for Llama 3.2 1B Instruct | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-47874FB9) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Llama 3.2 1B Instruct. -Sum of in-progress and submitted batch inference jobs using a custom model for Llama 3.2 3B Instruct | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-6DA13EBF) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Llama 3.2 3B Instruct. -Sum of in-progress and submitted batch inference jobs using a custom model for Llama 3.2 90B Instruct | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-BD863763) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Llama 3.2 90B Instruct. -Sum of in-progress and submitted batch inference jobs using a custom model for Llama 3.3 70B Instruct | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-F82ABCA9) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Llama 3.3 70B Instruct. -Sum of in-progress and submitted batch inference jobs using a custom model for Mistral Large 2 (24.07) | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-26C798C3) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Mistral Large 2 (24.07). -Sum of in-progress and submitted batch inference jobs using a custom model for Mistral Small | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-77CACAB8) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Mistral Small. -Sum of in-progress and submitted batch inference jobs using a custom model for Nova Lite V1. | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-6E2D34D3) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Nova Lite V1 -Sum of in-progress and submitted batch inference jobs using a custom model for Nova Micro V1 | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-2ED8276D) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Nova Micro V1. -Sum of in-progress and submitted batch inference jobs using a custom model for Nova Pro V1 | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-F648D95F) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Nova Pro V1. -Sum of in-progress and submitted batch inference jobs using a custom model for Titan Multimodal Embeddings G1 | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-652C224A) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Titan Multimodal Embeddings G1. -Sum of in-progress and submitted batch inference jobs using a custom model for Titan Text Embeddings V2 | Each supported Region: 3 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-329D7443) | The maximum number of in-progress and submitted batch inference jobs using a custom model for Titan Text Embeddings V2 +Sum of in-progress and submitted batch inference jobs using a custom model for Titan Multimodal Embeddings G1 | Each supported Region: 3 | No | The maximum number of in-progress and submitted batch inference jobs using a custom model for Titan Multimodal Embeddings G1. +Sum of in-progress and submitted batch inference jobs using a custom model for Titan Text Embeddings V2 | Each supported Region: 3 | No | The maximum number of in-progress and submitted batch inference jobs using a custom model for Titan Text Embeddings V2 @@ -572,0 +561 @@ Sum of training and validation records for a Meta Llama 3.1 8B Instruct v1 Fine- +Sum of training and validation records for a Meta Llama 3.3 70B Instruct v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-48C95F85) | The maximum combined number of training and validation records allowed for a Meta Llama 3.3 70B Instruct Fine-tuning job.