AWS general documentation change
Summary
Added multiple model customization quotas and updated existing service limits. Removed redundant entries and standardized terminology from 'InvokeModel' to 'model inference' across multiple sections. Updated region-specific quotas and added new model-specific limits.
Security assessment
Changes focus on service quotas, API terminology standardization, and model-specific limits without addressing security vulnerabilities or introducing security features. No evidence of security patches or vulnerability disclosures.
Diff
diff --git a/general/latest/gr/bedrock.md b/general/latest/gr/bedrock.md index e9eca0178..87aadf39a 100644 --- a//general/latest/gr/bedrock.md +++ b//general/latest/gr/bedrock.md @@ -231,0 +232,32 @@ Name | Default | Adjustable | Description +(Model customization) Custom models per account | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-CB5B847D) | The maximum number of custom models in an account. +(Model customization) Maximum input file size for distillation customization jobs | Each supported Region: 2 Gigabytes | No | The maximum input file size for distillation customization jobs. +(Model customization) Maximum line length for distillation customization jobs | Each supported Region: 16 Kilobytes | No | The maximum line length in input file for distillation customization jobs. +(Model customization) Maximum number of prompts for distillation customization jobs | Each supported Region: 15,000 | No | The maximum number of prompts required for distillation customization jobs. +(Model customization) Maximum student model fine tuning context length for Amazon Nova Micro V1 distillation customization jobs | Each supported Region: 32,000 | No | The maximum student model fine tuning context length for Amazon Nova Micro V1 distillation customization jobs. +(Model customization) Maximum student model fine tuning context length for Amazon Nova V1 distillation customization jobs | Each supported Region: 32,000 | No | The maximum student model fine tuning context length for Amazon Nova V1 distillation customization jobs. +(Model customization) Maximum student model fine tuning context length for Anthropic Claude 3 haiku 20240307 V1 distillation customization jobs | Each supported Region: 32,000 | No | The maximum student model fine tuning context length for Anthropic Claude 3 haiku 20240307 V1 distillation customization jobs. +(Model customization) Maximum student model fine tuning context length for Llama 3.1 70B Instruct V1 distillation customization jobs | Each supported Region: 16,000 | No | The maximum student model fine tuning context length for Llama 3.1 70B Instruct V1 distillation customization jobs. +(Model customization) Maximum student model fine tuning context length for Llama 3.1 8B Instruct V1 distillation customization jobs | Each supported Region: 32,000 | No | The maximum student model fine tuning context length for Llama 3.1 8B Instruct V1 distillation customization jobs. +(Model customization) Minimum number of prompts for distillation customization jobs | Each supported Region: 100 | No | The minimum number of prompts required for distillation customization jobs. +(Model customization) Scheduled customization jobs | Each supported Region: 2 | No | The maximum number of scheduled customization jobs. +(Model customization) Sum of training and validation records for a Amazon Nova Lite Fine-tuning job | Each supported Region: 20,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-031F46A7) | The maximum combined number of training and validation records allowed for a Amazon Nova Lite Fine-tuning job. +(Model customization) Sum of training and validation records for a Amazon Nova Micro Fine-tuning job | Each supported Region: 20,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-EC6A6ABC) | The maximum combined number of training and validation records allowed for a Amazon Nova Micro Fine-tuning job. +(Model customization) Sum of training and validation records for a Amazon Nova Pro Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-70FC4C0E) | The maximum combined number of training and validation records allowed for a Amazon Nova Pro Fine-tuning job. +(Model customization) Sum of training and validation records for a Claude 3 Haiku v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-679179D2) | The maximum combined number of training and validation records allowed for a Claude 3 Haiku Fine-tuning job. +(Model customization) Sum of training and validation records for a Claude 3-5-Haiku v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-ADA98D8D) | The maximum combined number of training and validation records allowed for a Claude 3-5-Haiku Fine-tuning job. +(Model customization) Sum of training and validation records for a Meta Llama 2 13B v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-68AE6C02) | The maximum combined number of training and validation records allowed for a Meta Llama 2 13B Fine-tuning job. +(Model customization) Sum of training and validation records for a Meta Llama 2 70B v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-5A222661) | The maximum combined number of training and validation records allowed for a Meta Llama 2 70B Fine-tuning job. +(Model customization) Sum of training and validation records for a Meta Llama 3.1 70B Instruct v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-63EC9D04) | The maximum combined number of training and validation records allowed for a Meta Llama 3.1 70B Instruct Fine-tuning job. +(Model customization) Sum of training and validation records for a Meta Llama 3.1 8B Instruct v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-34C933D1) | The maximum combined number of training and validation records allowed for a Meta Llama 3.1 8B Instruct Fine-tuning job. +(Model customization) Sum of training and validation records for a Meta Llama 3.2 11B Instruct v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-E5FD5C04) | The maximum combined number of training and validation records allowed for a Meta Llama 3.2 11B Instruct Fine-tuning job. +(Model customization) Sum of training and validation records for a Meta Llama 3.2 1B Instruct v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-70B8359C) | The maximum combined number of training and validation records allowed for a Meta Llama 3.2 1B Instruct Fine-tuning job. +(Model customization) Sum of training and validation records for a Meta Llama 3.2 3B Instruct v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-75A18A04) | The maximum combined number of training and validation records allowed for a Meta Llama 3.2 3B Instruct Fine-tuning job. +(Model customization) Sum of training and validation records for a Meta Llama 3.2 90B Instruct v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-8076814C) | The maximum combined number of training and validation records allowed for a Meta Llama 3.2 90B Instruct Fine-tuning job. +(Model customization) Sum of training and validation records for a Titan Image Generator G1 V1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-73BBA086) | The maximum combined number of training and validation records allowed for a Titan Image Generator Fine-tuning job. +(Model customization) Sum of training and validation records for a Titan Image Generator G1 V2 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-F15FCC01) | The maximum combined number of training and validation records allowed for a Titan Image Generator V2 Fine-tuning job. +(Model customization) Sum of training and validation records for a Titan Multimodal Embeddings G1 v1 Fine-tuning job | Each supported Region: 50,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-BB313AA3) | The maximum combined number of training and validation records allowed for a Titan Multimodal Embeddings Fine-tuning job. +(Model customization) Sum of training and validation records for a Titan Text G1 - Express v1 Continued Pre-Training job | Each supported Region: 100,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-CDD9DC4A) | The maximum combined number of training and validation records allowed for a Titan Text Express Continued Pre-Training job. +(Model customization) Sum of training and validation records for a Titan Text G1 - Express v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-79BA683B) | The maximum combined number of training and validation records allowed for a Titan Text Express Fine-tuning job. +(Model customization) Sum of training and validation records for a Titan Text G1 - Lite v1 Continued Pre-Training job | Each supported Region: 100,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-91554672) | The maximum combined number of training and validation records allowed for a Titan Text Lite Continued Pre-Training job. +(Model customization) Sum of training and validation records for a Titan Text G1 - Lite v1 Fine-tuning job | Each supported Region: 10,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-3B82104D) | The maximum combined number of training and validation records allowed for a Titan Text Lite Fine-tuning job. +(Model customization) Sum of training and validation records for a Titan Text G1 - Premier v1 Fine-tuning job | Each supported Region: 20,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-C0CACF50) | The maximum combined number of training and validation records allowed for a Titan Text Premier Fine-tuning job. @@ -300 +331,0 @@ Cross-Region InvokeModel requests per minute for Anthropic Claude 3.5 Haiku | Ea -Cross-Region InvokeModel requests per minute for Anthropic Claude 3.5 Sonnet V2 | us-west-2: 500 Each of the other supported Regions: 100 | No | The maximum number of times that you can call model inference in one minute for Anthropic Claude 3.5 Sonnet V2. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -302,7 +333,2 @@ Cross-Region InvokeModel tokens per minute for Anthropic Claude 3.5 Haiku | Each -Cross-Region InvokeModel tokens per minute for Anthropic Claude 3.5 Sonnet V2 | us-west-2: 4,000,000 Each of the other supported Regions: 800,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-FF8B4E28) | The maximum number of tokens that you can submit for model inference in one minute for Anthropic Claude 3.5 Sonnet V2. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. -Cross-region InvokeModel requests per minute for Anthropic Claude 3 Haiku | us-east-1: 2,000 us-west-2: 2,000 ap-northeast-1: 400 ap-southeast-1: 400 Each of the other supported Regions: 800 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Anthropic Claude 3 Haiku. -Cross-region InvokeModel requests per minute for Anthropic Claude 3 Sonnet | us-east-1: 1,000 us-west-2: 1,000 Each of the other supported Regions: 200 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Anthropic Claude 3 Sonnet. -Cross-region InvokeModel requests per minute for Anthropic Claude 3.5 Sonnet | us-west-2: 500 ap-northeast-1: 40 ap-southeast-1: 40 eu-central-1: 40 eu-west-1: 40 eu-west-3: 40 Each of the other supported Regions: 100 | No | The maximum number of times that you can call model inference in one minute for Anthropic Claude 3.5 Sonnet. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. -Cross-region InvokeModel tokens per minute for Anthropic Claude 3 Haiku | us-east-1: 4,000,000 us-west-2: 4,000,000 ap-northeast-1: 400,000 ap-southeast-1: 400,000 Each of the other supported Regions: 600,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-DCADBC78) | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Anthropic Claude 3 Haiku. -Cross-region InvokeModel tokens per minute for Anthropic Claude 3 Sonnet | us-east-1: 2,000,000 us-west-2: 2,000,000 Each of the other supported Regions: 400,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-5DF13F64) | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Anthropic Claude 3 Sonnet. -Cross-region InvokeModel tokens per minute for Anthropic Claude 3.5 Sonnet | us-west-2: 4,000,000 ap-northeast-1: 400,000 ap-southeast-1: 400,000 eu-central-1: 400,000 eu-west-1: 400,000 eu-west-3: 400,000 Each of the other supported Regions: 800,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-479B647F) | The maximum number of tokens that you can submit for model inference in one minute for Anthropic Claude 3.5 Sonnet. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-Region model inference requests per minute for Anthropic Claude 3.5 Sonnet V2 | us-west-2: 500 Each of the other supported Regions: 100 | No | The maximum number of times that you can call model inference in one minute for Anthropic Claude 3.5 Sonnet V2. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-Region model inference tokens per minute for Anthropic Claude 3.5 Sonnet V2 | us-west-2: 4,000,000 Each of the other supported Regions: 800,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-FF8B4E28) | The maximum number of tokens that you can submit for model inference in one minute for Anthropic Claude 3.5 Sonnet V2. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -312,0 +339 @@ Cross-region model inference requests per minute for Amazon Nova Pro | us-east- +Cross-region model inference requests per minute for Anthropic Claude 3 Haiku | us-east-1: 2,000 us-west-2: 2,000 ap-northeast-1: 400 ap-southeast-1: 400 Each of the other supported Regions: 800 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Anthropic Claude 3 Haiku. @@ -314 +341,3 @@ Cross-region model inference requests per minute for Anthropic Claude 3 Opus | E -Cross-region model inference requests per minute for Anthropic Claude 3.7 Sonnet V1 | us-east-1: 250 us-east-2: 250 us-west-2: 250 eu-central-1: 100 eu-north-1: 100 eu-west-1: 100 eu-west-3: 100 Each of the other supported Regions: 50 | No | The maximum number of cross-region requests that you can submit for model inference in one minute for Anthropic Claude 3.7 Sonnet V1. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-region model inference requests per minute for Anthropic Claude 3 Sonnet | us-east-1: 1,000 us-west-2: 1,000 Each of the other supported Regions: 200 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Anthropic Claude 3 Sonnet. +Cross-region model inference requests per minute for Anthropic Claude 3.5 Sonnet | us-west-2: 500 ap-northeast-1: 40 ap-southeast-1: 40 eu-central-1: 40 eu-west-1: 40 eu-west-3: 40 Each of the other supported Regions: 100 | No | The maximum number of times that you can call model inference in one minute for Anthropic Claude 3.5 Sonnet. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-region model inference requests per minute for Anthropic Claude 3.7 Sonnet V1 | us-east-1: 250 us-east-2: 250 us-west-2: 250 eu-central-1: 100 eu-north-1: 100 eu-west-1: 100 eu-west-2: 250 eu-west-3: 100 Each of the other supported Regions: 50 | No | The maximum number of cross-region requests that you can submit for model inference in one minute for Anthropic Claude 3.7 Sonnet V1. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -329,2 +358,2 @@ Cross-region model inference requests per minute for Writer AI Palmyra X5 V1 | E -Cross-region model inference tokens per minute for Amazon Nova Lite | us-east-1: 4,000,000 us-east-2: 4,000,000 us-west-1: 4,000,000 us-west-2: 4,000,000 Each of the other supported Regions: 200,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-7C42E72A) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Amazon Nova Lite. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. -Cross-region model inference tokens per minute for Amazon Nova Micro | us-east-1: 4,000,000 us-east-2: 4,000,000 us-west-1: 4,000,000 us-west-2: 4,000,000 Each of the other supported Regions: 200,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-DC7FF66C) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Amazon Nova Micro. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-region model inference tokens per minute for Amazon Nova Lite | us-east-1: 4,000,000 us-east-2: 4,000,000 us-west-1: 4,000,000 us-west-2: 4,000,000 Each of the other supported Regions: 200,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-7C42E72A) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Amazon Nova Lite. The quota considers the combined sum of input and output tokens across all requests to Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-region model inference tokens per minute for Amazon Nova Micro | us-east-1: 4,000,000 us-east-2: 4,000,000 us-west-1: 4,000,000 us-west-2: 4,000,000 Each of the other supported Regions: 200,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-DC7FF66C) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Amazon Nova Micro. The quota considers the combined sum of input and output tokens across all requests to Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -332 +361,2 @@ Cross-region model inference tokens per minute for Amazon Nova Premier V1 | Each -Cross-region model inference tokens per minute for Amazon Nova Pro | us-east-1: 800,000 us-east-2: 800,000 us-west-1: 800,000 us-west-2: 800,000 Each of the other supported Regions: 200,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-C0326783) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Amazon Nova Pro. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-region model inference tokens per minute for Amazon Nova Pro | us-east-1: 800,000 us-east-2: 800,000 us-west-1: 800,000 us-west-2: 800,000 Each of the other supported Regions: 200,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-C0326783) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Amazon Nova Pro. The quota considers the combined sum of input and output tokens across all requests to Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-region model inference tokens per minute for Anthropic Claude 3 Haiku | us-east-1: 4,000,000 us-west-2: 4,000,000 ap-northeast-1: 400,000 ap-southeast-1: 400,000 Each of the other supported Regions: 600,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-DCADBC78) | The maximum number of on-demand tokens that you can submit for model inference in one minute. The quota considers the combined sum of input and output tokens across all requests to Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Anthropic Claude 3 Haiku. @@ -334 +364,3 @@ Cross-region model inference tokens per minute for Anthropic Claude 3 Opus | Eac -Cross-region model inference tokens per minute for Anthropic Claude 3.7 Sonnet V1 | us-east-1: 1,000,000 us-east-2: 1,000,000 us-west-2: 1,000,000 eu-central-1: 100,000 eu-north-1: 100,000 eu-west-1: 100,000 eu-west-3: 100,000 Each of the other supported Regions: 50,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-6E888CC2) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Anthropic Claude 3.7 Sonnet V1. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-region model inference tokens per minute for Anthropic Claude 3 Sonnet | us-east-1: 2,000,000 us-west-2: 2,000,000 Each of the other supported Regions: 400,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-5DF13F64) | The maximum number of on-demand tokens that you can submit for model inference in one minute. The quota considers the combined sum of input and output tokens across all requests to Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Anthropic Claude 3 Sonnet. +Cross-region model inference tokens per minute for Anthropic Claude 3.5 Sonnet | us-west-2: 4,000,000 ap-northeast-1: 400,000 ap-southeast-1: 400,000 eu-central-1: 400,000 eu-west-1: 400,000 eu-west-3: 400,000 Each of the other supported Regions: 800,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-479B647F) | The maximum number of tokens that you can submit for model inference in one minute for Anthropic Claude 3.5 Sonnet. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-region model inference tokens per minute for Anthropic Claude 3.7 Sonnet V1 | us-east-1: 1,000,000 us-east-2: 1,000,000 us-west-2: 1,000,000 eu-central-1: 100,000 eu-north-1: 100,000 eu-west-1: 100,000 eu-west-2: 1,000,000 eu-west-3: 100,000 Each of the other supported Regions: 50,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-6E888CC2) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Anthropic Claude 3.7 Sonnet V1. The quota considers the combined sum of input and output tokens across all requests to Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -336 +368 @@ Cross-region model inference tokens per minute for Anthropic Claude Opus 4 V1 | -Cross-region model inference tokens per minute for Anthropic Claude Sonnet 4 V1 | Each supported Region: 200,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-59759B4A) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Anthropic Claude Sonnet 4 V1. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-region model inference tokens per minute for Anthropic Claude Sonnet 4 V1 | Each supported Region: 200,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-59759B4A) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Anthropic Claude Sonnet 4 V1. The quota considers the combined sum of input and output tokens across all requests to Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -341 +373 @@ Cross-region model inference tokens per minute for Meta Llama 3.1 8B Instruct | -Cross-region model inference tokens per minute for Meta Llama 3.2 1B Instruct | Each supported Region: 600,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-BD9FDA6F) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Meta Llama 3.2 1B Instruct. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-region model inference tokens per minute for Meta Llama 3.2 1B Instruct | Each supported Region: 600,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-BD9FDA6F) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Meta Llama 3.2 1B Instruct. The quota considers the combined sum of input and output tokens across all requests to Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -346 +378 @@ Cross-region model inference tokens per minute for Meta Llama 4 Scout V1 | Each -Cross-region model inference tokens per minute for Mistral Pixtral Large 25.02 V1 | Each supported Region: 80,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-4B9F76B0) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Mistral Pixtral Large 25.02 V1. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Cross-region model inference tokens per minute for Mistral Pixtral Large 25.02 V1 | Each supported Region: 80,000 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-4B9F76B0) | The maximum number of cross-region tokens that you can submit for model inference in one minute for Mistral Pixtral Large 25.02 V1. The quota considers the combined sum of input and output tokens across all requests to Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -349 +380,0 @@ Cross-region model inference tokens per minute for Writer AI Palmyra X5 V1 | Eac -Custom models per account | Each supported Region: 100 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-CB5B847D) | The maximum number of custom models in an account. @@ -392,9 +422,0 @@ ListPrompts requests per second | Each supported Region: 10 | No | The maximum n -Maximum input file size for distillation customization jobs | Each supported Region: 2 Gigabytes | No | The maximum input file size for distillation customization jobs. -Maximum line length for distillation customization jobs | Each supported Region: 16 Kilobytes | No | The maximum line length in input file for distillation customization jobs. -Maximum number of prompts for distillation customization jobs | Each supported Region: 15,000 | No | The maximum number of prompts required for distillation customization jobs. -Maximum student model fine tuning context length for Amazon Nova Micro V1 distillation customization jobs | Each supported Region: 32,000 | No | The maximum student model fine tuning context length for Amazon Nova Micro V1 distillation customization jobs. -Maximum student model fine tuning context length for Amazon Nova V1 distillation customization jobs | Each supported Region: 32,000 | No | The maximum student model fine tuning context length for Amazon Nova V1 distillation customization jobs. -Maximum student model fine tuning context length for Anthropic Claude 3 haiku 20240307 V1 distillation customization jobs | Each supported Region: 32,000 | No | The maximum student model fine tuning context length for Anthropic Claude 3 haiku 20240307 V1 distillation customization jobs. -Maximum student model fine tuning context length for Llama 3.1 70B Instruct V1 distillation customization jobs | Each supported Region: 16,000 | No | The maximum student model fine tuning context length for Llama 3.1 70B Instruct V1 distillation customization jobs. -Maximum student model fine tuning context length for Llama 3.1 8B Instruct V1 distillation customization jobs | Each supported Region: 32,000 | No | The maximum student model fine tuning context length for Llama 3.1 8B Instruct V1 distillation customization jobs. -Minimum number of prompts for distillation customization jobs | Each supported Region: 100 | No | The minimum number of prompts required for distillation customization jobs. @@ -424,0 +447 @@ Model invocation max tokens per day for Amazon Nova Premier V1 | Each supported +Model invocation max tokens per day for Anthropic Claude 3.7 Sonnet V1 | Each supported Region: 720,000,000 | No | The maximum number of tokens that you can submit for model inference in one day for Anthropic Claude 3.7 Sonnet V1. The quota considers the combined sum of input and output tokens across all requests to Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -426 +449 @@ Model invocation max tokens per day for Anthropic Claude Opus 4 V1 | Each suppor -Model invocation max tokens per day for Anthropic Claude Sonnet 4 V1 | Each supported Region: 144,000,000 | No | The maximum number of tokens that you can submit for model inference in one day for Anthropic Claude Sonnet 4 V1. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +Model invocation max tokens per day for Anthropic Claude Sonnet 4 V1 | Each supported Region: 144,000,000 | No | The maximum number of tokens that you can submit for model inference in one day for Anthropic Claude Sonnet 4 V1. The quota considers the combined sum of input and output tokens across all requests to Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -428,2 +451,2 @@ Model invocation max tokens per day for DeepSeek R1 V1 | Each supported Region: -Model units no-commitment Provisioned Throughputs across base models | eu-central-1: 0 Each of the other supported Regions: 2 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-FE44174A) | The maximum number of model units that can be distributed across no-commitment Provisioned Throughputs for base models -Model units no-commitment Provisioned Throughputs across custom models | eu-central-1: 0 Each of the other supported Regions: 2 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-BE77399C) | The maximum number of model units that can be distributed across no-commitment Provisioned Throughputs for custom models +Model units no-commitment Provisioned Throughputs across base models | Each supported Region: 0 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-FE44174A) | The maximum number of model units that can be distributed across no-commitment Provisioned Throughputs for base models +Model units no-commitment Provisioned Throughputs across custom models | Each supported Region: 0 | [Yes](https://console.aws.amazon.com/servicequotas/home/services/bedrock/quotas/L-BE77399C) | The maximum number of model units that can be distributed across no-commitment Provisioned Throughputs for custom models @@ -494,2 +517,2 @@ Model units, with commitment, for Provisioned Throughout created for Meta Maveri -No-commitment model units for Provisioned Throughput created for base model Amazon Nova Canvas V1.0 | Each supported Region: 1 | No | The maximum number of model units that can be allocated to a Provisioned Throughput created for the base model Amazon Nova Canvas V1.0, with no commitment. -No-commitment model units for Provisioned Throughput created for custom model Amazon Nova Canvas V1 0 | Each supported Region: 1 | No | The maximum number of model units that can be allocated to a Provisioned Throughput created for the custom model Amazon Nova Canvas V1 0, with no commitment. +No-commitment model units for Provisioned Throughput created for base model Amazon Nova Canvas V1.0 | Each supported Region: 0 | No | The maximum number of model units that can be allocated to a Provisioned Throughput created for the base model Amazon Nova Canvas V1.0, with no commitment. +No-commitment model units for Provisioned Throughput created for custom model Amazon Nova Canvas V1 0 | Each supported Region: 0 | No | The maximum number of model units that can be allocated to a Provisioned Throughput created for the custom model Amazon Nova Canvas V1 0, with no commitment. @@ -507,10 +529,0 @@ On-demand InvokeModel requests per minute for AI21 Labs Jamba Instruct | Each su -On-demand InvokeModel requests per minute for AI21 Labs Jurassic-2 Mid | Each supported Region: 400 | No | The maximum number of times that you can call InvokeModel in one minute for AI21 Labs Jurassic-2 Mid -On-demand InvokeModel requests per minute for AI21 Labs Jurassic-2 Ultra | Each supported Region: 100 | No | The maximum number of times that you can call InvokeModel in one minute for AI21 Labs Jurassic-2 Ultra -On-demand InvokeModel requests per minute for Amazon Nova Canvas | Each supported Region: 100 | No | The maximum number of requests that you can submit for model inference in one minute for Amazon Nova Canvas. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. -On-demand InvokeModel requests per minute for Amazon Rerank 1.0 | Each supported Region: 200 | No | The maximum number of times that you can call InvokeModel in one minute for Amazon Rerank 1.0. -On-demand InvokeModel requests per minute for Amazon Titan Image Generator G1 | Each supported Region: 60 | No | The maximum number of times that you can call InvokeModel in one minute for Amazon Titan Image Generator G1. -On-demand InvokeModel requests per minute for Amazon Titan Multimodal Embeddings G1 | Each supported Region: 2,000 | No | The maximum number of times that you can call InvokeModel in one minute for Amazon Titan Multimodal Embeddings G1. -On-demand InvokeModel requests per minute for Amazon Titan Text Embeddings | Each supported Region: 2,000 | No | The maximum number of times that you can call InvokeModel in one minute for Amazon Titan Text Embeddings -On-demand InvokeModel requests per minute for Amazon Titan Text Embeddings V2 | Each supported Region: 2,000 | No | The maximum number of times that you can call InvokeModel in one minute for Amazon Titan Text Embeddings V2 -On-demand InvokeModel requests per minute for Amazon Titan Text Express | Each supported Region: 400 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Amazon Titan Text Express -On-demand InvokeModel requests per minute for Amazon Titan Text Lite | Each supported Region: 800 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Amazon Titan Text Lite @@ -518,3 +530,0 @@ On-demand InvokeModel requests per minute for Amazon Titan Text Premier | Each s -On-demand InvokeModel requests per minute for Anthropic Claude 3 Haiku | us-east-1: 1,000 us-west-2: 1,000 ap-northeast-1: 200 ap-southeast-1: 200 Each of the other supported Regions: 400 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Anthropic Claude 3 Haiku. -On-demand InvokeModel requests per minute for Anthropic Claude 3 Sonnet | us-east-1: 500 us-west-2: 500 Each of the other supported Regions: 100 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Anthropic Claude 3 Sonnet. -On-demand InvokeModel requests per minute for Anthropic Claude 3.5 Sonnet | us-east-1: 50 us-east-2: 50 us-west-2: 250 ap-northeast-2: 50 ap-south-1: 50 ap-southeast-2: 50 Each of the other supported Regions: 20 | No | The maximum number of times that you can call model inference in one minute for Anthropic Claude 3.5 Sonnet. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -522,14 +531,0 @@ On-demand InvokeModel requests per minute for Anthropic Claude 3.5 Sonnet V2 | -On-demand InvokeModel requests per minute for Anthropic Claude Instant | us-east-1: 1,000 us-west-2: 1,000 Each of the other supported Regions: 400 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Anthropic Claude Instant -On-demand InvokeModel requests per minute for Anthropic Claude V2 | us-east-1: 500 us-west-2: 500 Each of the other supported Regions: 100 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Anthropic Claude V2 -On-demand InvokeModel requests per minute for Cohere Command | Each supported Region: 400 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Cohere Command. -On-demand InvokeModel requests per minute for Cohere Command Light | Each supported Region: 800 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Cohere Command Light. -On-demand InvokeModel requests per minute for Cohere Command R | Each supported Region: 400 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Cohere Command R 128k. -On-demand InvokeModel requests per minute for Cohere Command R Plus | Each supported Region: 400 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Cohere Command R Plus 128k. -On-demand InvokeModel requests per minute for Cohere Embed English | Each supported Region: 2,000 | No | The maximum number of times that you can call InvokeModel in one minute for Cohere Embed English. -On-demand InvokeModel requests per minute for Cohere Embed Multilingual | Each supported Region: 2,000 | No | The maximum number of times that you can call InvokeModel in one minute for Cohere Embed Multilingual. -On-demand InvokeModel requests per minute for Cohere Rerank 3.5 | Each supported Region: 250 | No | The maximum number of times that you can call InvokeModel in one minute for Cohere Rerank 3.5. -On-demand InvokeModel requests per minute for Meta Llama 2 13B | Each supported Region: 800 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Meta Llama 2 13B. -On-demand InvokeModel requests per minute for Meta Llama 2 70B | Each supported Region: 400 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Meta Llama 2 70B. -On-demand InvokeModel requests per minute for Meta Llama 2 Chat 13B | Each supported Region: 800 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Meta Llama 2 Chat 13B. -On-demand InvokeModel requests per minute for Meta Llama 2 Chat 70B | Each supported Region: 400 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream requests for Meta Llama 2 Chat 70B. -On-demand InvokeModel requests per minute for Mistral 7B Instruct | Each supported Region: 800 | No | The maximum number of times that you can call InvokeModel in one minute for Mistral mistral-7b-instruct-v0 @@ -537,2 +532,0 @@ On-demand InvokeModel requests per minute for Mistral AI Mistral Small | Each su -On-demand InvokeModel requests per minute for Mistral Large | Each supported Region: 400 | No | The maximum number of times that you can call InvokeModel and InvokeModelWithResponseStream in one minute for Mistral mistral-large-2402-v1 -On-demand InvokeModel requests per minute for Mistral Mixtral 8x7b Instruct | Each supported Region: 400 | No | The maximum number of times that you can call InvokeModel in one minute for Mistral mixtral-8x7b-v0 @@ -542,2 +535,0 @@ On-demand InvokeModel requests per minute for Stability.ai Stable Diffusion 3.5 -On-demand InvokeModel requests per minute for Stability.ai Stable Diffusion XL 0.8 | Each supported Region: 60 | No | The maximum number of times that you can call InvokeModel in one minute for Stability.ai Stable Diffusion XL 0.8 -On-demand InvokeModel requests per minute for Stability.ai Stable Diffusion XL 1.0 | Each supported Region: 60 | No | The maximum number of times that you can call InvokeModel in one minute for Stability.ai Stable Diffusion XL 1.0 @@ -549,8 +540,0 @@ On-demand InvokeModel tokens per minute for AI21 Labs Jamba Instruct | Each supp -On-demand InvokeModel tokens per minute for AI21 Labs Jurassic-2 Mid | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel in one minute for AI21 Labs Jurassic-2 Mid. -On-demand InvokeModel tokens per minute for AI21 Labs Jurassic-2 Ultra | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel in one minute for AI21 Labs Jurassic-2 Ultra. -On-demand InvokeModel tokens per minute for Amazon Titan Image Generator G1 | Each supported Region: 2,000 | No | The maximum number of tokens that you can provide through InvokeModel in one minute for Amazon Titan Image Generator G1. -On-demand InvokeModel tokens per minute for Amazon Titan Multimodal Embeddings G1 | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel in one minute for Amazon Titan Multimodal Embeddings G1. -On-demand InvokeModel tokens per minute for Amazon Titan Text Embeddings | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel in one minute for Amazon Titan Text Embeddings. -On-demand InvokeModel tokens per minute for Amazon Titan Text Embeddings V2 | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel in one minute for Amazon Titan Text Embeddings V2. -On-demand InvokeModel tokens per minute for Amazon Titan Text Express | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Amazon Titan Text Express. -On-demand InvokeModel tokens per minute for Amazon Titan Text Lite | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Amazon Titan Text Lite. @@ -558,3 +541,0 @@ On-demand InvokeModel tokens per minute for Amazon Titan Text Premier | Each sup -On-demand InvokeModel tokens per minute for Anthropic Claude 3 Haiku | us-east-1: 2,000,000 us-west-2: 2,000,000 ap-northeast-1: 200,000 ap-southeast-1: 200,000 Each of the other supported Regions: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Anthropic Claude 3 Haiku. -On-demand InvokeModel tokens per minute for Anthropic Claude 3 Sonnet | us-east-1: 1,000,000 us-west-2: 1,000,000 Each of the other supported Regions: 200,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Anthropic Claude 3 Sonnet. -On-demand InvokeModel tokens per minute for Anthropic Claude 3.5 Sonnet | us-east-1: 400,000 us-east-2: 400,000 us-west-2: 2,000,000 ap-northeast-2: 400,000 ap-south-1: 400,000 ap-southeast-2: 400,000 Each of the other supported Regions: 200,000 | No | The maximum number of tokens that you can submit for model inference in one minute for Anthropic Claude 3.5 Sonnet. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -562,14 +542,0 @@ On-demand InvokeModel tokens per minute for Anthropic Claude 3.5 Sonnet V2 | us -On-demand InvokeModel tokens per minute for Anthropic Claude Instant | us-east-1: 1,000,000 us-west-2: 1,000,000 Each of the other supported Regions: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Anthropic Claude Instant. -On-demand InvokeModel tokens per minute for Anthropic Claude V2 | us-east-1: 500,000 us-west-2: 500,000 Each of the other supported Regions: 200,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Anthropic Claude V2. -On-demand InvokeModel tokens per minute for Cohere Command | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Cohere Command. -On-demand InvokeModel tokens per minute for Cohere Command Light | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel in one minute for Cohere Command Light. -On-demand InvokeModel tokens per minute for Cohere Command R | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Cohere Command R 128k. -On-demand InvokeModel tokens per minute for Cohere Command R Plus | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Cohere Command R Plus 128k. -On-demand InvokeModel tokens per minute for Cohere Embed English | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel in one minute for Cohere Embed English. -On-demand InvokeModel tokens per minute for Cohere Embed Multilingual | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel in one minute for Cohere Embed Multilingual. -On-demand InvokeModel tokens per minute for Meta Llama 2 13B | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Meta Llama 2 13B. -On-demand InvokeModel tokens per minute for Meta Llama 2 70B | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Meta Llama 2 70B. -On-demand InvokeModel tokens per minute for Meta Llama 2 Chat 13B | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Meta Llama 2 Chat 13B. -On-demand InvokeModel tokens per minute for Meta Llama 2 Chat 70B | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Meta Llama 2 Chat 70B. -On-demand InvokeModel tokens per minute for Mistral AI Mistral 7B Instruct | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Mistral AI Mistral 7B Instruct. -On-demand InvokeModel tokens per minute for Mistral AI Mistral Large | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Mistral AI Mistral Large. @@ -577 +543,0 @@ On-demand InvokeModel tokens per minute for Mistral AI Mistral Small | Each supp -On-demand InvokeModel tokens per minute for Mistral AI Mixtral 8X7BB Instruct | Each supported Region: 300,000 | No | The maximum number of tokens that you can provide through InvokeModel and InvokeModelWithResponseStream in one minute. The quota considers the combined sum of InvokeModel and InvokeModelWithResponseStream tokens for Mistral AI Mixtral 8X7B Instruct. @@ -580,0 +547,3 @@ On-demand model inference concurrent requests for Luma Ray V2 | Each supported R +On-demand model inference requests per minute for AI21 Labs Jurassic-2 Mid | Each supported Region: 400 | No | The maximum number of times that you can call InvokeModel in one minute for AI21 Labs Jurassic-2 Mid +On-demand model inference requests per minute for AI21 Labs Jurassic-2 Ultra | Each supported Region: 100 | No | The maximum number of times that you can call InvokeModel in one minute for AI21 Labs Jurassic-2 Ultra +On-demand model inference requests per minute for Amazon Nova Canvas | Each supported Region: 100 | No | The maximum number of requests that you can submit for model inference in one minute for Amazon Nova Canvas. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. @@ -583,0 +553,2 @@ On-demand model inference requests per minute for Amazon Nova Pro | us-east-1: +On-demand model inference requests per minute for Amazon Rerank 1.0 | Each supported Region: 200 | No | The maximum number of times that you can call InvokeModel in one minute for Amazon Rerank 1.0. +On-demand model inference requests per minute for Amazon Titan Image Generator G1 | Each supported Region: 60 | No | The maximum number of times that you can call InvokeModel in one minute for Amazon Titan Image Generator G1. @@ -584,0 +556,6 @@ On-demand model inference requests per minute for Amazon Titan Image Generator G +On-demand model inference requests per minute for Amazon Titan Multimodal Embeddings G1 | Each supported Region: 2,000 | No | The maximum number of times that you can call InvokeModel in one minute for Amazon Titan Multimodal Embeddings G1. +On-demand model inference requests per minute for Amazon Titan Text Embeddings | Each supported Region: 2,000 | No | The maximum number of times that you can call InvokeModel in one minute for Amazon Titan Text Embeddings +On-demand model inference requests per minute for Amazon Titan Text Embeddings V2 | Each supported Region: 2,000 | No | The maximum number of times that you can call InvokeModel in one minute for Amazon Titan Text Embeddings V2 +On-demand model inference requests per minute for Amazon Titan Text Express | Each supported Region: 400 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Amazon Titan Text Express +On-demand model inference requests per minute for Amazon Titan Text Lite | Each supported Region: 800 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Amazon Titan Text Lite +On-demand model inference requests per minute for Anthropic Claude 3 Haiku | us-east-1: 1,000 us-west-2: 1,000 ap-northeast-1: 200 ap-southeast-1: 200 Each of the other supported Regions: 400 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Anthropic Claude 3 Haiku. @@ -585,0 +563 @@ On-demand model inference requests per minute for Anthropic Claude 3 Opus | Each +On-demand model inference requests per minute for Anthropic Claude 3 Sonnet | us-east-1: 500 us-west-2: 500 Each of the other supported Regions: 100 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Anthropic Claude 3 Sonnet. @@ -586,0 +565,14 @@ On-demand model inference requests per minute for Anthropic Claude 3.5 Haiku | +On-demand model inference requests per minute for Anthropic Claude 3.5 Sonnet | us-east-1: 50 us-east-2: 50 us-west-2: 250 ap-northeast-2: 50 ap-south-1: 50 ap-southeast-2: 50 Each of the other supported Regions: 20 | No | The maximum number of times that you can call model inference in one minute for Anthropic Claude 3.5 Sonnet. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream. +On-demand model inference requests per minute for Anthropic Claude Instant | us-east-1: 1,000 us-west-2: 1,000 Each of the other supported Regions: 400 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Anthropic Claude Instant +On-demand model inference requests per minute for Anthropic Claude V2 | us-east-1: 500 us-west-2: 500 Each of the other supported Regions: 100 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Anthropic Claude V2 +On-demand model inference requests per minute for Cohere Command | Each supported Region: 400 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Cohere Command. +On-demand model inference requests per minute for Cohere Command Light | Each supported Region: 800 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Cohere Command Light. +On-demand model inference requests per minute for Cohere Command R | Each supported Region: 400 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Cohere Command R 128k. +On-demand model inference requests per minute for Cohere Command R Plus | Each supported Region: 400 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Cohere Command R Plus 128k. +On-demand model inference requests per minute for Cohere Embed English | Each supported Region: 2,000 | No | The maximum number of times that you can call InvokeModel in one minute for Cohere Embed English. +On-demand model inference requests per minute for Cohere Embed Multilingual | Each supported Region: 2,000 | No | The maximum number of times that you can call InvokeModel in one minute for Cohere Embed Multilingual. +On-demand model inference requests per minute for Cohere Rerank 3.5 | Each supported Region: 250 | No | The maximum number of times that you can call InvokeModel in one minute for Cohere Rerank 3.5. +On-demand model inference requests per minute for Meta Llama 2 13B | Each supported Region: 800 | No | The maximum number of times that you can call model inference in one minute. The quota considers the combined sum of Converse, ConverseStream, InvokeModel and InvokeModelWithResponseStream for Meta Llama 2 13B.