AWS bedrock documentation change
Summary
Added prompt caching documentation with technical specifications and updated API example structure
Security assessment
Identical to the Nova 2 Lite changes - adds performance feature documentation and updates API examples. No security context is present in these documentation updates.
Diff
diff --git a/bedrock/latest/userguide/model-card-amazon-nova-lite.md b/bedrock/latest/userguide/model-card-amazon-nova-lite.md index 4043367fa..6cc96ef01 100644 --- a//bedrock/latest/userguide/model-card-amazon-nova-lite.md +++ b//bedrock/latest/userguide/model-card-amazon-nova-lite.md @@ -41,0 +42,10 @@ Nova Lite is Amazon's low-cost multimodal model that processes text, images, and +**Prompt caching using`bedrock-runtime` endpoint** + +For more information, see [Prompt caching for faster model inference](https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html). + +**Prompt caching supported** | **Min tokens per cache checkpoint** | **Max cache checkpoints per request** | **Supported TTL** | **Fields that accept prompt cache checkpoints** +---|---|---|---|--- +Yes | 1K* | 4 | 5 minutes | `system` and `messages` + +_* Amazon Nova models support a maximum of 20K tokens for prompt caching. Prompt caching is primarily for text prompts._ + @@ -150,2 +160,7 @@ Invoke API - 'messages': [{ 'role': 'user', 'content': 'Can you explain the features of Amazon Bedrock?'}], - 'max_tokens': 1024 + 'messages': [{ + 'role': 'user', + 'content': [{'text': 'Can you explain the features of Amazon Bedrock?'}] + }], + 'inferenceConfig': { + 'maxTokens': 1024 + }