AWS bedrock documentation change
Summary
Added documentation for service tier parameter in model invocation examples and CLI commands
Security assessment
The changes introduce a 'serviceTier' parameter for performance/cost optimization without any security context. No security features, vulnerabilities, or access controls are mentioned. The examples demonstrate prioritization of requests rather than security-related functionality.
Diff
diff --git a/bedrock/latest/userguide/inference-invoke.md b/bedrock/latest/userguide/inference-invoke.md index d7b698176..8f7e96b53 100644 --- a//bedrock/latest/userguide/inference-invoke.md +++ b//bedrock/latest/userguide/inference-invoke.md @@ -47,0 +48 @@ trace | To specify whether to return the trace for the guardrail you specify. Fo +serviceTier | To specify the service tier for a request. For more information, see [Service tiers for optimizing performance and cost](./service-tiers-inference.html). @@ -149,0 +151,66 @@ Run the following Python code example to generate a text response: +The following examples generate a text response to a text prompt using the OpenAI GPT model with a service tier to prioritize the request. Choose the tab for your preferred method, and then follow the steps: + +CLI + + +Run the following command in a terminal and validate the service tier in the response. + + + aws bedrock-runtime invoke-model \ + --model-id openai.gpt-oss-120b-1:0 \ + --body '{ + "messages": [ + { + "role": "user", + "content": "Describe the purpose of a '\''hello world'\'' program in one line." + } + ], + "max_tokens": 512, + "temperature": 0.7 + }' \ + --content-type application/json \ + --accept application/json \ + --service-tier priority \ + --cli-binary-format raw-in-base64-out + +Python + + +Run the following Python code example to generate a text response with service tier: + + + import boto3 + import json + + # Create a Bedrock Runtime client + bedrock_runtime = boto3.client( + service_name="bedrock-runtime", + region_name="us-east-1" + ) + + # Define the model ID and request body + model_id = "openai.gpt-oss-120b-1:0" + body = json.dumps({ + "messages": [ + { + "role": "user", + "content": "Describe the purpose of a 'hello world' program in one line." + } + ], + "max_tokens": 512, + "temperature": 0.7 + }) + + # Make the request with service tier + response = bedrock_runtime.invoke_model( + modelId=model_id, + body=body, + contentType="application/json", + accept="application/json", + serviceTier="priority" + ) + + # Parse and print the response + response_body = json.loads(response["body"]) + print(response_body) +