AWS bedrock: Restructure computer use guide; add GA client toolsets and beta guidance
Summary
Rewrites the Amazon Bedrock computer use page: drops the 'beta tool family' framing, documents two interfaces (client toolsets computer_toolset_20260801/browser_toolset_20260801 with no beta value, and Anthropic-defined computer_20251124/computer_20250124 requiring matching beta values), adds a supported-models/tool-type/beta-value table, gives separate InvokeModel, Converse, and bedrock-mantle example requests (including where to place anthropic_beta), and rewords the risk guidance to cover both interfaces.
Security assessment
The diff is primarily a feature/API-reference update (tool types, required beta values per endpoint, supported-model table, request examples). No vulnerability, CVE, or incident is referenced, so this is not a fix for a specific weakness. However, the change does carry security best-practice content, extending the existing caution about unique computer-use risks to both interfaces and rewording precautions such as limiting internet access to required domains to reduce exposure to malicious content (prompt-injection-like risk from web/UI content) and avoiding sensitive accounts/data to prevent information theft. That is security-adjacent hardening guidance rather than authentication, encryption, or credential changes, so severity is medium.
Evidence
+Computer use, through either interface, poses unique risks distinct from standard API features or chat interfaces. These risks are heightened when computer use interacts with the Internet. To minimize risks, consider taking precautions such as:
Diff
diff --git a/bedrock/latest/userguide/computer-use.md b/bedrock/latest/userguide/computer-use.md index 443089b..a64dbc3 100644 --- a//bedrock/latest/userguide/computer-use.md +++ b//bedrock/latest/userguide/computer-use.md @@ -7 +7 @@ -Use computer use on Amazon BedrockExample request +Use computer use on Amazon BedrockSupported models and tool typesExample requests @@ -11 +11 @@ Use computer use on Amazon BedrockExample request -Computer use is an Anthropic Claude tool family (in beta) for automating graphical user interface (GUI) tasks. The model returns `tool_use` actions such as `screenshot`, `left_click`, `type`, and `scroll` in JSON. Your application executes those actions on a desktop or container and returns the resulting screenshot to Claude on the next turn. +Computer use lets Anthropic Claude models automate graphical user interface (GUI) tasks. The model returns `tool_use` actions such as taking a screenshot, clicking, typing, and scrolling. Your application executes those actions on a desktop or container and returns the resulting screenshot to Claude on the next turn. @@ -13 +13 @@ Computer use is an Anthropic Claude tool family (in beta) for automating graphic -For the underlying tool protocol, the full list of actions, and prompt-engineering guidance, see [Computer use](https://docs.anthropic.com/en/docs/build-with-claude/computer-use) in the Anthropic documentation. This page covers the Amazon Bedrock-specific usage on top of that protocol. +Amazon Bedrock offers computer use through two interfaces: @@ -15 +15 @@ For the underlying tool protocol, the full list of actions, and prompt-engineeri -###### Warning + * **Client toolsets** – `computer_toolset_20260801` and `browser_toolset_20260801`. Generally available on the newer Claude models (see Supported models and tool types). No beta value is required. @@ -17 +17,12 @@ For the underlying tool protocol, the full list of actions, and prompt-engineeri -Computer use is made available to you as a "Beta Service" as defined in the AWS Service Terms. It is subject to your Agreement with AWS, the AWS Service Terms, and the applicable model EULA. The Computer Use API poses unique risks distinct from standard API features or chat interfaces. These risks are heightened when using the Computer Use API to interact with the Internet. To minimize risks, consider taking precautions such as: + * **Anthropic-defined computer tools** – `computer_20251124` and `computer_20250124`. In beta on all models that support them, and the only computer use option on older models. Each request requires the matching beta value. + + + + +For the underlying tool protocol, the full list of actions, and prompt-engineering guidance, see [Computer use](https://platform.claude.com/docs/en/agents-and-tools/tool-use/computer-use-tool) in the Anthropic documentation. This page covers the Amazon Bedrock-specific usage on top of that protocol. + +###### Note + +The `computer_20251124` and `computer_20250124` computer tools are made available to you as a "Beta Service" as defined in the AWS Service Terms. They are subject to your Agreement with AWS, the AWS Service Terms, and the applicable model EULA. + +Computer use, through either interface, poses unique risks distinct from standard API features or chat interfaces. These risks are heightened when computer use interacts with the Internet. To minimize risks, consider taking precautions such as: @@ -21 +32 @@ Computer use is made available to you as a "Beta Service" as defined in the AWS - * To prevent information theft, avoid giving the Computer Use API access to sensitive accounts or data. + * To prevent information theft, avoid giving computer use access to sensitive accounts or data. @@ -23 +34 @@ Computer use is made available to you as a "Beta Service" as defined in the AWS - * Limit the computer use API's internet access to required domains to reduce exposure to malicious content. + * Limit computer use's internet access to required domains to reduce exposure to malicious content. @@ -36 +47,3 @@ Any content that you enable Claude to see or access can potentially override ins - * Example request + * Supported models and tool types + + * Example requests @@ -43 +56,6 @@ Any content that you enable Claude to see or access can potentially override ins -Computer use is supported on both the `bedrock-runtime` and `bedrock-mantle` endpoints. To find which models support computer use on each endpoint, see the _Capabilities and Features_ table in each [Models at a glance](./model-cards.html). Submitting a request to a model that doesn't support computer use, or pairing a tool type with an unsupported model, returns a `400 invalid_request_error`. +Computer use is supported on both the `bedrock-runtime` and `bedrock-mantle` endpoints. On `bedrock-runtime`, you can use it with the InvokeModel and Converse APIs. You can enable computer use in one of two ways, depending on the model: + + * **Anthropic-defined computer tool** – Include a tool entry whose `type` is a dated computer tool (for example, `computer_20251124`) and the matching `anthropic_beta` value (for example, `computer-use-2025-11-24`). The beta value is required. A request that omits it, or that pairs a tool type with the beta value for a different version, returns a `400 invalid_request_error`. + + * **Client toolset** – Include a tool entry whose `type` is `computer_toolset_20260801` (or `browser_toolset_20260801` for browser automation). No `anthropic_beta` value is required. A toolset entry contains only the `type` field; don't include a `name`. The model calls each tool in the toolset by its own name, for example `screenshot` or `navigate`. + @@ -45 +62,0 @@ Computer use is supported on both the `bedrock-runtime` and `bedrock-mantle` end -To enable computer use on a request, include both: @@ -47 +63,0 @@ To enable computer use on a request, include both: - * An `anthropic_beta` entry naming a computer-use beta version (for example, `"anthropic_beta": ["computer-use-2025-11-24"]` in the request body for `bedrock-runtime`, or the `anthropic-beta: computer-use-2025-11-24` HTTP header for `bedrock-mantle`). @@ -49 +65 @@ To enable computer use on a request, include both: - * One or more Anthropic pre-defined tool entries in the `tools` array, with a `type` field that matches the beta version (for example, `computer_20251124`, `bash_20250124`, or `text_editor_20250124`). +Where you put the beta value depends on the endpoint and API: @@ -50,0 +67 @@ To enable computer use on a request, include both: + * `bedrock-runtime`, InvokeModel – the `anthropic_beta` field in the request body. @@ -51,0 +69 @@ To enable computer use on a request, include both: + * `bedrock-runtime`, Converse – the `anthropic_beta` field in `additionalModelRequestFields`, alongside the `tools` array that contains the computer tool. @@ -52,0 +71 @@ To enable computer use on a request, include both: + * `bedrock-mantle` – the `anthropic-beta` HTTP header, or the `anthropic_beta` field in the request body. @@ -54 +72,0 @@ To enable computer use on a request, include both: -For the beta-version-to-tool-type pairings, additional Anthropic-defined tools (bash and text editor), and the full request and response field documentation, see [Computer use (Beta)](./model-parameters-anthropic-claude-messages-tool-use.html#model-parameters-anthropic-claude-messages-computer-use). @@ -56 +73,0 @@ For the beta-version-to-tool-type pairings, additional Anthropic-defined tools ( -## Example request @@ -58 +75,23 @@ For the beta-version-to-tool-type pairings, additional Anthropic-defined tools ( -The following Python example sends a Messages API request through the `bedrock-runtime` endpoint with the computer use tool. Replace the `modelId` with one that supports computer use (see [Models at a glance](./model-cards.html)). + +The bash (`bash_20250124`), text editor (`text_editor_20250728`), and memory (`memory_20250818`) tools don't require a beta value. For all Anthropic-defined tools and their fields, see [Computer use](./model-parameters-anthropic-claude-messages-tool-use.html#model-parameters-anthropic-claude-messages-computer-use). + +## Supported models and tool types + +The following table shows the computer use tool types that each Claude model accepts on the `bedrock-runtime` endpoint. Submitting a tool type that a model doesn't accept returns a `400 invalid_request_error`. The `computer_20241022` tool type isn't accepted by any model in this table. + +**Model** | **Computer tool type** | **Required beta value** | **Client toolsets (no beta value)** +---|---|---|--- +Claude Fable 5.1, Claude Fable 5, Claude Opus 5.5, Claude Sonnet 5.5, Claude Haiku 5.5, Claude Opus 5, Claude Sonnet 5, Claude Opus 4.8 | `computer_20251124` | `computer-use-2025-11-24` | `computer_toolset_20260801`, `browser_toolset_20260801` +Claude Opus 4.7, Claude Opus 4.6, Claude Sonnet 4.6 | `computer_20251124` | `computer-use-2025-11-24` | Not supported +Claude Opus 4.5 | `computer_20251124` or `computer_20250124` | `computer-use-2025-11-24` (with `computer_20251124`) or `computer-use-2025-01-24` (with `computer_20250124`) | Not supported +Claude Sonnet 4.5, Claude Haiku 4.5, Claude Opus 4.1 | `computer_20250124` | `computer-use-2025-01-24` | Not supported + +To find which endpoints each model is available on, see the model's [Models at a glance](./model-cards.html). + +## Example requests + +Each of the following examples asks the model to take a screenshot. The model responds with `stop_reason` set to `tool_use` and a `tool_use` block that describes the action. Your application runs the action and returns the result in a `tool_result` block on the next turn. + +**InvokeModel with the computer tool** + +The following Python example sends a request through the `bedrock-runtime` endpoint with the `computer_20251124` tool and the required beta value. @@ -71 +110 @@ The following Python example sends a Messages API request through the `bedrock-r - "max_tokens": 1024, + "max_tokens": 2048, @@ -90 +129,106 @@ The following Python example sends a Messages API request through the `bedrock-r -For the equivalent `bedrock-mantle` Messages API request shape, see [Inference using Anthropic Messages API](./inference-messages-api.html). +The model requests the action through the `computer` tool: + + + { + "type": "tool_use", + "name": "computer", + "input": {"action": "screenshot"} + } + +**InvokeModel with the computer toolset** + +The following example uses `computer_toolset_20260801` instead. No beta value is required, and the toolset entry has no `name`. + + + import boto3 + import json + + client = boto3.client("bedrock-runtime", region_name="us-east-1") + + response = client.invoke_model( + modelId="us.anthropic.claude-opus-5-5", + body=json.dumps({ + "anthropic_version": "bedrock-2023-05-31", + "max_tokens": 2048, + "messages": [ + {"role": "user", "content": "Take a screenshot of the desktop."} + ], + "tools": [{"type": "computer_toolset_20260801"}], + }), + ) + + result = json.loads(response["body"].read()) + print(result["content"]) + +The model calls the `screenshot` tool from the toolset directly. The `toolset_name` field identifies the toolset that the tool belongs to: + + + { + "type": "tool_use", + "name": "screenshot", + "input": {}, + "toolset_name": "computer" + } + +**Converse** + +With the Converse API, pass the computer tool and the beta value in `additionalModelRequestFields`. The model's action is returned as a `toolUse` content block. + + + import boto3 + + client = boto3.client("bedrock-runtime", region_name="us-east-1") + + response = client.converse( + modelId="us.anthropic.claude-sonnet-4-6", + messages=[ + {"role": "user", "content": [{"text": "Take a screenshot of the desktop."}]} + ], + inferenceConfig={"maxTokens": 2048}, + additionalModelRequestFields={ + "anthropic_beta": ["computer-use-2025-11-24"], + "tools": [ + { + "type": "computer_20251124", + "name": "computer", + "display_width_px": 1024, + "display_height_px": 768, + } + ], + }, + ) + + print(response["stopReason"]) # "tool_use" + for block in response["output"]["message"]["content"]: + if "toolUse" in block: + print(block["toolUse"]["name"], block["toolUse"]["input"]) + +To use a client toolset with Converse, pass `"tools": [{"type": "computer_toolset_20260801"}]` in `additionalModelRequestFields` and omit `anthropic_beta`. + +**bedrock-mantle** + +On the `bedrock-mantle` endpoint (`https://bedrock-mantle.`region`.api.aws/anthropic/v1/messages`), send the beta value in the `anthropic-beta` header: + + + POST /anthropic/v1/messages + anthropic-version: 2023-06-01 + anthropic-beta: computer-use-2025-11-24 + content-type: application/json + + { + "model": "anthropic.claude-opus-5-5", + "max_tokens": 2048, + "messages": [ + {"role": "user", "content": "Take a screenshot of the desktop."} + ], + "tools": [ + { + "type": "computer_20251124", + "name": "computer", + "display_width_px": 1024, + "display_height_px": 768 + } + ] + }