AWS AmazonCloudWatch documentation change
Summary
Updated documentation for generative AI observability features, including monitoring enhancements for model invocations and AgentCore components. Removed duplicate wording and clarified dashboard capabilities.
Security assessment
Changes focus on improving clarity and expanding monitoring capabilities for AI workloads. No security-specific changes or references to vulnerabilities are present. Updates relate to operational observability rather than security controls.
Diff
diff --git a/AmazonCloudWatch/latest/monitoring/GenAI-observability.md b/AmazonCloudWatch/latest/monitoring/GenAI-observability.md index c0a73dda9..445e41af0 100644 --- a//AmazonCloudWatch/latest/monitoring/GenAI-observability.md +++ b//AmazonCloudWatch/latest/monitoring/GenAI-observability.md @@ -7 +7 @@ -With Amazon CloudWatch, you can observe generative AI workloads, including [Amazon Bedrock AgentCore agents](https://aws.amazon.com/bedrock/agentcore/), and gain insights into AI performance, health, and accuracy. CloudWatch provides pre-configured views into latency, usage, and errors of your AI workloads, allowing you to detect issues faster in components like models and agents. End-to-end prompt tracing helps you quickly identify issues in components such as knowledge bases, tools, and models. CloudWatch's AI monitoring capabilities are compatible with popular generative AI orchestration frameworks such as such as [AWS Strands](https://strandsagents.com/latest/), LangChain, and LangGraph, offering flexibility with your choice of framework. +With Amazon CloudWatch, you can observe generative AI workloads, including [Amazon Bedrock AgentCore agents](https://aws.amazon.com/bedrock/agentcore/), and gain insights into AI performance, health, and accuracy. CloudWatch provides pre-configured views into latency, usage, and errors of your AI workloads, allowing you to detect issues faster in components like models and agents. End-to-end prompt tracing helps you quickly identify issues in components such as knowledge bases, tools, and models. CloudWatch's AI monitoring capabilities are compatible with popular generative AI orchestration frameworks such as [AWS Strands](https://strandsagents.com/latest/), LangChain, and LangGraph, offering flexibility with your choice of framework. @@ -11 +11 @@ CloudWatch generative AI observability enables you to: - * Gain insights into end-user outcomes, AI performance, health, and accuracy while reducing human-in-the-loop (HITL) assessment burden + * Assess AI application quality and accuracy at scale through automated monitoring, reducing manual review requirements by capturing model outputs, response quality metrics, and end-user interactions @@ -26 +26 @@ CloudWatch generative AI observability enables you to: -CloudWatch generative AI observability provides two pre-built dashboards: +CloudWatch generative AI observability provides two pre-built capabilities: @@ -30 +30 @@ CloudWatch generative AI observability provides two pre-built dashboards: -You must enable Amazon Bedrock to view the **Model Invocation** dashboard. +You can use the **Model Invocation** dashboard by using any models for inference in Amazon Bedrock. @@ -32 +32 @@ You must enable Amazon Bedrock to view the **Model Invocation** dashboard. - * **Model Invocations** – Detailed metrics on model usage, token consumption, and costs + * **Model Invocations** – Detailed metrics dashboard on model usage, token consumption, and a curated invocation logs table to view detailed input and output content of model inferences @@ -34 +34 @@ You must enable Amazon Bedrock to view the **Model Invocation** dashboard. - * **Amazon Bedrock AgentCore agents** – Performance and decision metrics for the Amazon Bedrock agents + * **Amazon Bedrock AgentCore agents** – Performance and decision metrics for primitives of Amazon Bedrock AgentCore such as Agents, Memory, Built-in Tools, Gateways, and Identity @@ -58 +58 @@ Key metrics available in these dashboards include: - * [Amazon Bedrock AgentCore Agents](./AgentCore-Agents.html) + * [Amazon Bedrock AgentCore](./AgentCore-Agents.html)