AWS eks documentation change
Summary
Added SageMaker HyperPod Observability Add-on documentation and updated file structure
Security assessment
Introduces observability features for monitoring cluster health but doesn't directly address security controls or vulnerabilities
Diff
diff --git a/eks/latest/userguide/workloads-add-ons-available-eks.md b/eks/latest/userguide/workloads-add-ons-available-eks.md index 51c3e57ea..5faa73b1b 100644 --- a//eks/latest/userguide/workloads-add-ons-available-eks.md +++ b//eks/latest/userguide/workloads-add-ons-available-eks.md @@ -1 +1 @@ -[](/pdfs/eks/latest/userguide/eks-ug.pdf#workloads-add-ons-available-eks "Open PDF")[](https://github.com/awsdocs/amazon-eks-user-guide/tree/mainline/latest/ug/workloads-add-ons-available-eks.xml "Edit this page on GitHub") +[](/pdfs/eks/latest/userguide/eks-ug.pdf#workloads-add-ons-available-eks "Open PDF")[](https://github.com/awsdocs/amazon-eks-user-guide/tree/mainline/latest/ug/workloads/workloads-add-ons-available-eks.adoc "Edit this page on GitHub") @@ -5 +5 @@ -Amazon VPC CNI plugin for KubernetesCoreDNSKube-proxyAmazon EBS CSI driverAmazon EFS CSI driverAmazon FSx CSI driverMountpoint for Amazon S3 CSI DriverCSI snapshot controllerAmazon SageMaker HyperPod task governanceAWS Network Flow Monitor AgentNode monitoring agentAWS Distro for OpenTelemetryAmazon GuardDuty agentAmazon CloudWatch Observability agentAWS Private CA Connector for KubernetesEKS Pod Identity Agent +Amazon VPC CNI plugin for KubernetesCoreDNSKube-proxyAmazon EBS CSI driverAmazon EFS CSI driverAmazon FSx CSI driverMountpoint for Amazon S3 CSI DriverCSI snapshot controllerAmazon SageMaker HyperPod task governanceAmazon SageMaker HyperPod Observability Add-onAWS Network Flow Monitor AgentNode monitoring agentAWS Distro for OpenTelemetryAmazon GuardDuty agentAmazon CloudWatch Observability agentAWS Private CA Connector for KubernetesEKS Pod Identity Agent @@ -28,0 +29 @@ SageMaker HyperPod task governance optimizes compute resource allocation and usa +The Amazon SageMaker HyperPod Observability AddOn provides comprehensive monitoring and observability capabilities for HyperPod clusters. | Amazon SageMaker HyperPod Observability Add-on | EC2, EKS Auto Mode, @@ -272,0 +274,23 @@ To learn more about the add-on, see [SageMaker HyperPod task governance](https:/ +## Amazon SageMaker HyperPod Observability Add-on + +The Amazon SageMaker HyperPod Observability Add-on provides comprehensive monitoring and observability capabilities for HyperPod clusters. This add-on automatically deploys and manages essential monitoring components including node exporter, DCGM exporter, kube-state-metrics, and EFA exporter. It collects and forwards metrics to a customer-designated Amazon Managed Prometheus (AMP) instance and exposes an OTLP endpoint for custom metrics and event ingestion from customer training jobs. + +The add-on integrates with the broader HyperPod ecosystem by scraping metrics from various components including HyperPod Task Governance add-on, HyperPod Training Operator, Kubeflow, and KEDA. All collected metrics are centralized in Amazon Managed Prometheus, enabling customers to achieve a unified observability view through Amazon Managed Grafana dashboards. This provides end-to-end visibility into cluster health, resource utilization, and training job performance across the entire HyperPod environment. + +The Amazon EKS add-on name is `amazon-sagemaker-hyperpod-observability`. + +### Required IAM permissions + +This add-on uses the IAM roles for service accounts capability of Amazon EKS. For more information, see [IAM roles for service accounts](./iam-roles-for-service-accounts.html). The following managed policies are required: + + * `AmazonPrometheusRemoteWriteAccess` \- for remote writing metrics from the cluster to AMP + + * `CloudWatchAgentServerPolicy` \- for remote writing the logs from the cluster to CloudWatch + + + + +### Additional information + +To learn more about the add-on and its capabilities, see [SageMaker HyperPod Observability](https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod-eks-cluster-observability-cluster.html). +