AWS sagemaker documentation change
Summary
Restructured and simplified the SageMaker HyperPod release notes documentation. Removed detailed AMI package lists and replaced with references to separate AMI release documentation pages. Added clearer introductory text and improved organization of content.
Security assessment
The changes are primarily organizational and structural, focusing on improving documentation clarity and maintainability. There is no evidence of security-related content being added or modified.
Diff
diff --git a/sagemaker/latest/dg/sagemaker-hyperpod-release-notes.md index ef1eb9a47..ef68c4065 100644 --- a/sagemaker/latest/dg/sagemaker-hyperpod-release-notes.md +++ b/sagemaker/latest/dg/sagemaker-hyperpod-release-notes.md @@ -9,9 +9 @@ February 20, 2025February 18, 2025February 06, 2025January 22, 2025January 09, 2 -The following release notes track the latest updates for Amazon SageMaker HyperPod. These release notes describe new features, fixes, and improvements made since the previous version. - -SageMaker HyperPod runs an AMI based on the following. - - * [AWS Deep Learning AMIs Base GPU AMI (Ubuntu 20.04)](https://aws.amazon.com/releasenotes/aws-deep-learning-base-gpu-ami-ubuntu-20-04/) for orchestration with Slurm. - - * Amazon Linux 2 based AMI for orchestration with Amazon EKS. - - +This topic covers release notes that track update, fixes, and new features for Amazon SageMaker HyperPod. If you are looking for general feature releases, updates, and improvements for Amazon SageMaker HyperPod, you might find this page helpful. @@ -18,0 +11 @@ SageMaker HyperPod runs an AMI based on the following. +The HyperPod AMI releases are documented separately to include information of the key components including general AMI releases, versions, and dependencies. If you are looking for these information related to HyperPod AMI releases, see [Amazon SageMaker HyperPod AMI releases](./sagemaker-hyperpod-release-ami.html). @@ -46,63 +39 @@ For all container workloads in the Nvidia container toolkit version 1.17.4, the -**Improvements for Slurm** - - * Upgraded Slurm version to 24.11. - - * Upgraded Elastic Fabric Adapter (EFA) version from 1.37.0 to 1.38.0. - - * The EFA now includes the AWS OFI NCCL plugin. You can find this plugin in the `/opt/amazon/ofi-nccl` directory, rather than the original `/opt/aws-ofi-nccl/` location. If you need to update your `LD_LIBRARY_PATH` environment variable, make sure to modify the path to point to the new `/opt/amazon/ofi-nccl` location for the OFI NCCL plugin. - - * Removed the emacs package from these DLAMIs. You can install emacs from GNU emac. - - * Installed the latest version of neuron SDK 2.19: - - * `aws-neuronx-collectives/unknown`, now `2.23.135.0-3e70920f2 amd64` - - * `aws-neuronx-dkms/unknown`, now `2.19.64.0 amd64` - - * `aws-neuronx-runtime-lib/unknown`, now `2.23.112.0-9b5179492 amd64` - - * `aws-neuronx-tools/unknown`, now `2.20.204.0 amd64` - - - - -**Improvements for K8s** - - * Upgraded Nvidia container toolkit from version 1.17.3 to version 1.17.4. - - * Fixed the issue where customers were unable to connect to nodes after a reboot. - - * Upgraded Elastic Fabric Adapter (EFA) version from 1.37.0 to 1.38.0. - - * The EFA now includes the AWS OFI NCCL plugin, which is located in the `/opt/amazon/ofi-nccl` directory instead of the original `/opt/aws-ofi-nccl/` path. If you need to update your `LD_LIBRARY_PATH` environment variable, make sure to modify the path to point to the new `/opt/amazon/ofi-nccl` location for the OFI NCCL plugin. - - * Removed the emacs package from these DLAMIs. You can install emacs from GNU emac. - - * Installed the latest version of neuron SDK: - - * `aws-neuronx-dkms.noarch 2.19.64.0-dkms @neuron` - - * `aws-neuronx-oci-hook.x86_64 2.4.4.0-1 @neuron` - - * `aws-neuronx-tools.x86_64 2.18.3.0-1 @neuron` - - * `aws-neuronx-collectives.x86_64 2.23.135.0_3e70920f2-1 neuron` - - * `aws-neuronx-gpsimd-customop.x86_64 0.2.3.0-1 neuron` - - * `aws-neuronx-gpsimd-customop-lib.x86_64` - - * `aws-neuronx-gpsimd-tools.x86_64 0.13.2.0_94ba34927-1 neuron` - - * `aws-neuronx-k8-plugin.x86_64 2.23.45.0-1 neuron` - - * `aws-neuronx-k8-scheduler.x86_64 2.23.45.0-1 neuron` - - * `aws-neuronx-runtime-lib.x86_64 2.23.112.0_9b5179492-1 neuron` - - * `aws-neuronx-tools.x86_64 2.20.204.0-1 neuron` - - * `tensorflow-model-server-neuronx.x86_64` - - - +For information about related AMI releases, see [SageMaker HyperPod AMI releases for Slurm: February 18, 2025](./sagemaker-hyperpod-release-ami-slurm.html#sagemaker-hyperpod-release-ami-slurm-20250218) and [SageMaker HyperPod AMI releases for Amazon EKS: February 18, 2025](./sagemaker-hyperpod-release-ami-eks.html#sagemaker-hyperpod-release-ami-eks-20250218). @@ -116 +47 @@ SageMaker HyperPod releases the following for [Orchestrating SageMaker HyperPod - * Enhanced SageMaker HyperPod multi-AZ support: You can specifying different subnets and security groups, cutting across different Availability Zones, for individual instance groups within your cluster. For more information about SageMaker HyperPod multi-AZ support, see [Setting up SageMaker HyperPod clusters across multiple AZs](./sagemaker-hyperpod-prerequisites.html#sagemaker-hyperpod-prerequisites-multiple-availability-zones). + * Enhanced SageMaker HyperPod multi-AZ support: You can specify different subnets and security groups, cutting across different Availability Zones, for individual instance groups within your cluster. For more information about SageMaker HyperPod multi-AZ support, see [Setting up SageMaker HyperPod clusters across multiple AZs](./sagemaker-hyperpod-prerequisites.html#sagemaker-hyperpod-prerequisites-multiple-availability-zones). @@ -123,21 +54 @@ SageMaker HyperPod releases the following for [Orchestrating SageMaker HyperPod -SageMaker HyperPod releases the following for [Orchestrating SageMaker HyperPod clusters with Amazon EKS](./sagemaker-hyperpod-eks.html). - -**AMI general updates** - - * New SageMaker HyperPod DLAMI for Amazon EKS 1.31.2. - - - - -**SageMaker HyperPod DLAMI for Amazon EKS support** - -The following is a summarized list of packages pre-installed or pre-configured in the SageMaker HyperPod DLAMIs for Amazon EKS support. Each DLAMIs is built on Amazon Linux 2 (AL2) and supports a specific Kubernetes version. - -The AMIs include the following: - -Deep Learning EKS AMI 1.31 - - - * **Amazon EKS Components** - - * Kubernetes Version: 1.31.2 +**AMI releases** @@ -145,31 +56 @@ Deep Learning EKS AMI 1.31 - * Containerd Version: 1.7.23 - - * Runc Version: 1.1.14 - - * AWS IAM Authenticator: 0.6.26 - - * **Amazon SSM Agent:** 3.3.987 - - * **Linux Kernel:** 5.10.230 - - * **OSS Nvidia driver:** 550.127.05 - - * **NVIDIA CUDA:** 12.4 - - * **EFA Installer:** 1.37.0 - - * **GDRCopy:** 2.4.1-1 - - * **Nvidia container toolkit:** 1.17.3 - - * **AWS OFI NCCL:** 1.13.0 - - * **aws-neuronx-tools:** 2.18.3 - - * **aws-neuronx-runtime-lib:** 2.23.112.0 - - * **aws-neuronx-oci-hook:** 2.4.4.0-1 - - * **aws-neuronx-dkms:** 2.18.20.0 - - * **aws-neuronx-collectives:** 2.23.133.0 + * [SageMaker HyperPod AMI releases for Amazon EKS: January 22, 2025](./sagemaker-hyperpod-release-ami-eks.html#sagemaker-hyperpod-release-ami-eks-20250122) @@ -215,68 +96 @@ SageMaker HyperPod releases the following for [Orchestrating SageMaker HyperPod -**SageMaker HyperPod DLAMI for Amazon EKS support** - -The following is a summarized list of packages pre-installed or pre-configured in the SageMaker HyperPod DLAMIs for Amazon EKS support. Each DLAMIs is built on Amazon Linux 2 (AL2) and supports a specific Kubernetes version. - -The AMIs include the following: - -K8s v1.28 - - - * **Amazon EKS Components** - - * Kubernetes Version: 1.28.15 - - * Containerd Version: 1.7.23 - - * Runc Version: 1.1.14 - - * AWS IAM Authenticator: 0.6.26 - - * **Amazon SSM Agent:** 3.3.987 - - * **Linux Kernel:** 5.10.228 - - * **OSS NVIDIA driver:** 550.127.05 - - * **NVIDIA CUDA:** 12.4 - - * **EFA Installer:** 1.37.0 - - * **GDRCopy:** 2.4 - - * **NVIDIA container toolkit:** 1.17.3 - - * **AWS OFI NCCL:** 1.13.0 - - * **aws-neuronx-tools:** 2.18.3.0-1 - - * **aws-neuronx-runtime-lib:** 2.23.112.0 - - * **aws-neuronx-oci-hook:** 2.4.4.0-1 - - * **aws-neuronx-dkms:** 2.18.20.0 - - * **aws-neuronx-collectives:** 2.23.135.0 - - - - -K8s v1.29 - - - * **Amazon EKS Components** - - * Kubernetes Version: 1.29.10 - - * Containerd Version: 1.7.23 - - * Runc Version: 1.1.14