AWS sagemaker documentation change
Summary
Updated ECR paths documentation with framework version updates, added Spark algorithm section, removed PyTorch Neuron DLC, and improved example descriptions. Added multiple new container versions across various machine learning frameworks.
Security assessment
The changes consist of routine updates to container versions, framework support, and documentation improvements. There is no mention of security vulnerabilities, patches, or security feature enhancements in the diff. Changes appear to be standard version updates and documentation clarifications.
Diff
diff --git a/sagemaker/latest/dg-ecr-paths/ecr-ap-northeast-3.md b/sagemaker/latest/dg-ecr-paths/ecr-ap-northeast-3.md index 309f088fe..de67c8478 100644 --- a//sagemaker/latest/dg-ecr-paths/ecr-ap-northeast-3.md +++ b//sagemaker/latest/dg-ecr-paths/ecr-ap-northeast-3.md @@ -5 +5 @@ -AutoGluonBlazingTextClarifyDJL DeepSpeedData WranglerDebuggerDeepAR ForecastingFactorization MachinesHugging FaceIP InsightsImage classificationInferentia MXNetInferentia PyTorchK-MeansKNNLinear LearnerMXNetModel MonitorNTMNeo Image ClassificationNeo MXNetNeo PyTorchNeo TensorflowNeo XGBoostObject DetectionObject2VecPCAPyTorchPyTorch NeuronPyTorch Training CompilerRandom Cut ForestScikit-learnSemantic SegmentationSeq2SeqSparkML ServingTensorflowTensorflow InferentiaXGBoost +AutoGluonBlazingTextClarifyDJL DeepSpeedData WranglerDebuggerDeepAR ForecastingFactorization MachinesHugging FaceIP InsightsImage classificationInferentia MXNetInferentia PyTorchK-MeansKNNLinear LearnerMXNetModel MonitorNTMNeo Image ClassificationNeo MXNetNeo PyTorchNeo TensorflowNeo XGBoostObject DetectionObject2VecPCAPyTorchPyTorch Training CompilerRandom Cut ForestScikit-learnSemantic SegmentationSeq2SeqSparkSparkML ServingTensorflowTensorflow InferentiaXGBoost @@ -9 +9 @@ AutoGluonBlazingTextClarifyDJL DeepSpeedData WranglerDebuggerDeepAR ForecastingF -The following topics list parameters for each of the algorithms and deep learning containers in this region provided by Amazon SageMaker AI. +The following topics list parameters for each of the algorithms and deep learning containers that are provided by Amazon SageMaker AI in this AWS Region. @@ -69,2 +68,0 @@ The following topics list parameters for each of the algorithms and deep learnin - * PyTorch Neuron (DLC) - @@ -80,0 +79,2 @@ The following topics list parameters for each of the algorithms and deep learnin + * Spark (algorithm) + @@ -94 +94 @@ The following topics list parameters for each of the algorithms and deep learnin -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -101,0 +102,12 @@ Registry path | Version | Job types (image scope) +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/autogluon-training:`<tag>` | 1.3.0 | training +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/autogluon-inference:`<tag>` | 1.3.0 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/autogluon-training:`<tag>` | 1.2.0 | training +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/autogluon-inference:`<tag>` | 1.2.0 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/autogluon-training:`<tag>` | 1.1.1 | training +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/autogluon-inference:`<tag>` | 1.1.1 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/autogluon-training:`<tag>` | 1.1.0 | training +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/autogluon-inference:`<tag>` | 1.1.0 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/autogluon-training:`<tag>` | 1.0.0 | training +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/autogluon-inference:`<tag>` | 1.0.0 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/autogluon-training:`<tag>` | 0.8.2 | training +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/autogluon-inference:`<tag>` | 0.8.2 | inference @@ -123 +135 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -135 +147 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -147 +159 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -155 +167,6 @@ Registry path | Version | Job types (image scope) -364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/djl-inference:0.22.1-deepspeed0.8.3-cu118-`<tag>` | 0.22.1 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/djl-inference:0.27.0-deepspeed0.12.6-cu121-`<tag>` | 0.27.0 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/djl-inference:0.26.0-deepspeed0.12.6-cu121-`<tag>` | 0.26.0 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/djl-inference:0.25.0-deepspeed0.11.0-cu118-`<tag>` | 0.25.0 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/djl-inference:0.24.0-deepspeed0.10.0-cu118-`<tag>` | 0.24.0 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/djl-inference:0.23.0-deepspeed0.9.5-cu118-`<tag>` | 0.23.0 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/djl-inference:0.22.1-deepspeed0.9.2-cu118-`<tag>` | 0.22.1 | inference @@ -162 +179 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -169,0 +187 @@ Registry path | Version | Job types (image scope) +913387583493.dkr.ecr.ap-northeast-3.amazonaws.com/sagemaker-data-wrangler-container:`<tag>` | 3.x | processing @@ -175 +193 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -187 +205 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -199 +217 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -211 +229 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -218,0 +237,9 @@ Registry path | Version | Job types (image scope) +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/huggingface-pytorch-training:`<tag>` | 4.49.0 | training +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/huggingface-pytorch-inference:`<tag>` | 4.49.0 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/huggingface-pytorch-training:`<tag>` | 4.48.0 | training +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/huggingface-pytorch-inference:`<tag>` | 4.48.0 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/huggingface-pytorch-training:`<tag>` | 4.46.1 | training +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/huggingface-pytorch-inference:`<tag>` | 4.37.0 | inference +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/huggingface-pytorch-training:`<tag>` | 4.36.0 | training +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/huggingface-pytorch-training:`<tag>` | 4.28.1 | training +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/huggingface-pytorch-inference:`<tag>` | 4.28.1 | inference @@ -255 +282 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -267 +294 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -279 +306 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -292 +319 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -306 +333 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -318 +345 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -330 +357 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -342 +369 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -368 +395 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -380 +407 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -392 +419 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -404 +431 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -416 +443 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -423,0 +451 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver +925152966179.dkr.ecr.ap-northeast-3.amazonaws.com/sagemaker-inference-pytorch:`<tag>` | 2.0 | inference | CPU, GPU | py3 @@ -434 +462 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -447 +475 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -459 +487 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -471 +499 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -483 +511 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -495 +523,3 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +For information about the supported and unsupported PyTorch versions, see the [Framework Support Policy Table](https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/dlc-framework-support-policy.html) in the _AWS Deep Learning Containers Developer Guide_. + +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -502,0 +533,20 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training:`<tag>` | 2.7.1 | training | CPU, GPU | py312 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference:`<tag>` | 2.6.0 | inference | CPU, GPU | py312 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training:`<tag>` | 2.6.0 | training | CPU, GPU | py312 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference:`<tag>` | 2.5.1 | inference | CPU, GPU | py311 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training:`<tag>` | 2.5.1 | training | CPU, GPU | py311 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference:`<tag>` | 2.4.0 | inference | CPU, GPU | py311 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference-graviton:`<tag>` | 2.4.0 | inference_graviton | CPU | py311 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training:`<tag>` | 2.4.0 | training | CPU, GPU | py311 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference:`<tag>` | 2.3.0 | inference | CPU, GPU | py311 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference-graviton:`<tag>` | 2.3.0 | inference_graviton | CPU | py311 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training:`<tag>` | 2.3.0 | training | CPU, GPU | py311 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference-graviton:`<tag>` | 2.2.1 | inference_graviton | CPU | py310 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference:`<tag>` | 2.2.0 | inference | CPU, GPU | py310 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training:`<tag>` | 2.2.0 | training | CPU, GPU | py310 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference:`<tag>` | 2.1.0 | inference | CPU, GPU | py310 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference-graviton:`<tag>` | 2.1.0 | inference_graviton | CPU | py310 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training:`<tag>` | 2.1.0 | training | CPU, GPU | py310 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference:`<tag>` | 2.0.1 | inference | CPU, GPU | py310 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference-graviton:`<tag>` | 2.0.1 | inference_graviton | CPU | py310 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training:`<tag>` | 2.0.1 | training | CPU, GPU | py310 @@ -531,4 +581,4 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference:`<tag>` | 1.5.0 | inference | CPU, GPU | py3 -364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training:`<tag>` | 1.5.0 | training | CPU, GPU | py3 -364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference:`<tag>` | 1.4.0 | inference | CPU, GPU | py3 -364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training:`<tag>` | 1.4.0 | training | CPU, GPU | py2, py3 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference:`<tag>` | 1.5.0 | inference | CPU, GPU | py3, py36 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training:`<tag>` | 1.5.0 | training | CPU, GPU | py3, py36 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-inference:`<tag>` | 1.4.0 | inference | CPU, GPU | py3, py36 +364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training:`<tag>` | 1.4.0 | training | CPU, GPU | py2, py3, py36 @@ -541,12 +590,0 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -## PyTorch Neuron (DLC) - -SageMaker AI Python SDK example to retrieve registry path. - - - from sagemaker import image_uris - image_uris.retrieve(framework='pytorch-neuron',region='us-west-2', image_scope='inference') - -Registry path | Version | Job types (image scope) | Processor types | Python versions ----|---|---|---|--- -364406365360.dkr.ecr.ap-northeast-3.amazonaws.com/pytorch-training-neuron:`<tag>` | 1.11.0 | training | TRN | py38 - @@ -555 +593 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -568 +606 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -580 +618 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -600 +638 @@ Registry path | Version | Package version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -612 +650 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -621,0 +660,16 @@ Registry path | Version | Job types (image scope) +## Spark (algorithm) + +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. +