AWS sagemaker documentation change
Summary
Added DJL DeepSpeed algorithm documentation, removed PyTorch Neuron references, updated registry paths with new framework versions, and standardized example descriptions
Security assessment
Changes consist of framework additions/removals and version updates without any explicit security context. The modifications appear to be routine documentation maintenance for supported algorithms and container versions in the AWS GovCloud region.
Diff
diff --git a/sagemaker/latest/dg-ecr-paths/ecr-us-gov-west-1.md b/sagemaker/latest/dg-ecr-paths/ecr-us-gov-west-1.md index 5f2bd46b9..a7925830a 100644 --- a//sagemaker/latest/dg-ecr-paths/ecr-us-gov-west-1.md +++ b//sagemaker/latest/dg-ecr-paths/ecr-us-gov-west-1.md @@ -5 +5 @@ -AutoGluonBlazingTextChainerClarifyDebuggerDeepAR ForecastingFactorization MachinesHugging FaceIP InsightsImage classificationInferentia MXNetInferentia PyTorchK-MeansKNNLDALinear LearnerMXNetMXNet CoachNTMNeo Image ClassificationNeo MXNetNeo PyTorchNeo TensorflowNeo XGBoostObject DetectionObject2VecPCAPyTorchPyTorch NeuronRandom Cut ForestScikit-learnSemantic SegmentationSeq2SeqSparkSparkML ServingTensorflowTensorflow CoachTensorflow InferentiaTensorflow RayXGBoost +AutoGluonBlazingTextChainerClarifyDJL DeepSpeedDebuggerDeepAR ForecastingFactorization MachinesHugging FaceIP InsightsImage classificationInferentia MXNetInferentia PyTorchK-MeansKNNLDALinear LearnerMXNetMXNet CoachNTMNeo Image ClassificationNeo MXNetNeo PyTorchNeo TensorflowNeo XGBoostObject DetectionObject2VecPCAPyTorchRandom Cut ForestScikit-learnSemantic SegmentationSeq2SeqSparkSparkML ServingTensorflowTensorflow CoachTensorflow InferentiaTensorflow RayXGBoost @@ -9 +9 @@ AutoGluonBlazingTextChainerClarifyDebuggerDeepAR ForecastingFactorization Machin -The following topics list parameters for each of the algorithms and deep learning containers in this region provided by Amazon SageMaker AI. +The following topics list parameters for each of the algorithms and deep learning containers that are provided by Amazon SageMaker AI in this AWS Region. @@ -20,0 +21,2 @@ The following topics list parameters for each of the algorithms and deep learnin + * DJL DeepSpeed (algorithm) + @@ -69,2 +70,0 @@ The following topics list parameters for each of the algorithms and deep learnin - * PyTorch Neuron (DLC) - @@ -98 +98 @@ The following topics list parameters for each of the algorithms and deep learnin -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -105,0 +106,12 @@ Registry path | Version | Job types (image scope) +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/autogluon-training:`<tag>` | 1.3.0 | training +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/autogluon-inference:`<tag>` | 1.3.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/autogluon-training:`<tag>` | 1.2.0 | training +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/autogluon-inference:`<tag>` | 1.2.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/autogluon-training:`<tag>` | 1.1.1 | training +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/autogluon-inference:`<tag>` | 1.1.1 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/autogluon-training:`<tag>` | 1.1.0 | training +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/autogluon-inference:`<tag>` | 1.1.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/autogluon-training:`<tag>` | 1.0.0 | training +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/autogluon-inference:`<tag>` | 1.0.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/autogluon-training:`<tag>` | 0.8.2 | training +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/autogluon-inference:`<tag>` | 0.8.2 | inference @@ -127 +139 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -139 +151 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -153 +165 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -162,0 +175,20 @@ Registry path | Version | Job types (image scope) +## DJL DeepSpeed (algorithm) + +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. + + + from sagemaker import image_uris + image_uris.retrieve(framework='djl-deepspeed', region='us-west-2',py_version='py3',image_scope='inference') + +Registry path | Version | Job types (image scope) +---|---|--- +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/djl-inference:0.27.0-deepspeed0.12.6-cu121-`<tag>` | 0.27.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/djl-inference:0.26.0-deepspeed0.12.6-cu121-`<tag>` | 0.26.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/djl-inference:0.25.0-deepspeed0.11.0-cu118-`<tag>` | 0.25.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/djl-inference:0.24.0-deepspeed0.10.0-cu118-`<tag>` | 0.24.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/djl-inference:0.23.0-deepspeed0.9.5-cu118-`<tag>` | 0.23.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/djl-inference:0.22.1-deepspeed0.9.2-cu118-`<tag>` | 0.22.1 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/djl-inference:0.21.0-deepspeed0.8.3-cu117-`<tag>` | 0.21.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/djl-inference:0.20.0-deepspeed0.7.5-cu116-`<tag>` | 0.20.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/djl-inference:0.19.0-deepspeed0.7.3-cu113-`<tag>` | 0.19.0 | inference + @@ -165 +197 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -177 +209 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -189 +221 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -201 +233 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -208,0 +241,9 @@ Registry path | Version | Job types (image scope) +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/huggingface-pytorch-training:`<tag>` | 4.49.0 | training +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/huggingface-pytorch-inference:`<tag>` | 4.49.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/huggingface-pytorch-training:`<tag>` | 4.48.0 | training +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/huggingface-pytorch-inference:`<tag>` | 4.48.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/huggingface-pytorch-training:`<tag>` | 4.46.1 | training +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/huggingface-pytorch-inference:`<tag>` | 4.37.0 | inference +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/huggingface-pytorch-training:`<tag>` | 4.36.0 | training +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/huggingface-pytorch-training:`<tag>` | 4.28.1 | training +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/huggingface-pytorch-inference:`<tag>` | 4.28.1 | inference @@ -245 +286 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -257 +298 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -269 +310 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -282 +323 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -296 +337 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -308 +349 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -320 +361 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -332 +373 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -344 +385 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -384 +425 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -397 +438 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -409 +450 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -421 +462 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -433 +474 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -440,0 +482 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver +263933020539.dkr.ecr.us-gov-west-1.amazonaws.com/sagemaker-inference-pytorch:`<tag>` | 2.0 | inference | CPU, GPU | py3 @@ -451 +493 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -464 +506 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -476 +518 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -488 +530 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -500 +542 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -512 +554,3 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +For information about the supported and unsupported PyTorch versions, see the [Framework Support Policy Table](https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/dlc-framework-support-policy.html) in the _AWS Deep Learning Containers Developer Guide_. + +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -519,0 +564,20 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training:`<tag>` | 2.7.1 | training | CPU, GPU | py312 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference:`<tag>` | 2.6.0 | inference | CPU, GPU | py312 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training:`<tag>` | 2.6.0 | training | CPU, GPU | py312 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference:`<tag>` | 2.5.1 | inference | CPU, GPU | py311 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training:`<tag>` | 2.5.1 | training | CPU, GPU | py311 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference:`<tag>` | 2.4.0 | inference | CPU, GPU | py311 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference-graviton:`<tag>` | 2.4.0 | inference_graviton | CPU | py311 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training:`<tag>` | 2.4.0 | training | CPU, GPU | py311 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference:`<tag>` | 2.3.0 | inference | CPU, GPU | py311 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference-graviton:`<tag>` | 2.3.0 | inference_graviton | CPU | py311 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training:`<tag>` | 2.3.0 | training | CPU, GPU | py311 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference-graviton:`<tag>` | 2.2.1 | inference_graviton | CPU | py310 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference:`<tag>` | 2.2.0 | inference | CPU, GPU | py310 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training:`<tag>` | 2.2.0 | training | CPU, GPU | py310 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference:`<tag>` | 2.1.0 | inference | CPU, GPU | py310 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference-graviton:`<tag>` | 2.1.0 | inference_graviton | CPU | py310 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training:`<tag>` | 2.1.0 | training | CPU, GPU | py310 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference:`<tag>` | 2.0.1 | inference | CPU, GPU | py310 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference-graviton:`<tag>` | 2.0.1 | inference_graviton | CPU | py310 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training:`<tag>` | 2.0.1 | training | CPU, GPU | py310 @@ -520,0 +585 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference-graviton:`<tag>` | 2.0.0 | inference_graviton | CPU | py310 @@ -547,4 +612,4 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference:`<tag>` | 1.5.0 | inference | CPU, GPU | py3 -442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training:`<tag>` | 1.5.0 | training | CPU, GPU | py3 -442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference:`<tag>` | 1.4.0 | inference | CPU, GPU | py3 -442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training:`<tag>` | 1.4.0 | training | CPU, GPU | py2, py3 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference:`<tag>` | 1.5.0 | inference | CPU, GPU | py3, py36 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training:`<tag>` | 1.5.0 | training | CPU, GPU | py3, py36 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-inference:`<tag>` | 1.4.0 | inference | CPU, GPU | py3, py36 +442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training:`<tag>` | 1.4.0 | training | CPU, GPU | py2, py3, py36 @@ -562,12 +626,0 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -## PyTorch Neuron (DLC) - -SageMaker AI Python SDK example to retrieve registry path. - - - from sagemaker import image_uris - image_uris.retrieve(framework='pytorch-neuron',region='us-west-2', image_scope='inference') - -Registry path | Version | Job types (image scope) | Processor types | Python versions ----|---|---|---|--- -442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/pytorch-training-neuron:`<tag>` | 1.11.0 | training | TRN | py38 - @@ -576 +629 @@ Registry path | Version | Job types (image scope) | Processor types | Python ver -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -588 +641 @@ Registry path | Version | Job types (image scope) -SageMaker AI Python SDK example to retrieve registry path. +The following SageMaker AI Python SDK example shows how to retrieve a specific registry path. @@ -608 +661 @@ Registry path | Version | Package version | Job types (image scope)