AWS mwaa: MWAA: add out-of-disk-space troubleshooting and typo fix
Summary
Adds a troubleshooting entry for the "OSError [Error 28] No space left on device" pip-install failure, suggesting --no-cache-dir installs via a startup script or installing from Python wheels. Also corrects the typo "permisions" to "permissions" in the VPC/S3 gateway endpoint step.
Security assessment
Operational troubleshooting for container storage limits plus a spelling correction ('permisions' -> 'permissions') on an existing VPC/Amazon S3 gateway endpoint note. No authentication, authorization, encryption, or exposure change; the 'minimum required permissions' guidance is unchanged in substance.
Evidence
+ pip3 install --no-cache-dir -r /usr/local/airflow/dags/requirements.txt
Diff
diff --git a/mwaa/latest/userguide/t-create-update-environment.md b/mwaa/latest/userguide/t-create-update-environment.md index aab00d5e1..5ba864915 100644 --- a//mwaa/latest/userguide/t-create-update-environment.md +++ b//mwaa/latest/userguide/t-create-update-environment.md @@ -18,0 +19,2 @@ The topics on this page contain errors you can encounter when creating and updat + * [I get a Could not install packages due to an OSError [Error 28] No space left on device error](./t-create-update-environment.html#t-requirements-no-space) + @@ -74,0 +77,19 @@ If it takes more than twenty minutes for your environment to install a new versi +### I get a `Could not install packages due to an OSError [Error 28] No space left on device` error + +Amazon MWAA containers have a finite amount of storage for the OS, DAGs, runtimes, and libraries. For more information, see [How much task storage is available to each environment?](./mwaa-faqs.html#worker-storage). + +To reduce the storage requirement, you might be able to use `--no-cache-dir` by installing the libraries with a startup script. For example: + + + #!/bin/sh + + if [[ "${MWAA_AIRFLOW_COMPONENT}" != "webserver" ]] + then + # place requirements.txt in DAGs folder, and replace existing requirements.txt with an empty text file + pip3 install --no-cache-dir -r /usr/local/airflow/dags/requirements.txt + fi + +For more information, see [Configure a startup script](./using-startup-script.html#create-startup-script). + +You can also install your libraries from Python wheel files. For more information, see [Option two: Python wheels (.whl)](./best-practices-dependencies.html#best-practices-dependencies-python-wheels). + @@ -152 +173 @@ We recommend the following steps: - 6. If you are using an Amazon VPC _without_ internet access, ensure that you've created an Amazon S3 gateway endpoint, and granted the minimum required permisions to Amazon ECR to access Amazon S3. To learn more about creating an Amazon S3 gateway endpoint, refer to the following: + 6. If you are using an Amazon VPC _without_ internet access, ensure that you've created an Amazon S3 gateway endpoint, and granted the minimum required permissions to Amazon ECR to access Amazon S3. To learn more about creating an Amazon S3 gateway endpoint, refer to the following: