AWS emr documentation change
Summary
Added documentation for a new 'executor.logging' configuration property that allows disabling logging on executor pods, and updated examples to show how to disable logging and configure custom logging settings.
Security assessment
The change documents a new logging control feature that allows disabling logging on executor pods. While logging controls can have security implications (reducing audit trails or preventing sensitive data exposure), there's no evidence this addresses a specific security vulnerability. This appears to be a feature enhancement for operational control rather than security documentation.
Diff
diff --git a/emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks-job-submitter-container-defaults.md b/emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks-job-submitter-container-defaults.md index 233048c64..a61b0b6ae 100644 --- a//emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks-job-submitter-container-defaults.md +++ b//emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks-job-submitter-container-defaults.md @@ -17,0 +18,5 @@ By default, a job will time out if it cannot start and it waits in the `SUBMITTE +**`executor.logging` ** + + +Enables or disables logging on the executor pods. When this is set to ` DISABLED` the logging container is removed from the executor pods, which will disable any logging for these pods specified in the `monitoringConfiguration`, such as `s3MonitoringConfiguration` or `cloudWatchMonitoringConfiguration`. When this setting is not set or is set to any other value, logging on the executor pods is enabled. + @@ -39 +44,3 @@ Sets a custom value for the amount of memory, in bytes, for the logging containe - * StartJobRun request with custom logging container image, CPU, and memory + * StartJobRun request with logging disabled for executor pods + + * StartJobRun request with custom logging container image, CPU, and memory for the driver and executor pods @@ -78 +85 @@ Sets a custom value for the amount of memory, in bytes, for the logging containe -### `StartJobRun` request with custom logging container image, CPU, and memory +### `StartJobRun` request with logging disabled for executor pods @@ -80,0 +88,2 @@ Sets a custom value for the amount of memory, in bytes, for the logging containe + "configurationOverrides": { + "applicationConfiguration": [ @@ -82,7 +91,3 @@ Sets a custom value for the amount of memory, in bytes, for the logging containe - "name": "spark-python", - "virtualClusterId": "virtual-cluster-id", - "executionRoleArn": "execution-role-arn", - "releaseLabel": "emr-6.11.0-latest", - "jobDriver": { - "sparkSubmitJobDriver": { - "entryPoint": "s3://S3-prefix/trip-count.py" + "classification": "emr-containers-defaults", + "properties": { + "executor.logging": "DISABLED" @@ -89,0 +95,6 @@ Sets a custom value for the amount of memory, in bytes, for the logging containe + } + ], + "monitoringConfiguration": { + "cloudWatchMonitoringConfiguration": { + "logGroupName": "/emr-containers/jobs", + "logStreamNamePrefix": "demo" @@ -90,0 +102,9 @@ Sets a custom value for the amount of memory, in bytes, for the logging containe + "s3MonitoringConfiguration": { + "logUri": "s3://joblogs" + } + } + } + +### `StartJobRun` request with custom logging container image, CPU, and memory for the driver and executor pods + + @@ -112 +131,0 @@ Sets a custom value for the amount of memory, in bytes, for the logging containe - }