AWS emr documentation change
Summary
Added warning about Spark Dynamic Resource Allocator configuration
Security assessment
Addresses performance/cost considerations for scaling behavior, not directly related to security controls or vulnerabilities
Diff
diff --git a/emr/latest/ManagementGuide/emr-managed-scaling.md b/emr/latest/ManagementGuide/emr-managed-scaling.md index 3bceb4346..f67073172 100644 --- a//emr/latest/ManagementGuide/emr-managed-scaling.md +++ b//emr/latest/ManagementGuide/emr-managed-scaling.md @@ -134,0 +135,2 @@ See more [details on how Amazon EMR integrates with YARN deny listing during dec + * For Spark workloads, disabling Spark Dynamic Resource Allocator (DRA) by changing the Spark property **spark.dynamicAllocation.enabled** to `FALSE` can cause Managed Scaling issues, where clusters can be scaled up more than required for your workloads (up to the maximum compute). When using Managed Scaling for these workloads, we recommend that you keep Spark DRA enabled, which is the default state of this property. +