AWS glue documentation change
Summary
Added warnings about partition column selection and clarified partition function constraints
Security assessment
Changes provide performance optimization guidance and API usage clarity. No security vulnerabilities or security features are mentioned in the updates.
Diff
diff --git a/glue/latest/webapi/API_IntegrationPartition.md b/glue/latest/webapi/API_IntegrationPartition.md index 199cde258..2db609983 100644 --- a//glue/latest/webapi/API_IntegrationPartition.md +++ b//glue/latest/webapi/API_IntegrationPartition.md @@ -16 +16 @@ A structure that describes how data is partitioned on the target. -The field name used to partition data on the target. +The field name used to partition data on the target. Avoid using columns that have unique values for each row (for example, `LastModifiedTimestamp`, `SystemModTimeStamp`) as the partition column. These columns are not suitable for partitioning because they create a large number of small partitions, which can lead to performance issues. @@ -27 +27 @@ Required: No -Specifies a function used to partition data on the target. +Specifies the function used to partition data on the target. The only accepted value for this parameter is `'identity'` (string). The `'identity'` function ensures that the data partitioning on the target follows the same scheme as the source. In other words, the partitioning structure of the source data is preserved in the target destination.