AWS glue documentation change
Summary
Added documentation for IcebergOptimizationProperties and IcebergOptimizationPropertiesOutput structures including configuration parameters for Iceberg table compaction, retention, orphan file deletion, and IAM role requirements
Security assessment
The changes document security-related configurations for Iceberg table operations including IAM role requirements (RoleArn) and orphan file deletion to prevent data leakage. While these are security-adjacent features, there is no evidence this addresses a specific existing vulnerability.
Diff
diff --git a/glue/latest/dg/aws-glue-api-catalog-catalogs.md b/glue/latest/dg/aws-glue-api-catalog-catalogs.md index a58c3a12d..6f6ddb1dc 100644 --- a//glue/latest/dg/aws-glue-api-catalog-catalogs.md +++ b//glue/latest/dg/aws-glue-api-catalog-catalogs.md @@ -5 +5 @@ -— data types —CatalogCatalogInputTargetRedshiftCatalogCatalogPropertiesCatalogPropertiesOutputDataLakeAccessPropertiesDataLakeAccessPropertiesOutputFederatedCatalog — operations —CreateCatalog (create_catalog)UpdateCatalog (update_catalog)DeleteCatalog (delete_catalog)GetCatalog (get_catalog)GetCatalogs (get_catalogs) +— data types —CatalogCatalogInputTargetRedshiftCatalogCatalogPropertiesCatalogPropertiesOutputDataLakeAccessPropertiesIcebergOptimizationPropertiesDataLakeAccessPropertiesOutputIcebergOptimizationPropertiesOutputFederatedCatalog — operations —CreateCatalog (create_catalog)UpdateCatalog (update_catalog)DeleteCatalog (delete_catalog)GetCatalog (get_catalog)GetCatalogs (get_catalogs) @@ -24,0 +25,2 @@ The Catalogs API describes the APIs for creating, deleting, locating, updating, + * IcebergOptimizationProperties structure + @@ -26,0 +29,2 @@ The Catalogs API describes the APIs for creating, deleting, locating, updating, + * IcebergOptimizationPropertiesOutput structure + @@ -164,0 +169,4 @@ A `DataLakeAccessProperties` object that specifies properties to configure data + * `IcebergOptimizationProperties` – An IcebergOptimizationProperties object. + +A structure that specifies Iceberg table optimization properties for the catalog. This includes configuration for compaction, retention, and orphan file deletion operations that can be applied to Iceberg tables in this catalog. + @@ -185,0 +194,4 @@ A `DataLakeAccessProperties` object with input properties to configure data lake + * `IcebergOptimizationProperties` – An IcebergOptimizationPropertiesOutput object. + +An `IcebergOptimizationPropertiesOutput` object that specifies Iceberg table optimization settings for the catalog, including configurations for compaction, retention, and orphan file deletion operations. + @@ -221,0 +234,37 @@ Specifies a federated catalog type for the native catalog resource. The currentl +## IcebergOptimizationProperties structure + +A structure that specifies Iceberg table optimization properties for the catalog, including configurations for compaction, retention, and orphan file deletion operations. + +###### Fields + + * `RoleArn` – UTF-8 string, matching the [Custom string pattern #51](./aws-glue-api-common.html#regex_51). + +The Amazon Resource Name (ARN) of the IAM role that will be assumed to perform Iceberg table optimization operations. + + * `Compaction` – A map array of key-value pairs. + +Each key is a Key string, not less than 1 or more than 255 bytes long, matching the [Single-line string pattern](./aws-glue-api-common.html#aws-glue-api-regex-oneLine). + +Each value is a UTF-8 string, not more than 512000 bytes long. + +A map of key-value pairs that specify configuration parameters for Iceberg table compaction operations, which optimize the layout of data files to improve query performance. + + * `Retention` – A map array of key-value pairs. + +Each key is a Key string, not less than 1 or more than 255 bytes long, matching the [Single-line string pattern](./aws-glue-api-common.html#aws-glue-api-regex-oneLine). + +Each value is a UTF-8 string, not more than 512000 bytes long. + +A map of key-value pairs that specify configuration parameters for Iceberg table retention operations, which manage the lifecycle of table snapshots to control storage costs. + + * `OrphanFileDeletion` – A map array of key-value pairs. + +Each key is a Key string, not less than 1 or more than 255 bytes long, matching the [Single-line string pattern](./aws-glue-api-common.html#aws-glue-api-regex-oneLine). + +Each value is a UTF-8 string, not more than 512000 bytes long. + +A map of key-value pairs that specify configuration parameters for Iceberg orphan file deletion operations, which identify and remove files that are no longer referenced by the table metadata. + + + + @@ -262,0 +312,41 @@ Specifies a federated catalog type for the native catalog resource. The currentl +## IcebergOptimizationPropertiesOutput structure + +A structure that contains the output properties of Iceberg table optimization configuration for your catalog resource in the AWS Glue Data Catalog. + +###### Fields + + * `RoleArn` – UTF-8 string, matching the [Custom string pattern #51](./aws-glue-api-common.html#regex_51). + +The Amazon Resource Name (ARN) of the IAM role that is used to perform Iceberg table optimization operations. + + * `Compaction` – A map array of key-value pairs. + +Each key is a Key string, not less than 1 or more than 255 bytes long, matching the [Single-line string pattern](./aws-glue-api-common.html#aws-glue-api-regex-oneLine). + +Each value is a UTF-8 string, not more than 512000 bytes long. + +A map of key-value pairs that specify configuration parameters for Iceberg table compaction operations, which optimize the layout of data files to improve query performance. + + * `Retention` – A map array of key-value pairs. + +Each key is a Key string, not less than 1 or more than 255 bytes long, matching the [Single-line string pattern](./aws-glue-api-common.html#aws-glue-api-regex-oneLine). + +Each value is a UTF-8 string, not more than 512000 bytes long. + +A map of key-value pairs that specify configuration parameters for Iceberg table retention operations, which manage the lifecycle of table snapshots to control storage costs. + + * `OrphanFileDeletion` – A map array of key-value pairs. + +Each key is a Key string, not less than 1 or more than 255 bytes long, matching the [Single-line string pattern](./aws-glue-api-common.html#aws-glue-api-regex-oneLine). + +Each value is a UTF-8 string, not more than 512000 bytes long. + +A map of key-value pairs that specify configuration parameters for Iceberg orphan file deletion operations, which identify and remove files that are no longer referenced by the table metadata. + + * `LastUpdatedTime` – Timestamp. + +The timestamp when the Iceberg optimization properties were last updated. + + + +