AWS AmazonS3 documentation change
Summary
Updated section headers, added details about compaction scheduling/APIs, added note about Iceberg concurrency/retries, expanded maintenance operations table with API links
Security assessment
Changes focus on operational details (scheduling, API usage, conflict handling) rather than addressing vulnerabilities or introducing security features. The note about optimistic concurrency and retries improves reliability documentation but doesn't directly address security risks.
Diff
diff --git a/AmazonS3/latest/userguide/s3-tables-considerations.md b/AmazonS3/latest/userguide/s3-tables-considerations.md index 3a8e043c4..bf9ecce1c 100644 --- a//AmazonS3/latest/userguide/s3-tables-considerations.md +++ b//AmazonS3/latest/userguide/s3-tables-considerations.md @@ -5 +5 @@ -Considerations for compactionConsiderations for snapshot managementConsiderations for unreferenced file removalLimits for S3 table and table buckets maintenance +Considerations for compactionConsiderations for snapshot managementConsiderations for unreferenced file removalS3 table and table buckets maintenance operations limits and related APIs @@ -19 +19 @@ Amazon S3 offers maintenance operations to enhance the performance of your S3 ta - * Limits for S3 table and table buckets maintenance + * S3 table and table buckets maintenance operations limits and related APIs @@ -32 +32 @@ The following considerations apply to compaction. For more information about com - * Compaction doesn’t support data type: Fixed. + * Compaction doesn’t support data type: `Fixed`. @@ -35,0 +36 @@ The following considerations apply to compaction. For more information about com + * Compaction occurs on an automated schedule. If you want to prevent charges associated with compaction you can manually disable it for a table using the [PutTableMaintenanceConfiguration](https://docs.aws.amazon.com/AmazonS3/latest/API/API_s3Buckets_PutTableMaintenanceConfiguration.html) API operation. @@ -38,0 +40,5 @@ The following considerations apply to compaction. For more information about com + +###### Note + +Apache Iceberg uses an optimistic concurrency model along with conflict detection to arbitrate write transactions. With optimistic concurrency, user and compaction transactions can conflict causing transactions to fail. If conflicts occur, compaction jobs will retry on failure. It is recommended that your pipelines also use retry logic to overcome transactions that fail from conflicting operations. + @@ -61 +67 @@ The following considerations apply to unreferenced file removal. For more inform -## Limits for S3 table and table buckets maintenance +## S3 table and table buckets maintenance operations limits and related APIs @@ -63,7 +69,7 @@ The following considerations apply to unreferenced file removal. For more inform -Maintenance operation | Property | Configurable at table bucket level? | Configurable at table level? | Default value | Minimum value ----|---|---|---|---|--- -Compaction | targetFileSizeMB | No | Yes | 512MB | 64MB -Snapshot management | minimumSnapshots | No | Yes | 1 | 1 -Snapshot management | maximumSnapshotAge | No | Yes | 120 hours | 1 hour -Unreferenced file removal | unreferencedDays | Yes | No | 3 days | 1 days -Unreferenced file removal | nonCurrentDays | Yes | No | 10 days | 1 days +Maintenance operation | Property | Configurable at table bucket level? | Configurable at table level? | Default value | Minimum value | Related Iceberg maintenance routine | Controlling S3 Tables API +---|---|---|---|---|---|---|--- +Compaction | `targetFileSizeMB` | No | Yes | 512MB | 64MB | `[`rewriteDataFiles`](https://iceberg.apache.org/docs/latest/maintenance/#compact-data-files)` | [`PutTableMaintenanceConfiguration`](https://docs.aws.amazon.com/AmazonS3/latest/API/API_s3tables_PutTableMaintenanceConfiguration.html) +Snapshot management | `minimumSnapshots` | No | Yes | 1 | 1 | [`ExpireSnapshots`](https://iceberg.apache.org/docs/latest/maintenance/#expire-snapshots) `retainLast` | ``[`PutTableMaintenanceConfiguration`](https://docs.aws.amazon.com/AmazonS3/latest/API/API_s3tables_PutTableMaintenanceConfiguration.html) +Snapshot management | `maximumSnapshotAge` | No | Yes | 120 hours | 1 hour | [`ExpireSnapshots`](https://iceberg.apache.org/docs/latest/maintenance/#expire-snapshots) `expireOlderThan` | [`PutTableMaintenanceConfiguration`](https://docs.aws.amazon.com/AmazonS3/latest/API/API_s3tables_PutTableMaintenanceConfiguration.html) +Unreferenced file removal | `unreferencedDays` | Yes | No | 3 days | 1 days | [`deleteOrphanFiles`](https://iceberg.apache.org/docs/latest/maintenance/#delete-orphan-files) | [`PutTableBucketMaintenanceConfiguration`](https://docs.aws.amazon.com/AmazonS3/latest/API/API_s3tables_PutTableBucketMaintenanceConfiguration.html) +Unreferenced file removal | `nonCurrentDays` | Yes | No | 10 days | 1 days | N/A | [`PutTableBucketMaintenanceConfiguration`](https://docs.aws.amazon.com/AmazonS3/latest/API/API_s3tables_PutTableBucketMaintenanceConfiguration.html)