AWS msk documentation change
Summary
Added documentation for log compaction retention settings (delete.retention.ms, min/max.compaction.lag.ms) across multiple configuration sections.
Security assessment
The changes document standard Kafka log compaction parameters that control data retention windows. While these settings influence data lifecycle management, there's no indication they address a specific security vulnerability or represent new security features. The documentation updates appear to expand configuration details rather than respond to security issues.
Diff
diff --git a/msk/latest/developerguide/msk-configuration-express-read-write.md b/msk/latest/developerguide/msk-configuration-express-read-write.md index 7b6b167b1..1792e586b 100644 --- a//msk/latest/developerguide/msk-configuration-express-read-write.md +++ b//msk/latest/developerguide/msk-configuration-express-read-write.md @@ -26 +26 @@ You can use Amazon MSK to create a custom MSK configuration file to set the foll -Express brokers read/write (editable) configurations – static properties Property | Description | Default Value +Property | Description | Default Value @@ -35,0 +36,3 @@ leader.imbalance.per.broker.percentage | The ratio of leader imbalance allowed +log.cleaner.delete.retention.ms | The amount of time to retain delete tombstone markers for log compacted topics. This setting also gives a bound on the time in which a consumer must complete a read if they begin from offset 0 to ensure that they get a valid snapshot of the final stage. Else, delete tombstones might be collected before they complete their scan. | 86400000 (24 * 60 * 60 * 1000 ms, that is, 1 day), Apache Kafka Default +log.cleaner.min.compaction.lag.ms | The minimum time a message will remain uncompacted in the log. This setting is only applicable for logs that are being compacted. | 0, Apache Kafka Default +log.cleaner.max.compaction.lag.ms | The maximum time a message will remain ineligible for compaction in the log. This setting is only applicable for logs that are being compacted. This configuration would be bounded in the range of [7 days, Long.Max]. | 9223372036854775807, Apache Kafka Default @@ -59 +62 @@ You can use Apache Kafka AlterConfig API or the Kafka-configs.sh tool to edit th -Express brokers dynamic configurations Property | Description | Default value +Property | Description | Default value @@ -62,0 +66,3 @@ compression.type | The final compression type for a given topic. You can set th +log.cleaner.delete.retention.ms | The amount of time to retain delete tombstone markers for log compacted topics. This setting also gives a bound on the time in which a consumer must complete a read if they begin from offset 0 to ensure that they get a valid snapshot of the final stage. Else, delete tombstones might be collected before they complete their scan. | 86400000 (24 * 60 * 60 * 1000 ms, that is, 1 day), Apache Kafka Default +log.cleaner.min.compaction.lag.ms | The minimum time a message will remain uncompacted in the log. This setting is only applicable for logs that are being compacted. | 0, Apache Kafka Default +log.cleaner.max.compaction.lag.ms | The maximum time a message will remain ineligible for compaction in the log. This setting is only applicable for logs that are being compacted. This configuration would be bounded in the range of [7 days, Long.Max]. | 9223372036854775807, Apache Kafka Default @@ -80 +86 @@ You can use Apache Kafka commands to set or modify topic-level configuration pro -Topic-Level configurations on Express Brokers Property | Description +Property | Description @@ -83,0 +90 @@ compression.type | Specify the final compression type for a given topic. This c +delete.retention.ms | The amount of time to retain delete tombstone markers for log compacted topics. This setting also gives a bound on the time in which a consumer must complete a read if they begin from offset 0 to ensure that they get a valid snapshot of the final stage. Else, delete tombstones might be collected before they complete their scan. The default value for this setting is 86400000 (24 * 60 * 60 * 1000 ms, that is, 1 day), Apache Kafka Default @@ -87,0 +95,2 @@ message.timestamp.type | Define whether the timestamp in the message is message +min.compaction.lag.ms | The minimum time a message will remain uncompacted in the log. This setting is only applicable for logs that are being compacted. The default value for this setting is 0, Apache Kafka Default +max.compaction.lag.ms | The maximum time a message will remain ineligible for compaction in the log. This setting is only applicable for logs that are being compacted. This configuration would be bounded in the range of [7 days, Long.Max]. The default value for this setting is 9223372036854775807, Apache Kafka Default.