AWS streams documentation change
Summary
Updated documentation to introduce On-demand Advantage mode, restructured content to differentiate between On-demand Standard, On-demand Advantage, and Provisioned modes, and revised switching procedures between modes.
Security assessment
The changes focus on operational aspects (capacity modes, pricing, throughput management) and introduce a new billing/performance tier (On-demand Advantage). There is no mention of security vulnerabilities, access controls, encryption changes, or security incident mitigations. Existing security capabilities like encryption are referenced but not modified.
Diff
diff --git a/streams/latest/dev/how-do-i-size-a-stream.md b/streams/latest/dev/how-do-i-size-a-stream.md index bfb506ca2..13dd45935 100644 --- a//streams/latest/dev/how-do-i-size-a-stream.md +++ b//streams/latest/dev/how-do-i-size-a-stream.md @@ -5 +5 @@ -What is a data stream capacity mode?On-demand mode features and use casesProvisioned mode features and use casesSwitch between capacity modes +What are the different modes in Kinesis Data Streams?On-demand Standard mode features and use casesOn-demand Advantage mode features and use casesProvisioned mode features and use casesSwitch between modes @@ -7 +7 @@ What is a data stream capacity mode?On-demand mode features and use casesProvisi -# Choose the data stream capacity mode +# Choose the right mode to stream in @@ -9 +9 @@ What is a data stream capacity mode?On-demand mode features and use casesProvisi -The following topics explain how to choose the proper capacity mode for your application and how to switch between capacity modes if needed. +The following topics explain how to choose the best mode for your application and how to switch between modes, if needed. @@ -13 +13 @@ The following topics explain how to choose the proper capacity mode for your app - * What is a data stream capacity mode? + * What are the different modes in Kinesis Data Streams? @@ -15 +15,3 @@ The following topics explain how to choose the proper capacity mode for your app - * On-demand mode features and use cases + * On-demand Standard mode features and use cases + + * On-demand Advantage mode features and use cases @@ -19 +21,2 @@ The following topics explain how to choose the proper capacity mode for your app - * Switch between capacity modes + * Switch between modes + @@ -22,0 +26 @@ The following topics explain how to choose the proper capacity mode for your app +## What are the different modes in Kinesis Data Streams? @@ -24 +28 @@ The following topics explain how to choose the proper capacity mode for your app -## What is a data stream capacity mode? +A mode determines how the capacity of a data stream is managed and how you're charged for the usage of your data stream. In Amazon Kinesis Data Streams, you can choose **On-demand Standard** , **On-demand Advantage** , and **provisioned** as the mode for your data streams. @@ -26 +30 @@ The following topics explain how to choose the proper capacity mode for your app -A capacity mode determines how the capacity of a data stream is managed and how you are charged for the usage of your data stream. In Amazon Kinesis Data Streams, you can choose between an **on-demand** mode and a **provisioned** mode for your data streams. + * **On-demand Standard** \- Data streams with an on-demand mode require no capacity planning and automatically scale to handle gigabytes of write and read throughput per minute. With the on-demand mode, Kinesis Data Streams automatically manages the shards in order to provide the necessary throughput. @@ -28 +32 @@ A capacity mode determines how the capacity of a data stream is managed and how - * **On-demand** \- data streams with an on-demand mode require no capacity planning and automatically scale to handle gigabytes of write and read throughput per minute. With the on-demand mode, Kinesis Data Streams automatically manages the shards in order to provide the necessary throughput. + * **On-demand Advantage** \- An account-level mode that enables more capabilities and provides a simpler pricing structure for on-demand streams. In this mode, you can proactively warm a stream’s write throughput capacity at any time. For pricing, there's no longer a fixed, per-stream level charge, and the data ingest, data retrieval, and extended retention usage across all on-demand streams are at least 60% lower than that of **On-demand Standard**. @@ -30 +34 @@ A capacity mode determines how the capacity of a data stream is managed and how - * **Provisioned** \- for the data streams with a provisioned mode, you must specify the number of shards for the data stream. The total capacity of a data stream is the sum of the capacities of its shards. You can increase or decrease the number of shards in a data stream as needed. + * **Provisioned** \- For the data streams with a provisioned mode, you must specify the number of shards for the data stream. The total capacity of a data stream is the sum of the capacities of its shards. You can increase or decrease the number of shards in a data stream, as needed. @@ -35 +39 @@ A capacity mode determines how the capacity of a data stream is managed and how -You can use Kinesis Data Streams `PutRecord` and `PutRecords` APIs to write data into your data streams in both on-demand and provisioned capacity modes. To retrieve data, both capacity modes support default consumers that use the `GetRecords` API and Enhanced Fan-Out (EFO) consumers that use the `SubscribeToShard` API. +You can use Kinesis Data Streams `PutRecord` and `PutRecords` APIs to write data into your data streams in any mode. To retrieve data, all three modes support default consumers that use the `GetRecords` API and Enhanced Fan-Out (EFO) consumers that use the `SubscribeToShard` API. @@ -39 +43 @@ All Kinesis Data Streams capabilities, including retention mode, encryption, mon -## On-demand mode features and use cases +## On-demand Standard mode features and use cases @@ -53 +57 @@ The aggregate read capacity of a data stream with the on-demand mode increases p -With the on-demand capacity mode (same as with the provisioned capacity mode), you must specify a partition key with each record to write data into your data stream. Kinesis Data Streams uses your partition keys to distribute data across shards. Kinesis Data Streams monitors traffic for each shard. When the incoming traffic exceeds 500 KB/s per shard, it splits the shard within 15 minutes. The parent shard’s hash key values are redistributed evenly across child shards. +With the on-demand mode (same as with the provisioned capacity mode), you must specify a partition key with each record to write data into your data stream. Kinesis Data Streams uses your partition keys to distribute data across shards. Kinesis Data Streams monitors traffic for each shard. When the incoming traffic exceeds 500 KB/s per shard, it splits the shard within 15 minutes. The parent shard’s hash key values are redistributed evenly across child shards. @@ -60,0 +65,10 @@ In the on-demand mode, Kinesis Data Streams splits the shards evenly when it det +## On-demand Advantage mode features and use cases + +On-demand Advantage is an account-level setting that unlocks more capabilities and provides a different pricing structure for all on-demand streams in the Region. In this mode, on-demand streams retain their functionality and continue to automatically scale capacity based on actual data usage. If you want to proactively warm a stream’s write throughput capacity, you can configure warm throughput. For example, if your data stream has a write throughput between 10 MB/s and 40 MB/s, you can expect it to handle up to 80MB/s of instant throughput increases without throttling. However, if you forecast an upcoming event to peak around 200MB/s of traffic, you can configure the stream with a warm throughput of 200MB/s to ensure that the capacity is available when the data throughput arrives. Using warm throughput doesn't incur an additional charge. + +Another benefit of On-demand Advantage mode is that on-demand streams transition to a simpler pricing structure. With the mode enabled, the account will no longer see fixed, per-stream charges, and you would only deal with data ingest, data retrieval, and the optional extended retention charges. Each pricing dimension is also at a significant discount compared to the corresponding dimension in On-demand Standard. For more information, see [Amazon Kinesis Data Streams pricing](https://aws.amazon.com/kinesis/data-streams/pricing/). + +Enhanced fan-out data retrievals also do not have a price premium compared to the standard data retrievals in this mode. Enabling On-demand Advantage commits the account to at least 25MiB/s of data ingest and 25MiB/s of data retrieval across all on-demand streams. For accounts that meet the minimum usage requirement, the Kinesis Data Streams console has a check to see if your account’s usage patterns would be a good fit to use **On-demand Advantage mode**. + +If your account’s data usage is below the requirement, you'll be charged the difference as a shortfall, but it will still be at the same discounted rate. Enabling On-demand Advantage also has a minimum period of 24 hours before you can disable the mode. Overall, On-demand Advantage is the best way to stream with Kinesis Data Streams if you have consistent throughput usage close to or above the minimum commitment, need many fan-out consumers, or operate with hundreds of data streams. + @@ -91,3 +105 @@ You may also experience read and write exceptions if you're using a partition ke -## Switch between capacity modes - -You can switch the capacity mode of your data stream from on-demand to provisioned, or from provisioned to on-demand. For each data stream in your AWS account, you can switch between the on-demand and provisioned capacity modes twice within 24 hours. +## Switch between modes @@ -95 +107 @@ You can switch the capacity mode of your data stream from on-demand to provision -Switching between capacity modes of a data stream does not cause any disruptions to your applications that use this data stream. You can continue writing to and reading from this data stream. As you are switching between capacity modes, either from on-demand to provisioned or from provisioned to on-demand, the status of the stream is set to _Updating_. You must wait for the data stream status to get to _Active_ before you can modify its properties again. +For each data stream in your AWS account, you can switch between the on-demand and provisioned modes twice within 24 hours. Switching between modes doesn't cause any disruptions to your applications that use this data stream. You can continue writing to and reading from this data stream. As you're switching between modes, either from on-demand to provisioned or from provisioned to on-demand, the status of the stream is set to _Updating_. You must wait for the data stream status to get to _Active_ before you can modify its properties again. @@ -97 +109 @@ Switching between capacity modes of a data stream does not cause any disruptions -When you switch from provisioned to on-demand capacity mode, your data stream initially retains whatever shard count it had before the transition, and from this point on, Kinesis Data Streams monitors your data traffic and scales the shard count of this on-demand data stream depending on your write throughput. +When you switch from provisioned to on-demand capacity mode, your data stream initially retains whatever shard count it had before the transition, and from this point on, Kinesis Data Streams monitors your data traffic and scales the shard count of this on-demand data stream depending on your write throughput. When you switch from on-demand to provisioned mode, your data stream also initially retains whatever shard count it had before the transition, but from this point on, you're responsible for monitoring and adjusting the shard count of this data stream to properly accomodate your write throughput. @@ -99 +111 @@ When you switch from provisioned to on-demand capacity mode, your data stream in -When you switch from on-demand to provisioned mode, your data stream also initially retains whatever shard count it had before the transition, but from this point on, you are responsible for monitoring and adjusting the shard count of this data stream to properly accomodate your write throughput. +You can switch from **On-demand Standard** to **On-demand Advantage** mode by enabling an account level setting. When enabled, the account commits to at least 25MiB/s of data ingest and 25MiB/s of data retrieval usage across all on-demand streams in the Region. Once enabled, you must wait at least 24 hours before you can disable **On-demand Advantage** , but you can request the change at any time. If you want to switch from **On-demand Advantage** to **On-demand Standard** , you must first remove any warm throughput configured with-demand streams.