AWS cli documentation change
Summary
Added Route node configuration with security-focused filtering
Security assessment
While not directly fixing a vulnerability, adds data routing controls that could support security policies
Diff
diff --git a/cli/latest/reference/glue/batch-get-jobs.md b/cli/latest/reference/glue/batch-get-jobs.md index 63914900d..b75bc4978 100644 --- a//cli/latest/reference/glue/batch-get-jobs.md +++ b//cli/latest/reference/glue/batch-get-jobs.md @@ -15 +15 @@ - * [AWS CLI 2.27.63 Command Reference](../../index.html) » + * [AWS CLI 2.28.0 Command Reference](../../index.html) » @@ -358 +358 @@ Jobs -> (list) ->>> The type of predefined worker that is allocated when a job runs. Accepts a value of G.1X, G.2X, G.4X, G.8X or G.025X for Spark jobs. Accepts the value Z.2X for Ray jobs. +>>> The type of predefined worker that is allocated when a job runs. @@ -360,6 +360,19 @@ Jobs -> (list) ->>> * For the `G.1X` worker type, each worker maps to 1 DPU (4 vCPUs, 16 GB of memory) with 94GB disk, and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs. ->>> * For the `G.2X` worker type, each worker maps to 2 DPU (8 vCPUs, 32 GB of memory) with 138GB disk, and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs. ->>> * For the `G.4X` worker type, each worker maps to 4 DPU (16 vCPUs, 64 GB of memory) with 256GB disk, and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs in the following Amazon Web Services Regions: US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), and Europe (Stockholm). ->>> * For the `G.8X` worker type, each worker maps to 8 DPU (32 vCPUs, 128 GB of memory) with 512GB disk, and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs, in the same Amazon Web Services Regions as supported for the `G.4X` worker type. ->>> * For the `G.025X` worker type, each worker maps to 0.25 DPU (2 vCPUs, 4 GB of memory) with 84GB disk, and provides 1 executor per worker. We recommend this worker type for low volume streaming jobs. This worker type is only available for Glue version 3.0 or later streaming jobs. ->>> * For the `Z.2X` worker type, each worker maps to 2 M-DPU (8vCPUs, 64 GB of memory) with 128 GB disk, and provides up to 8 Ray workers based on the autoscaler. +>>> Glue provides multiple worker types to accommodate different workload requirements: +>>> +>>> G Worker Types (General-purpose compute workers): +>>> +>>> * G.1X: 1 DPU (4 vCPUs, 16 GB memory, 94GB disk) +>>> * G.2X: 2 DPU (8 vCPUs, 32 GB memory, 138GB disk) +>>> * G.4X: 4 DPU (16 vCPUs, 64 GB memory, 256GB disk) +>>> * G.8X: 8 DPU (32 vCPUs, 128 GB memory, 512GB disk) +>>> * G.12X: 12 DPU (48 vCPUs, 192 GB memory, 768GB disk) +>>> * G.16X: 16 DPU (64 vCPUs, 256 GB memory, 1024GB disk) +>>> + +>>> +>>> R Worker Types (Memory-optimized workers): +>>> +>>> * R.1X: 1 M-DPU (4 vCPUs, 32 GB memory) +>>> * R.2X: 2 M-DPU (8 vCPUs, 64 GB memory) +>>> * R.4X: 4 M-DPU (16 vCPUs, 128 GB memory) +>>> * R.8X: 8 M-DPU (32 vCPUs, 256 GB memory) @@ -455,0 +469,4 @@ Jobs -> (list) +>>>>>>>>> +>>>>>>>>> GlueStudioType -> (string) +>>>>>>>>> +>>>>>>>>>> The data type of the column as defined in Glue Studio. @@ -553,0 +571,4 @@ Jobs -> (list) +>>>>>>>>> +>>>>>>>>> GlueStudioType -> (string) +>>>>>>>>> +>>>>>>>>>> The data type of the column as defined in Glue Studio. @@ -605,0 +627,4 @@ Jobs -> (list) +>>>>>>>>> +>>>>>>>>> GlueStudioType -> (string) +>>>>>>>>> +>>>>>>>>>> The data type of the column as defined in Glue Studio. @@ -621,0 +647,32 @@ Jobs -> (list) +>>>>> +>>>>> PartitionPredicate -> (string) +>>>>> +>>>>>> Partitions satisfying this predicate are deleted. Files within the retention period in these partitions are not deleted. +>>>>> +>>>>> OutputSchemas -> (list) +>>>>> +>>>>>> Specifies the data schema for the catalog source. +>>>>>> +>>>>>> (structure) +>>>>>> +>>>>>>> Specifies a user-defined schema when a schema cannot be determined by Glue. +>>>>>>> +>>>>>>> Columns -> (list) +>>>>>>> +>>>>>>>> Specifies the column definitions that make up a Glue schema. +>>>>>>>> +>>>>>>>> (structure) +>>>>>>>> +>>>>>>>>> Specifies a single column in a Glue schema definition. +>>>>>>>>> +>>>>>>>>> Name -> (string) +>>>>>>>>> +>>>>>>>>>> The name of the column in the Glue Studio schema. +>>>>>>>>> +>>>>>>>>> Type -> (string) +>>>>>>>>> +>>>>>>>>>> The hive type for this column in the Glue Studio schema. +>>>>>>>>> +>>>>>>>>> GlueStudioType -> (string) +>>>>>>>>> +>>>>>>>>>> The data type of the column as defined in Glue Studio. @@ -798,92 +854,0 @@ Jobs -> (list) ->>>> ->>>> S3ExcelSource -> (structure) ->>>> ->>>>> Defines configuration parameters for reading Excel files from Amazon S3. ->>>>> ->>>>> Name -> (string) ->>>>> ->>>>>> The name of the S3 Excel data source. ->>>>> ->>>>> Paths -> (list) ->>>>> ->>>>>> The S3 paths where the Excel files are located. ->>>>>> ->>>>>> (string) ->>>>> ->>>>> CompressionType -> (string) ->>>>> ->>>>>> The compression format used for the Excel files. ->>>>> ->>>>> Exclusions -> (list) ->>>>> ->>>>>> Patterns to exclude specific files or paths from processing. ->>>>>> ->>>>>> (string) ->>>>> ->>>>> GroupSize -> (string) ->>>>> ->>>>>> Defines the size of file groups for batch processing. ->>>>> ->>>>> GroupFiles -> (string) ->>>>> ->>>>>> Specifies how files should be grouped for processing. ->>>>> ->>>>> Recurse -> (boolean) ->>>>> ->>>>>> Indicates whether to recursively process subdirectories. ->>>>> ->>>>> MaxBand -> (integer) ->>>>> ->>>>>> The maximum number of processing bands to use. ->>>>> ->>>>> MaxFilesInBand -> (integer) ->>>>> ->>>>>> The maximum number of files to process in each band. ->>>>> ->>>>> AdditionalOptions -> (structure) ->>>>> ->>>>>> Additional configuration options for S3 direct source processing. ->>>>>> ->>>>>> BoundedSize -> (long) ->>>>>> ->>>>>>> Sets the upper limit for the target size of the dataset in bytes that will be processed. ->>>>>> ->>>>>> BoundedFiles -> (long) ->>>>>> ->>>>>>> Sets the upper limit for the target number of files that will be processed. ->>>>>> ->>>>>> EnableSamplePath -> (boolean) ->>>>>> ->>>>>>> Sets option to enable a sample path. ->>>>>> ->>>>>> SamplePath -> (string) ->>>>>> ->>>>>>> If enabled, specifies the sample path. ->>>>> ->>>>> NumberRows -> (long) ->>>>> ->>>>>> The number of rows to process from each Excel file. ->>>>> ->>>>> SkipFooter -> (integer) ->>>>> ->>>>>> The number of rows to skip at the end of each Excel file. ->>>>> ->>>>> OutputSchemas -> (list) ->>>>> ->>>>>> The AWS Glue schemas to apply to the processed data. ->>>>>> ->>>>>> (structure) ->>>>>> ->>>>>>> Specifies a user-defined schema when a schema cannot be determined by Glue. ->>>>>>> ->>>>>>> Columns -> (list) ->>>>>>> ->>>>>>>> Specifies the column definitions that make up a Glue schema. ->>>>>>>> ->>>>>>>> (structure) ->>>>>>>> ->>>>>>>>> Specifies a single column in a Glue schema definition. ->>>>>>>>> ->>>>>>>>> Name -> (string) ->>>>>>>>> ->>>>>>>>>> The name of the column in the Glue Studio schema. @@ -891 +856 @@ Jobs -> (list) ->>>>>>>>> Type -> (string) +>>>>>>>>> GlueStudioType -> (string) @@ -893 +858 @@ Jobs -> (list) ->>>>>>>>>> The hive type for this column in the Glue Studio schema. +>>>>>>>>>> The data type of the column as defined in Glue Studio. @@ -989,0 +955,4 @@ Jobs -> (list) +>>>>>>>>> +>>>>>>>>> GlueStudioType -> (string) +>>>>>>>>> +>>>>>>>>>> The data type of the column as defined in Glue Studio. @@ -1077,0 +1047,4 @@ Jobs -> (list) +>>>>>>>>> +>>>>>>>>> GlueStudioType -> (string) +>>>>>>>>> +>>>>>>>>>> The data type of the column as defined in Glue Studio. @@ -1109,0 +1083,16 @@ Jobs -> (list) +>>>>> +>>>>> PitrEnabled -> (boolean) +>>>>> +>>>>>> Specifies whether Point-in-Time Recovery (PITR) is enabled for the DynamoDB table. When set to `true` , allows reading from a specific point in time. The default value is `false` . +>>>>> +>>>>> AdditionalOptions -> (structure)