AWS Security ChangesHomeSearch

AWS glue: Document Glue Spark Connect endpoint auth token and new session APIs

Service: glue · 2026-11-10 · Documentation medium

File: glue/latest/dg/aws-glue-api-interactive-sessions.md · Type: credentials

Summary

Adds a new SessionEndpoint data type describing the Spark Connect endpoint URL, AuthToken, and AuthTokenExpirationTime, plus new GetSessionEndpoint, GetSystemLogsForSession, and GetDashboardUrl actions; also expands WorkerType value lists and region availability notes.

Security assessment

The change documents a new API (GetSessionEndpoint) that returns an authentication token and expiration for Spark Connect sessions, making credential handling explicit for users. It is security-related documentation of a feature rather than a fix for a specific vulnerability, so no incident/CVE is referenced.

Evidence

+The authentication token to include in requests to the Spark Connect endpoint.

Diff

diff --git a/glue/latest/dg/aws-glue-api-interactive-sessions.md b/glue/latest/dg/aws-glue-api-interactive-sessions.md
index b3e1a6b..c4383db 100644
--- a//glue/latest/dg/aws-glue-api-interactive-sessions.md
+++ b//glue/latest/dg/aws-glue-api-interactive-sessions.md
@@ -7 +7 @@
-— data types —SessionSessionCommandStatementStatementOutputStatementOutputDataConnectionsList — operations —CreateSession (create_session)StopSession (stop_session)DeleteSession (delete_session)GetSession (get_session)ListSessions (list_sessions)RunStatement (run_statement)CancelStatement (cancel_statement)GetStatement (get_statement)ListStatements (list_statements)GetGlueIdentityCenterConfiguration (get_glue_identity_center_configuration)UpdateGlueIdentityCenterConfiguration (update_glue_identity_center_configuration)CreateGlueIdentityCenterConfiguration (create_glue_identity_center_configuration)DeleteGlueIdentityCenterConfiguration (delete_glue_identity_center_configuration)
+— data types —SessionSessionCommandStatementStatementOutputStatementOutputDataConnectionsListSessionEndpoint — operations —CreateSession (create_session)StopSession (stop_session)DeleteSession (delete_session)GetSession (get_session)ListSessions (list_sessions)RunStatement (run_statement)CancelStatement (cancel_statement)GetStatement (get_statement)ListStatements (list_statements)GetGlueIdentityCenterConfiguration (get_glue_identity_center_configuration)UpdateGlueIdentityCenterConfiguration (update_glue_identity_center_configuration)CreateGlueIdentityCenterConfiguration (create_glue_identity_center_configuration)DeleteGlueIdentityCenterConfiguration (delete_glue_identity_center_configuration)GetSessionEndpoint (get_session_endpoint)GetSystemLogsForSession (get_system_logs_for_session)GetDashboardUrl (get_dashboard_url)
@@ -26,0 +27,2 @@ The interactive sessions API describes the AWS Glue API related to using AWS Glu
+  * SessionEndpoint structure
+
@@ -104 +106,3 @@ The number of workers of a defined `WorkerType` to use for the session.
-  * `WorkerType` – UTF-8 string (valid values: `Standard=""` | `G.1X=""` | `G.2X=""` | `G.025X=""` | `G.4X=""` | `G.8X=""` | `Z.2X=""`).
+  * `WorkerType` – UTF-8 string (valid values: `Standard=""` | `G.1X=""` | `G.2X=""` | `G.4X=""` | `G.8X=""` | `G.025X=""` | `Z.2X=""` | `G.12X=""` | `G.16X=""` | `R.1X=""` | `R.2X=""` | `R.4X=""` | `R.8X=""`).
+
+The type of predefined worker that is allocated when a session runs. Accepts a value of `G.1X`, `G.2X`, `G.4X`, `G.8X`, `G.12X`, `G.16X`, `R.1X`, `R.2X`, `R.4X`, or `R.8X` for Spark sessions. Accepts the value `Z.2X` for Ray sessions.
@@ -106 +110 @@ The number of workers of a defined `WorkerType` to use for the session.
-The type of predefined worker that is allocated when a session runs. Accepts a value of `G.1X`, `G.2X`, `G.4X`, or `G.8X` for Spark sessions. Accepts the value `Z.2X` for Ray sessions.
+The `G.12X`, `G.16X`, and `R.1X` through `R.8X` worker types are available only for AWS Glue version 4.0 or later Spark ETL jobs in select AWS Regions. For the supported Regions, see [Configuring job properties for Spark jobs](https://docs.aws.amazon.com/glue/latest/dg/add-job.html) in the developer guide.
@@ -247,0 +252,21 @@ A list of connections used by the job.
+## SessionEndpoint structure
+
+Contains the Spark Connect endpoint details for an interactive session, including the URL and authentication credentials.
+
+###### Fields
+
+  * `Url` – _Required:_ UTF-8 string, not more than 2048 bytes long, matching the [Custom string pattern #56](./aws-glue-api-common.html#regex_56).
+
+The Spark Connect endpoint URL for the session.
+
+  * `AuthToken` – _Required:_ UTF-8 string, not more than 16384 bytes long.
+
+The authentication token to include in requests to the Spark Connect endpoint.
+
+  * `AuthTokenExpirationTime` – _Required:_ Timestamp.
+
+The time at which the authentication token expires.
+
+
+
+
@@ -275,0 +301,6 @@ A list of connections used by the job.
+  * GetSessionEndpoint action (Python: get_session_endpoint)
+
+  * GetSystemLogsForSession action (Python: get_system_logs_for_session)
+
+  * GetDashboardUrl action (Python: get_dashboard_url)
+
@@ -331 +362 @@ The number of workers of a defined `WorkerType` to use for the session.
-  * `WorkerType` – UTF-8 string (valid values: `Standard=""` | `G.1X=""` | `G.2X=""` | `G.025X=""` | `G.4X=""` | `G.8X=""` | `Z.2X=""`).
+  * `WorkerType` – UTF-8 string (valid values: `Standard=""` | `G.1X=""` | `G.2X=""` | `G.4X=""` | `G.8X=""` | `G.025X=""` | `Z.2X=""` | `G.12X=""` | `G.16X=""` | `R.1X=""` | `R.2X=""` | `R.4X=""` | `R.8X=""`).
@@ -333 +364 @@ The number of workers of a defined `WorkerType` to use for the session.
-The type of predefined worker that is allocated when a job runs. Accepts a value of G.1X, G.2X, G.4X, or G.8X for Spark jobs. Accepts the value Z.2X for Ray notebooks.
+The type of predefined worker that is allocated when a job runs. Accepts a value of G.1X, G.2X, G.4X, G.8X, G.12X, G.16X, R.1X, R.2X, R.4X, or R.8X for Spark jobs. Accepts the value Z.2X for Ray notebooks.
@@ -339 +370,9 @@ The type of predefined worker that is allocated when a job runs. Accepts a value
-    * For the `G.4X` worker type, each worker maps to 4 DPU (16 vCPUs, 64 GB of memory) with 256GB disk, and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for AWS Glue version 3.0 or later Spark ETL jobs in the following AWS Regions: US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), and Europe (Stockholm).
+    * For the `G.4X` worker type, each worker maps to 4 DPU (16 vCPUs, 64 GB of memory) with 256GB disk, and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for AWS Glue version 3.0 or later Spark ETL jobs in select AWS Regions. For the supported Regions, see [Configuring job properties for Spark jobs](https://docs.aws.amazon.com/glue/latest/dg/add-job.html) in the developer guide.
+
+    * For the `G.8X` worker type, each worker maps to 8 DPU (32 vCPUs, 128 GB of memory) with 512GB disk, and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for AWS Glue version 3.0 or later Spark ETL jobs in select AWS Regions. For the supported Regions, see [Configuring job properties for Spark jobs](https://docs.aws.amazon.com/glue/latest/dg/add-job.html) in the developer guide.
+
+    * For the `G.12X` worker type, each worker maps to 12 DPU (48 vCPUs, 192 GB of memory) with 768GB disk, and provides 1 executor per worker. We recommend this worker type for jobs with very large workloads. This worker type is available only for AWS Glue version 4.0 or later Spark ETL jobs in select AWS Regions. For the supported Regions, see [Configuring job properties for Spark jobs](https://docs.aws.amazon.com/glue/latest/dg/add-job.html) in the developer guide.
+
+    * For the `G.16X` worker type, each worker maps to 16 DPU (64 vCPUs, 256 GB of memory) with 1024GB disk, and provides 1 executor per worker. We recommend this worker type for jobs with very large workloads. This worker type is available only for AWS Glue version 4.0 or later Spark ETL jobs in select AWS Regions. For the supported Regions, see [Configuring job properties for Spark jobs](https://docs.aws.amazon.com/glue/latest/dg/add-job.html) in the developer guide.
+
+    * For the `R.1X` worker type, each worker maps to 1 M-DPU (4 vCPUs, 32 GB of memory) with 94GB disk, and provides 1 executor per worker. We recommend this worker type for memory-intensive workloads. This worker type is available only for AWS Glue version 4.0 or later Spark ETL jobs in select AWS Regions. For the supported Regions, see [Configuring job properties for Spark jobs](https://docs.aws.amazon.com/glue/latest/dg/add-job.html) in the developer guide.
@@ -341 +380,5 @@ The type of predefined worker that is allocated when a job runs. Accepts a value
-    * For the `G.8X` worker type, each worker maps to 8 DPU (32 vCPUs, 128 GB of memory) with 512GB disk, and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for AWS Glue version 3.0 or later Spark ETL jobs, in the same AWS Regions as supported for the `G.4X` worker type.
+    * For the `R.2X` worker type, each worker maps to 2 M-DPU (8 vCPUs, 64 GB of memory) with 138GB disk, and provides 1 executor per worker. We recommend this worker type for memory-intensive workloads. This worker type is available only for AWS Glue version 4.0 or later Spark ETL jobs in select AWS Regions. For the supported Regions, see [Configuring job properties for Spark jobs](https://docs.aws.amazon.com/glue/latest/dg/add-job.html) in the developer guide.
+
+    * For the `R.4X` worker type, each worker maps to 4 M-DPU (16 vCPUs, 128 GB of memory) with 256GB disk, and provides 1 executor per worker. We recommend this worker type for memory-intensive workloads. This worker type is available only for AWS Glue version 4.0 or later Spark ETL jobs in select AWS Regions. For the supported Regions, see [Configuring job properties for Spark jobs](https://docs.aws.amazon.com/glue/latest/dg/add-job.html) in the developer guide.
+
+    * For the `R.8X` worker type, each worker maps to 8 M-DPU (32 vCPUs, 256 GB of memory) with 512GB disk, and provides 1 executor per worker. We recommend this worker type for memory-intensive workloads. This worker type is available only for AWS Glue version 4.0 or later Spark ETL jobs in select AWS Regions. For the supported Regions, see [Configuring job properties for Spark jobs](https://docs.aws.amazon.com/glue/latest/dg/add-job.html) in the developer guide.
@@ -979,0 +1023,131 @@ Deletes the existing AWS Glue Identity Center configuration, removing the integr
+## GetSessionEndpoint action (Python: get_session_endpoint)
+
+Returns the Spark Connect endpoint URL and authentication token for an interactive session.
+
+###### Example Get Spark Connect endpoint for a session
+    
+    
+    aws glue get-session-endpoint --session-id ses-1234567890abcdef0
+
+###### Request
+
+  * `SessionId` – _Required:_ UTF-8 string, not less than 1 or more than 255 bytes long, matching the [Single-line string pattern](./aws-glue-api-common.html#aws-glue-api-regex-oneLine).
+
+The unique identifier of the interactive session.
+
+
+
+
+###### Response
+
+  * `SparkConnect` – _Required:_ A SessionEndpoint object.
+
+The Spark Connect endpoint details for the session.
+
+
+
+
+###### Errors
+
+  * `AccessDeniedException`
+
+  * `EntityNotFoundException`
+
+  * `InternalServiceException`
+
+  * `OperationTimeoutException`
+
+  * `InvalidInputException`
+
+  * `OperationNotSupportedException`
+
+  * `IllegalSessionStateException`
+
+
+
+
+## GetSystemLogsForSession action (Python: get_system_logs_for_session)
+
+Retrieves the system logs for an interactive session.
+
+###### Request
+
+  * `Id` – _Required:_ UTF-8 string, not less than 1 or more than 255 bytes long, matching the [Single-line string pattern](./aws-glue-api-common.html#aws-glue-api-regex-oneLine).
+
+The ID of the session.
+
+
+
+
+###### Response
+
+  * `SystemLogsUrl` – UTF-8 string, not more than 40000 bytes long.
+
+The URL to download the system logs for the session.
+
+
+
+
+###### Errors
+
+  * `AccessDeniedException`
+
+  * `InternalServiceException`
+
+  * `EntityNotFoundException`
+
+  * `InvalidInputException`
+
+
+
+
+## GetDashboardUrl action (Python: get_dashboard_url)
+
+Retrieves the URL for the Spark monitoring dashboard for a Glue resource.
+
+###### Example Get Spark UI dashboard URL for a session
+    
+    
+    aws glue get-dashboard-url --resource-id ses-1234567890abcdef0 --resource-type SESSION
+
+###### Request
+
+  * `ResourceId` – _Required:_ UTF-8 string, not less than 1 or more than 255 bytes long, matching the [Single-line string pattern](./aws-glue-api-common.html#aws-glue-api-regex-oneLine).
+
+The unique identifier of the resource for which to retrieve the dashboard URL.
+
+  * `ResourceType` – _Required:_ UTF-8 string (valid values: `JOB=""` | `SESSION=""`).
+
+The type of the resource. Valid values are `SESSION` and `JOB`.
+
+  * `RequestOrigin` – UTF-8 string, not less than 1 or more than 128 bytes long, matching the [Custom string pattern #52](./aws-glue-api-common.html#regex_52).
+
+The origin of the request. 
+
+
+
+
+###### Response
+
+  * `Url` – _Required:_ UTF-8 string, not more than 40000 bytes long.
+
+The URL for the Spark monitoring dashboard.
+
+
+
+
+###### Errors
+
+  * `InvalidInputException`
+
+  * `EntityNotFoundException`
+
+  * `AccessDeniedException`
+
+  * `OperationNotSupportedException`
+
+  * `InternalServiceException`
+