AWS glue documentation change
Summary
Added documentation for AWS Glue zero-ETL integration CloudFormation templates, including integration resource properties and sample configurations
Security assessment
The change adds documentation about security-related configurations including IAM role references, VPC network settings, KMS encryption keys, and data filtering. While these elements have security implications, there is no evidence this addresses a specific vulnerability or security incident - it documents new integration capabilities.
Diff
diff --git a/glue/latest/dg/populate-with-cloudformation-templates.md b/glue/latest/dg/populate-with-cloudformation-templates.md index 28ff9542a..8ddbfa74f 100644 --- a//glue/latest/dg/populate-with-cloudformation-templates.md +++ b//glue/latest/dg/populate-with-cloudformation-templates.md @@ -5 +5 @@ -Sample databaseSample database, table, partitionsSample grok classifierSample JSON classifierSample XML classifierSample Amazon S3 crawlerSample connectionSample JDBC crawlerSample job for Amazon S3 to Amazon S3Sample job for JDBC to Amazon S3Sample On-Demand triggerSample scheduled triggerSample conditional triggerSample machine learning transformSample data quality rulesetSample data quality ruleset with EventBridge schedulerSample development endpoint +Sample databaseSample database, table, partitionsSample grok classifierSample JSON classifierSample XML classifierSample Amazon S3 crawlerSample connectionSample connectionSample connectionSample JDBC crawlerSample job for Amazon S3 to Amazon S3Sample job for JDBC to Amazon S3Sample On-Demand triggerSample scheduled triggerSample conditional triggerSample machine learning transformSample data quality rulesetSample data quality ruleset with EventBridge schedulerSample development endpoint @@ -46,0 +47,2 @@ Development endpoint | [AWS::Glue::DevEndpoint](https://docs.aws.amazon.com/AWSC +Integration | [AWS::Glue::Integration](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-integration.html) | Zero-ETL integration +Integration Resource Property | [AWS::Glue::IntegrationResourceProperty](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-integrationresourceproperty.html) | Zero-ETL integration with integration resource property @@ -498,0 +501,108 @@ This sample creates a connection to an Amazon RDS MySQL database named `devdb`. +## Sample CloudFormation template for an AWS Glue zero-ETL integration + +AWS zero-ETL is a set of fully managed integrations that minimize the need to build ETL data pipelines for common ingestion and replication use cases. + +This sample creates a zero-ETL integration from the given source to the target. + + + --- + AWSTemplateFormatVersion: '2010-09-09' + # Sample CFN YAML to demonstrate creating a zero-ETL integration in AWS Glue + # + # Parameters section contains names that are substituted in the Resources section + # + Parameters: + # The name of the zero-ETL integration to be created + IntegrationName: + Type: String + # The ARN for the source of the zero-ETL integration + SourceArn: + Type: String + # The ARN for the target of the zero-ETL integration + TargetArn: + Type: String + # + # + Resources: + # Create an AWS Glue zero-ETL integration + GlueIntegration: + Type: AWS::Glue::Integration + Properties: + IntegrationName: !Ref IntegrationName + Description: "AWS Glue zero-ETL integration" + SourceArn: !Ref SourceArn + TargetArn: !Ref TargetArn + DataFilter: "include:table1" + Tags: + - Key: Purpose + Value: GlueZeroETLIntegration + + +## Sample CloudFormation template for an AWS Glue zero-ETL integration with integration resource properties + +An AWS Glue zero-ETL integration requires resource properties to be defined for the source and the target. For the source, the only property that needs to be defined is the IAM role that the integration will use to access the AWS Glue connection or DynamoDB database. For the target, the properties that can be configured include the IAM role that will be used to access the target, the VPC network that the integration should be created in, the event bus that will be used to setup event notifications for the integration and the KMS key that will be used for data encryption. + +The below sample defines the source and target resource properties and then creates a zero-ETL integration from the source to the target. + + + --- + AWSTemplateFormatVersion: '2010-09-09' + # Sample CFN YAML to demonstrate defining the integration resource properties and then creating a zero-ETL integration in AWS Glue + # + # Parameters section contains names that are substituted in the Resources section + # + Parameters: + #The name of the zero-ETL integration to be created + IntegrationName: + Type: String + # The ARN for the target of the zero-ETL integration + TargetArn: + Type: String + # The ARN for the IAM role that will be used to access the target + TargetRoleArn: + Type: String + # The ARN for the source of the zero-ETL integration + SourceArn: + Type: String + # The ARN for the IAM role that will be used to access thesource + SourceRoleArn: + Type: String + # + # + Resources: + # Integration Resource Property for zero-ETL target + TargetIntegrationResourceProperty: + Type: AWS::Glue::IntegrationResourceProperty + Properties: + ResourceArn: !Ref TargetArn + TargetProcessingProperties: + RoleArn: !Ref TargetRoleArn + Tags: + - Key: Purpose + Value: TargetIrpTag + + # Integration Resource Property for zero-ETL source + SourceIntegrationResourceProperty: + Type: AWS::Glue::IntegrationResourceProperty + Properties: + ResourceArn: !Ref SourceArn + SourceProcessingProperties: + RoleArn: !Ref SourceRoleArn + Tags: + - Key: Purpose + Value: SourceIRPTag + + # Create an AWS Glue zero-ETL integration + GlueIntegration: + Type: AWS::Glue::Integration + Properties: + IntegrationName: !Ref IntegrationName + Description: "AWS Glue zero-ETL integration" + SourceArn: !Ref SourceArn + TargetArn: !Ref TargetArn + DataFilter: "include:table1" + Tags: + - Key: Purpose + Value: GlueZeroETLIntegration + +