AWS emr documentation change
Summary
Added '(PrestoSQL)' clarification to Trino in application list and updated component versions with '-amzn-' suffixes
Security assessment
Version updates with '-amzn-' suffixes indicate Amazon-specific builds but lack explicit security context. No CVE or vulnerability references are mentioned.
Diff
diff --git a/emr/latest/ReleaseGuide/emr-700-release.md b/emr/latest/ReleaseGuide/emr-700-release.md index 8ffc25be1..bf1dc0e9f 100644 --- a//emr/latest/ReleaseGuide/emr-700-release.md +++ b//emr/latest/ReleaseGuide/emr-700-release.md @@ -11 +11 @@ -This release includes the following applications: [AmazonCloudWatchAgent](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [Delta](https://delta.io/), [Flink](https://flink.apache.org/), [HBase](http://hbase.apache.org/), [HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [Hadoop](http://hadoop.apache.org/docs/current/), [Hive](http://hive.apache.org/), [Hudi](https://hudi.apache.org), [Hue](http://gethue.com/), [Iceberg](https://iceberg.apache.org/), [JupyterEnterpriseGateway](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [JupyterHub](https://jupyterhub.readthedocs.io/en/latest/#), [Livy](https://livy.incubator.apache.org/), [MXNet](https://mxnet.incubator.apache.org/), [Oozie](http://oozie.apache.org/), [Phoenix](https://phoenix.apache.org/), [Pig](http://pig.apache.org/), [Presto](https://prestodb.io/), [Spark](https://spark.apache.org/docs/latest/), [Sqoop](http://sqoop.apache.org/), [TensorFlow](https://www.tensorflow.org/), [Tez](https://tez.apache.org/), [Trino](https://trino.io/), [Zeppelin](https://zeppelin.incubator.apache.org/), and [ZooKeeper](https://zookeeper.apache.org). +This release includes the following applications: [AmazonCloudWatchAgent](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [Delta](https://delta.io/), [Flink](https://flink.apache.org/), [HBase](http://hbase.apache.org/), [HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [Hadoop](http://hadoop.apache.org/docs/current/), [Hive](http://hive.apache.org/), [Hudi](https://hudi.apache.org), [Hue](http://gethue.com/), [Iceberg](https://iceberg.apache.org/), [JupyterEnterpriseGateway](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [JupyterHub](https://jupyterhub.readthedocs.io/en/latest/#), [Livy](https://livy.incubator.apache.org/), [MXNet](https://mxnet.incubator.apache.org/), [Oozie](http://oozie.apache.org/), [Phoenix](https://phoenix.apache.org/), [Pig](http://pig.apache.org/), [Presto](https://prestodb.io/), [Spark](https://spark.apache.org/docs/latest/), [Sqoop](http://sqoop.apache.org/), [TensorFlow](https://www.tensorflow.org/), [Tez](https://tez.apache.org/), [Trino (PrestoSQL)](https://trino.io/), [Zeppelin](https://zeppelin.incubator.apache.org/), and [ZooKeeper](https://zookeeper.apache.org). @@ -33 +33 @@ Scala | 2.12.18| 2.12.17| 2.12.17| 2.12.17 -AmazonCloudWatchAgent| 1.300032.2| 1.300032.2| 1.300032.2| 1.300031.1 +AmazonCloudWatchAgent| 1.300032.2-amzn-0| 1.300032.2-amzn-0| 1.300032.2-amzn-0| 1.300031.1-amzn-0 @@ -35 +35 @@ Delta| 3.2.0-amzn-0| 3.1.0| 3.0.0| 3.0.0 -Flink| 1.18.1| 1.18.1| 1.18.1| 1.18.0 +Flink| 1.18.1-amzn-2| 1.18.1-amzn-1| 1.18.1-amzn-0| 1.18.0-amzn-0 @@ -37,4 +37,4 @@ Ganglia| \- | \- | \- | \- -HBase| 2.4.17| 2.4.17| 2.4.17| 2.4.17 -HCatalog| 3.1.3| 3.1.3| 3.1.3| 3.1.3 -Hadoop| 3.3.6| 3.3.6| 3.3.6| 3.3.6 -Hive| 3.1.3| 3.1.3| 3.1.3| 3.1.3 +HBase| 2.4.17-amzn-7| 2.4.17-amzn-6| 2.4.17-amzn-5| 2.4.17-amzn-4 +HCatalog| 3.1.3-amzn-12| 3.1.3-amzn-11| 3.1.3-amzn-10| 3.1.3-amzn-9 +Hadoop| 3.3.6-amzn-5| 3.3.6-amzn-4| 3.3.6-amzn-3| 3.3.6-amzn-2 +Hive| 3.1.3-amzn-12| 3.1.3-amzn-11| 3.1.3-amzn-10| 3.1.3-amzn-9 @@ -46 +46 @@ JupyterHub| 1.5.0| 1.5.0| 1.5.0| 1.5.0 -Livy| 0.8.0| 0.8.0| 0.8.0| 0.7.1 +Livy| 0.8.0-incubating| 0.8.0-incubating| 0.8.0-incubating| 0.7.1-incubating @@ -52,2 +52,2 @@ Pig| 0.17.0| 0.17.0| 0.17.0| 0.17.0 -Presto| 0.285| 0.285| 0.284| 0.283 -Spark| 3.5.1| 3.5.1| 3.5.0| 3.5.0 +Presto| 0.285-amzn-1| 0.285-amzn-0| 0.284-amzn-0| 0.283-amzn-1 +Spark| 3.5.1-amzn-1| 3.5.1-amzn-0| 3.5.0-amzn-1| 3.5.0-amzn-0 @@ -56,2 +56,2 @@ TensorFlow| 2.16.1| 2.11.0| 2.11.0| 2.11.0 -Tez| 0.10.2| 0.10.2| 0.10.2| 0.10.2 -Trino (PrestoSQL)| 442| 436| 435| 426 +Tez| 0.10.2-amzn-10| 0.10.2-amzn-9| 0.10.2-amzn-8| 0.10.2-amzn-7 +Trino (PrestoSQL)| 442-amzn-0| 436-amzn-0| 435-amzn-0| 426-amzn-1 @@ -59 +59 @@ Zeppelin| 0.11.1| 0.10.1| 0.10.1| 0.10.1 -ZooKeeper| 3.9.1| 3.9.1| 3.9.1| 3.5.10 +ZooKeeper| 3.9.1-amzn-1| 3.9.1-amzn-1| 3.9.1-amzn-0| 3.5.10 @@ -99,2 +99,2 @@ OsReleaseLabel (Amazon Linux version) | Amazon Linux kernel version | Available -2023.7.20250609.0 | 6.1.140-154.222.amzn2023 | July 14, 2025 | Europe (Stockholm), Middle East (Bahrain), China (Beijing), Asia Pacific (Mumbai), Europe (Paris), Asia Pacific (Jakarta), US East (Ohio), Africa (Cape Town), Europe (Ireland), Middle East (UAE), Europe (Frankfurt), South America (São Paulo), Asia Pacific (Hong Kong), Asia Pacific (Hyderabad), US East (N. Virginia), Asia Pacific (Seoul), Asia Pacific (Osaka), Asia Pacific (Malaysia), Europe (London), , Asia Pacific (Melbourne), Europe (Milan), Asia Pacific (Tokyo), AWS GovCloud (US-East), AWS GovCloud (US-West), US West (Oregon), US West (N. California), Asia Pacific (Singapore), Asia Pacific (Sydney), Israel (Tel Aviv), Canada (Central), Canada West (Calgary), Europe (Spain), China (Ningxia), Europe (Zurich) -2023.7.20250527.1 | 6.1.134-152.225.amzn2023 | Jun 19, 2025 | Europe (Stockholm), Middle East (Bahrain), China (Beijing), Asia Pacific (Mumbai), Europe (Paris), Asia Pacific (Jakarta), US East (Ohio), Africa (Cape Town), Europe (Ireland), Middle East (UAE), Europe (Frankfurt), South America (São Paulo), Asia Pacific (Hong Kong), Asia Pacific (Hyderabad), US East (N. Virginia), Asia Pacific (Seoul), Asia Pacific (Osaka), Asia Pacific (Malaysia), Europe (London), , Asia Pacific (Melbourne), Europe (Milan), Asia Pacific (Tokyo), AWS GovCloud (US-East), AWS GovCloud (US-West), US West (Oregon), US West (N. California), Asia Pacific (Singapore), Asia Pacific (Sydney), Israel (Tel Aviv), Canada (Central), Canada West (Calgary), Europe (Spain), China (Ningxia), Europe (Zurich) +2023.7.20250609.0 | 6.1.140-154.222.amzn2023 | July 14, 2025 | Europe (Stockholm), Middle East (Bahrain), China (Beijing), Asia Pacific (Mumbai), Europe (Paris), Asia Pacific (Jakarta), US East (Ohio), Africa (Cape Town), Europe (Ireland), Middle East (UAE), Europe (Frankfurt), South America (São Paulo), Asia Pacific (Hong Kong), Asia Pacific (Hyderabad), US East (N. Virginia), Asia Pacific (Seoul), Asia Pacific (Osaka), Asia Pacific (Malaysia), Europe (London), Asia Pacific (Melbourne), Europe (Milan), Asia Pacific (Tokyo), AWS GovCloud (US-East), AWS GovCloud (US-West), US West (Oregon), US West (N. California), Asia Pacific (Singapore), Asia Pacific (Sydney), Israel (Tel Aviv), Canada (Central), Canada West (Calgary), Europe (Spain), China (Ningxia), Europe (Zurich) +2023.7.20250527.1 | 6.1.134-152.225.amzn2023 | Jun 19, 2025 | Europe (Stockholm), Middle East (Bahrain), China (Beijing), Asia Pacific (Mumbai), Europe (Paris), Asia Pacific (Jakarta), US East (Ohio), Africa (Cape Town), Europe (Ireland), Middle East (UAE), Europe (Frankfurt), South America (São Paulo), Asia Pacific (Hong Kong), Asia Pacific (Hyderabad), US East (N. Virginia), Asia Pacific (Seoul), Asia Pacific (Osaka), Asia Pacific (Malaysia), Europe (London), Asia Pacific (Melbourne), Europe (Milan), Asia Pacific (Tokyo), AWS GovCloud (US-East), AWS GovCloud (US-West), US West (Oregon), US West (N. California), Asia Pacific (Singapore), Asia Pacific (Sydney), Israel (Tel Aviv), Canada (Central), Canada West (Calgary), Europe (Spain), China (Ningxia), Europe (Zurich) @@ -103 +103 @@ OsReleaseLabel (Amazon Linux version) | Amazon Linux kernel version | Available -2023.7.20250414.0 | 6.1.132-147.221.amzn2023 | May 12, 2025 | US East (N. Virginia), US East (Ohio), US West (N. California), US West (Oregon), Europe (Stockholm), Europe (Milan), Europe (Frankfurt), Europe (Ireland), Europe (London), Europe (Paris), Asia Pacific (Hong Kong), Asia Pacific (Mumbai), Asia Pacific (Tokyo), Asia Pacific (Seoul), Asia Pacific (Osaka), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Jakarta), Africa (Cape Town), South America (São Paulo), Middle East (Bahrain), Canada (Central), AWS GovCloud (US-West), AWS GovCloud (US-East), China (Beijing), China (Ningxia), Asia Pacific (Hyderabad), Middle East (UAE), Europe (Spain), Europe (Zurich), Asia Pacific (Melbourne), Israel (Tel Aviv), Canada West (Calgary), Asia Pacific (Malaysia), +2023.7.20250414.0 | 6.1.132-147.221.amzn2023 | May 12, 2025 | US East (N. Virginia), US East (Ohio), US West (N. California), US West (Oregon), Europe (Stockholm), Europe (Milan), Europe (Frankfurt), Europe (Ireland), Europe (London), Europe (Paris), Asia Pacific (Hong Kong), Asia Pacific (Mumbai), Asia Pacific (Tokyo), Asia Pacific (Seoul), Asia Pacific (Osaka), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Jakarta), Africa (Cape Town), South America (São Paulo), Middle East (Bahrain), Canada (Central), AWS GovCloud (US-West), AWS GovCloud (US-East), China (Beijing), China (Ningxia), Asia Pacific (Hyderabad), Middle East (UAE), Europe (Spain), Europe (Zurich), Asia Pacific (Melbourne), Israel (Tel Aviv), Canada West (Calgary), Asia Pacific (Malaysia) @@ -247,137 +247,139 @@ Configuration classifications allow you to customize applications. These often c -emr-7.0.0 classifications Classifications | Description ----|--- -capacity-scheduler| Change values in Hadoop's capacity-scheduler.xml file. -container-executor| Change values in Hadoop YARN's container-executor.cfg file. -container-log4j| Change values in Hadoop YARN's container-log4j.properties file. -core-site| Change values in Hadoop's core-site.xml file. -docker-conf| Change docker related settings. -emrfs-site| Change EMRFS settings. -flink-conf| Change flink-conf.yaml settings. -flink-log4j| Change Flink log4j.properties settings. -flink-log4j-session| Change Flink log4j-session.properties settings for Kubernetes/Yarn session. -flink-log4j-cli| Change Flink log4j-cli.properties settings. -hadoop-env| Change values in the Hadoop environment for all Hadoop components. -hadoop-log4j| Change values in Hadoop's log4j.properties file. -hadoop-ssl-server| Change hadoop ssl server configuration -hadoop-ssl-client| Change hadoop ssl client configuration -hbase| Amazon EMR-curated settings for Apache HBase. -hbase-env| Change values in HBase's environment. -hbase-log4j| Change values in HBase's hbase-log4j.properties file. -hbase-metrics| Change values in HBase's hadoop-metrics2-hbase.properties file. -hbase-policy| Change values in HBase's hbase-policy.xml file. -hbase-site| Change values in HBase's hbase-site.xml file. -hdfs-encryption-zones| Configure HDFS encryption zones. -hdfs-env| Change values in the HDFS environment. -hdfs-site| Change values in HDFS's hdfs-site.xml. -hcatalog-env| Change values in HCatalog's environment. -hcatalog-server-jndi| Change values in HCatalog's jndi.properties. -hcatalog-server-proto-hive-site| Change values in HCatalog's proto-hive-site.xml. -hcatalog-webhcat-env| Change values in HCatalog WebHCat's environment. -hcatalog-webhcat-log4j2| Change values in HCatalog WebHCat's log4j2.properties. -hcatalog-webhcat-site| Change values in HCatalog WebHCat's webhcat-site.xml file. -hive| Amazon EMR-curated settings for Apache Hive. -hive-beeline-log4j2| Change values in Hive's beeline-log4j2.properties file. -hive-parquet-logging| Change values in Hive's parquet-logging.properties file. -hive-env| Change values in the Hive environment. -hive-exec-log4j2| Change values in Hive's hive-exec-log4j2.properties file. -hive-llap-daemon-log4j2| Change values in Hive's llap-daemon-log4j2.properties file. -hive-log4j2| Change values in Hive's hive-log4j2.properties file. -hive-site| Change values in Hive's hive-site.xml file -hiveserver2-site| Change values in Hive Server2's hiveserver2-site.xml file -hue-ini| Change values in Hue's ini file -httpfs-env| Change values in the HTTPFS environment. -httpfs-site| Change values in Hadoop's httpfs-site.xml file. -hadoop-kms-acls| Change values in Hadoop's kms-acls.xml file. -hadoop-kms-env| Change values in the Hadoop KMS environment. -hadoop-kms-java-home| Change Hadoop's KMS java home -hadoop-kms-log4j| Change values in Hadoop's kms-log4j.properties file. -hadoop-kms-site| Change values in Hadoop's kms-site.xml file. -hudi-env| Change values in the Hudi environment. -hudi-defaults| Change values in Hudi's hudi-defaults.conf file. -iceberg-defaults| Change values in Iceberg's iceberg-defaults.conf file. -delta-defaults| Change values in Delta's delta-defaults.conf file. -jupyter-notebook-conf| Change values in Jupyter Notebook's jupyter_notebook_config.py file. -jupyter-hub-conf| Change values in JupyterHubs's jupyterhub_config.py file. -jupyter-s3-conf| Configure Jupyter Notebook S3 persistence. -jupyter-sparkmagic-conf| Change values in Sparkmagic's config.json file. -livy-conf| Change values in Livy's livy.conf file. -livy-env| Change values in the Livy environment. -livy-log4j2| Change Livy log4j2.properties settings. -mapred-env| Change values in the MapReduce application's environment. -mapred-site| Change values in the MapReduce application's mapred-site.xml file. -oozie-env| Change values in Oozie's environment. -oozie-log4j| Change values in Oozie's oozie-log4j.properties file. -oozie-site| Change values in Oozie's oozie-site.xml file. -phoenix-hbase-metrics| Change values in Phoenix's hadoop-metrics2-hbase.properties file. -phoenix-hbase-site| Change values in Phoenix's hbase-site.xml file. -phoenix-log4j| Change values in Phoenix's log4j.properties file. -phoenix-metrics| Change values in Phoenix's hadoop-metrics2-phoenix.properties file. -pig-env| Change values in the Pig environment. -pig-properties| Change values in Pig's pig.properties file. -pig-log4j| Change values in Pig's log4j.properties file. -presto-log| Change values in Presto's log.properties file. -presto-config| Change values in Presto's config.properties file. -presto-password-authenticator| Change values in Presto's password-authenticator.properties file. -presto-env| Change values in Presto's presto-env.sh file. -presto-node| Change values in Presto's node.properties file. -presto-connector-blackhole| Change values in Presto's blackhole.properties file. -presto-connector-cassandra| Change values in Presto's cassandra.properties file. -presto-connector-hive| Change values in Presto's hive.properties file. -presto-connector-jmx| Change values in Presto's jmx.properties file. -presto-connector-kafka| Change values in Presto's kafka.properties file. -presto-connector-lakeformation| Change values in Presto's lakeformation.properties file. -presto-connector-localfile| Change values in Presto's localfile.properties file. -presto-connector-memory| Change values in Presto's memory.properties file. -presto-connector-mongodb| Change values in Presto's mongodb.properties file. -presto-connector-mysql| Change values in Presto's mysql.properties file. -presto-connector-postgresql| Change values in Presto's postgresql.properties file. -presto-connector-raptor| Change values in Presto's raptor.properties file. -presto-connector-redis| Change values in Presto's redis.properties file. -presto-connector-redshift| Change values in Presto's redshift.properties file. -presto-connector-tpch| Change values in Presto's tpch.properties file. -presto-connector-tpcds| Change values in Presto's tpcds.properties file. -trino-log| Change values in Trino's log.properties file. -trino-config| Change values in Trino's config.properties file. -trino-password-authenticator| Change values in Trino's password-authenticator.properties file. -trino-env| Change values in Trino's trino-env.sh file. -trino-node| Change values in Trino's node.properties file. -trino-connector-blackhole| Change values in Trino's blackhole.properties file. -trino-connector-cassandra| Change values in Trino's cassandra.properties file. -trino-connector-delta| Change values in Trino's delta.properties file. -trino-connector-hive| Change values in Trino's hive.properties file. -trino-exchange-manager| Change values in Trino's exchange-manager.properties file. -trino-connector-iceberg| Change values in Trino's iceberg.properties file. -trino-connector-hudi| Change values in Trino's hudi.properties file. -trino-connector-jmx| Change values in Trino's jmx.properties file. -trino-connector-kafka| Change values in Trino's kafka.properties file. -trino-connector-localfile| Change values in Trino's localfile.properties file. -trino-connector-memory| Change values in Trino's memory.properties file. -trino-connector-mongodb| Change values in Trino's mongodb.properties file. -trino-connector-mysql| Change values in Trino's mysql.properties file. -trino-connector-postgresql| Change values in Trino's postgresql.properties file. -trino-connector-raptor| Change values in Trino's raptor.properties file. -trino-connector-redis| Change values in Trino's redis.properties file. -trino-connector-redshift| Change values in Trino's redshift.properties file. -trino-connector-tpch| Change values in Trino's tpch.properties file. -trino-connector-tpcds| Change values in Trino's tpcds.properties file. -ranger-kms-dbks-site| Change values in dbks-site.xml file of Ranger KMS. -ranger-kms-site| Change values in ranger-kms-site.xml file of Ranger KMS. -ranger-kms-env| Change values in the Ranger KMS environment. -ranger-kms-logback| Change values in kms-logback.xml file of Ranger KMS. -ranger-kms-db-ca| Change values for CA file on S3 for MySQL SSL connection with Ranger KMS. -spark| Amazon EMR-curated settings for Apache Spark. -spark-defaults| Change values in Spark's spark-defaults.conf file. -spark-env| Change values in the Spark environment. -spark-hive-site| Change values in Spark's hive-site.xml file -spark-log4j2| Change values in Spark's log4j2.properties file. -spark-metrics| Change values in Spark's metrics.properties file. -sqoop-env| Change values in Sqoop's environment. -sqoop-oraoop-site| Change values in Sqoop OraOop's oraoop-site.xml file. -sqoop-site| Change values in Sqoop's sqoop-site.xml file. -tez-site| Change values in Tez's tez-site.xml file. -yarn-env| Change values in the YARN environment. -yarn-site| Change values in YARN's yarn-site.xml file. -zeppelin-env| Change values in the Zeppelin environment. -zeppelin-site| Change configuration settings in zeppelin-site.xml. -zookeeper-config| Change values in ZooKeeper's zoo.cfg file. -zookeeper-log4j| Change values in ZooKeeper's log4j.properties file. +Reconfiguration actions occur when you specify a configuration for instance groups in a running cluster. Amazon EMR only initiates reconfiguration actions for the classifications that you modify. For more information, see [Reconfigure an instance group in a running cluster](./emr-configure-apps-running-cluster.html). + +emr-7.0.0 classifications Classifications | Description | Reconfiguration Actions +---|---|--- +capacity-scheduler| Change values in Hadoop's capacity-scheduler.xml file.| Restarts the ResourceManager service. +container-executor| Change values in Hadoop YARN's container-executor.cfg file.| Not available. +container-log4j| Change values in Hadoop YARN's container-log4j.properties file.| Not available. +core-site| Change values in Hadoop's core-site.xml file.| Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. +docker-conf| Change docker related settings.| Not available. +emrfs-site| Change EMRFS settings.| Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. +flink-conf| Change flink-conf.yaml settings.| Restarts Flink history server. +flink-log4j| Change Flink log4j.properties settings.| Restarts Flink history server. +flink-log4j-session| Change Flink log4j-session.properties settings for Kubernetes/Yarn session.| Restarts Flink history server. +flink-log4j-cli| Change Flink log4j-cli.properties settings.| Restarts Flink history server. +hadoop-env| Change values in the Hadoop environment for all Hadoop components.| Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. +hadoop-log4j| Change values in Hadoop's log4j.properties file.| Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer.