AWS clean-rooms: List SQL-only analysis rule controls as a PySpark limitation
Summary
Added a limitation bullet noting that aggregation thresholds, comparison controls, disallowed output columns, differential privacy, and additional analyses apply only to SQL queries, are not enforced on PySpark jobs, and cause StartProtectedJob to reject jobs referencing tables that set them.
Security assessment
Documents that privacy/authorization controls are not applied to PySpark jobs and that such jobs are rejected by StartProtectedJob, which is security-relevant control-boundary information, though no specific vulnerability or CVE is cited.
Evidence
+ * Some custom analysis rule controls apply only to SQL queries: minimum aggregation thresholds, comparison controls, disallowed output columns, differential privacy, and additional analyses. AWS Clean Rooms doesn't enforce them on PySpark jobs. Instead, `StartProtectedJob` rejects a job if any configured table or intermediate table that it references sets one of these controls. For more information, see [Controls that apply only to SQL queries](./custom-considerations.html#custom-sql-only-controls).
Diff
diff --git a/clean-rooms/latest/userguide/pyspark-analysis-templates.md b/clean-rooms/latest/userguide/pyspark-analysis-templates.md index efa35da..4076044 100644 --- a//clean-rooms/latest/userguide/pyspark-analysis-templates.md +++ b//clean-rooms/latest/userguide/pyspark-analysis-templates.md @@ -49,0 +50,2 @@ Consider the following limitations before you use PySpark in AWS Clean Rooms. + * Some custom analysis rule controls apply only to SQL queries: minimum aggregation thresholds, comparison controls, disallowed output columns, differential privacy, and additional analyses. AWS Clean Rooms doesn't enforce them on PySpark jobs. Instead, `StartProtectedJob` rejects a job if any configured table or intermediate table that it references sets one of these controls. For more information, see [Controls that apply only to SQL queries](./custom-considerations.html#custom-sql-only-controls). +