AWS amazonq documentation change
Summary
Added documentation for hallucination mitigation feature, updated service role requirements for pre-April 2024 applications, modified default settings, and included CLI parameters for orchestration/hallucination controls
Security assessment
Introduces hallucination mitigation as a security feature to improve response accuracy, but no explicit mention of addressing a specific vulnerability. IAM role updates appear to be configuration prerequisites rather than security fixes.
Diff
diff --git a/amazonq/latest/qbusiness-ug/guardrails-global-controls.md b/amazonq/latest/qbusiness-ug/guardrails-global-controls.md index 28e58c3de..b7e1c6dc3 100644 --- a//amazonq/latest/qbusiness-ug/guardrails-global-controls.md +++ b//amazonq/latest/qbusiness-ug/guardrails-global-controls.md @@ -34 +34 @@ The following are the global features that you can customize: -###### Note +###### Important @@ -36 +36 @@ The following are the global features that you can customize: -As of Oct 31, 2024, once you have created a new Amazon Q Business application environment, this setting will be _enabled by default_ , even if the Admin has not yet connected any enterprise data sources. +If you're changing response settings for an Amazon Q Business application environment created and deployed before 16 April, 2024, you need to update your web experience service role. For information on service role permissions needed, see [IAM role for an Amazon Q Business web experience](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/iam-roles.html#deploy-experience-iam-role). For information on how to update your web experience service role, see [Updating a web experience](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/supported-exp-actions.html#update-web-experience). @@ -38 +38,3 @@ As of Oct 31, 2024, once you have created a new Amazon Q Business application en -For existing application environments, this setting will _remain as previously configured_. +###### Note + +Displaying sample prompts to your end user using the Amazon Q Business [Quick prompts](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/quick-prompts.html) feature might not work if you choose to restrict response generation to enterprise data. @@ -45,0 +48,6 @@ If you choose to activate this feature for your end users, they will see the opt +###### Note + +As of Oct 31, 2024, once you have created a new Amazon Q Business application environment, this setting will be _enabled by default_ , even if the Admin has not yet connected any enterprise data sources. + +For existing application environments, this setting will _remain as previously configured_. + @@ -51,0 +60 @@ You must have already added this information in IAM Identity Center for response + * **Enable hallucination mitigation** – Allow Amazon Q Business to check the chat responses it generates for [hallucinations](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/concepts-terms.html#hallucination). If a hallucination is detected with high confidence, Amazon Q Business corrects the inconsistencies in its response real-time during chat and generates a new, edited message. @@ -52,0 +62 @@ You must have already added this information in IAM Identity Center for response +The hallucination mitigation feature is only available for retrieval augmented generation (RAG) responses from data connected to the application—either through connected data sources, or files uploaded during chat (up to 100,000 characters). @@ -53,0 +64 @@ You must have already added this information in IAM Identity Center for response +Hallucination mitigation isn't supported for the following use cases: @@ -55 +66 @@ You must have already added this information in IAM Identity Center for response -###### Important + * Applications where [chat orchestration](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/guardrails-global-controls.html#guardrails-global-orchestration) is enabled. @@ -57 +68,3 @@ You must have already added this information in IAM Identity Center for response -If you're changing response settings for an Amazon Q Business application environment created and deployed before 16 April, 2024, you need to update your web experience service role. For information on service role permissions needed, see [IAM role for an Amazon Q Business web experience](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/iam-roles.html#deploy-experience-iam-role). For information on how to update your web experience service role, see [Updating a web experience](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/supported-exp-actions.html#update-web-experience). + * [Plugin](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/plugins.html) workflows. + + * Responses generated from tabular data, or from transcripts of images, audio and video. Hallucination mitigation applies only to responses generated from textual data. @@ -59 +71,0 @@ If you're changing response settings for an Amazon Q Business application enviro -###### Note @@ -61 +73,5 @@ If you're changing response settings for an Amazon Q Business application enviro -Displaying sample prompts to your end user using the Amazon Q Business [Quick prompts](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/quick-prompts.html) feature might not work if you choose to restrict response generation to enterprise data. + + +###### Important + +Activating hallucination mitigation will increase chat response latency. @@ -71 +87 @@ You can use **Chat orchestration settings** to automatically manage chat request -Chat orchestration is optimized to work for English language content. For more details on language support in Amazon Q Business, see [Supported languages](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/supported-languages.html). +Chat orchestration is optimized to work for English language content. For more details on language support in Amazon Q Business, see [Supported languages](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/supported-languages.html). Additionally, the [hallucination mitigation](amazonq/latest/qbusiness-ug/hallucination-reduction.html) feature won't work if chat orchestration controls are enabled for your application. @@ -115 +131 @@ When you create an Amazon Q Business application environment, it's assigned the - * Generate responses from enterprise data only. + * An option to generate responses from either enterprise data or LLMs. @@ -117 +133,3 @@ When you create an Amazon Q Business application environment, it's assigned the - * No blocked words allowed. + * Response personalization is activated. + + * Automatic orchestration of end user chat requests across any Amazon Q Business plugins and data sources you’ve configured. @@ -121 +139,3 @@ When you create an Amazon Q Business application environment, it's assigned the - * Response personalization is activated. + * Q Apps creation is activated. + + * Hallucination mitigation is deactivated. To turn hallucination mitigation on, you must first deactivate chat orchestration. @@ -165 +185 @@ You must have already added this information in IAM Identity Center for response - * For **Blocked words** – Define blocked words for the application environment. The application environment will not respond to questions that contain these words or mention them in any responses. + * **Enable hallucination mitigation** – Allow Amazon Q Business to check the chat responses it generates for [hallucinations](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/concepts-terms.html#hallucination). If a hallucination is detected with high confidence, Amazon Q Business corrects the inconsistencies in its response real-time during chat and generates a new, edited message. @@ -167 +187,7 @@ You must have already added this information in IAM Identity Center for response - * For **Messaging shown for blocked words** – Choose to create a custom response for your end users informing them of blocked word usage and any next steps to take. +###### Note + +You must deactivate **Chat orchestration settings** before you can activate hallucination mitigation. + + 6. For **Chat orchestration settings** , activate to automatically manage chat requests across configured plugins and data sources in your Amazon Q Business application. If you activate chat orchestration, Amazon Q Business automatically routes chat requests to [plugins](https://docs.aws.amazon.com/amazonq/latest/qbusiness-ug/plugins.html), integrating enterprise data and relevant actions within a single chat response. Users get direct responses without manual plugin selection. + +###### Note @@ -169 +195,7 @@ You must have already added this information in IAM Identity Center for response - 6. For **Feature settings** , choose whether your end users will be allowed to upload files directly in chat to ask questions based on file content and whether Amazon Q Apps will be enabled for your application environment. +You must deactivate **Enable hallucination mitigation** before you can activate chat orchestration. + + 7. For **Feature settings** , choose whether your end users will be allowed to upload files directly in chat to ask questions based on file content and whether Amazon Q Apps will be enabled for your application environment. + + 8. * For **Blocked words** – Define blocked words for the application environment. The application environment will not respond to questions that contain these words or mention them in any responses. + + * For **Messaging shown for blocked words** – Choose to create a custom response for your end users informing them of blocked word usage and any next steps to take. @@ -171 +203 @@ You must have already added this information in IAM Identity Center for response - 7. Choose **Save**. + 9. Choose **Save**. @@ -187 +219,3 @@ AWS CLI - --creator-mode-configuration creatorModeControl=ENABLED | DISABLED + --creator-mode-configuration creatorModeControl=ENABLED | DISABLED \ + --orchestration-configuration orchestrationControl=ENABLED | DISABLED \ + --hallucination-reduction-configuration '{"hallucinationReductionControl": "ENABLED" | "DISABLED"}'