AWS cli documentation change
Summary
Added documentation for GENERATED_TEST_CASES output structure in automated reasoning policy workflow, including test case validation details and expected results definitions
Security assessment
The changes add documentation about test case generation and validation capabilities for automated reasoning policies, but there is no evidence of addressing security vulnerabilities or describing security-specific features. The additions focus on workflow output structure and test case expectations.
Diff
diff --git a/cli/latest/reference/bedrock/get-automated-reasoning-policy-build-workflow-result-assets.md b/cli/latest/reference/bedrock/get-automated-reasoning-policy-build-workflow-result-assets.md index f652334af..d5f008407 100644 --- a//cli/latest/reference/bedrock/get-automated-reasoning-policy-build-workflow-result-assets.md +++ b//cli/latest/reference/bedrock/get-automated-reasoning-policy-build-workflow-result-assets.md @@ -15 +15 @@ - * [AWS CLI 2.31.37 Command Reference](../../index.html) » + * [AWS CLI 2.31.39 Command Reference](../../index.html) » @@ -126,0 +127 @@ See also: [AWS API Documentation](https://docs.aws.amazon.com/goto/WebAPI/bedroc +> * `GENERATED_TEST_CASES` @@ -259 +260 @@ buildWorkflowAssets -> (tagged union structure) -> This is a Tagged Union structure. Only one of the following top level keys can be set: `policyDefinition`, `qualityReport`, `buildLog`. +> This is a Tagged Union structure. Only one of the following top level keys can be set: `policyDefinition`, `qualityReport`, `buildLog`, `generatedTestCases`. @@ -1718,0 +1720,57 @@ buildWorkflowAssets -> (tagged union structure) +> +> generatedTestCases -> (structure) +> +>> A comprehensive test suite generated by the build workflow, providing validation capabilities for automated reasoning policies. +>> +>> generatedTestCases -> (list) [required] +>> +>>> Represents a collection of generated test cases. +>>> +>>> (structure) +>>> +>>>> Represents a generated test case, consisting of query content, guard content, and expected results. +>>>> +>>>> queryContent -> (string) [required] +>>>> +>>>>> The input query or prompt that generated the content. This provides context for the validation. +>>>>> +>>>>> Constraints: +>>>>> +>>>>> * min: `0` +>>>>> * max: `1024` +>>>>> + +>>>> +>>>> guardContent -> (string) [required] +>>>> +>>>>> The output content that’s validated by the Automated Reasoning policy. This represents the foundation model response that will be checked for accuracy. +>>>>> +>>>>> Constraints: +>>>>> +>>>>> * min: `0` +>>>>> * max: `1024` +>>>>> + +>>>> +>>>> expectedAggregatedFindingsResult -> (string) [required] +>>>> +>>>>> The expected results of the generated test case. Possible values include: +>>>>> +>>>>> * `VALID` \- The claims are true. The claims are implied by the premises and the Automated Reasoning policy. Given the Automated Reasoning policy and premises, it is not possible for these claims to be false. In other words, there are no alternative answers that are true that contradict the claims. +>>>>> * `INVALID` \- The claims are false. The claims are not implied by the premises and Automated Reasoning policy. Furthermore, there exists different claims that are consistent with the premises and Automated Reasoning policy. +>>>>> * `SATISFIABLE` \- The claims can be true or false. It depends on what assumptions are made for the claim to be implied from the premises and Automated Reasoning policy rules. In this situation, different assumptions can make input claims false and alternative claims true. +>>>>> * `IMPOSSIBLE` \- Automated Reasoning can’t make a statement about the claims. This can happen if the premises are logically incorrect, or if there is a conflict within the Automated Reasoning policy itself. +>>>>> + +>>>>> +>>>>> Possible values: +>>>>> +>>>>> * `VALID` +>>>>> * `INVALID` +>>>>> * `SATISFIABLE` +>>>>> * `IMPOSSIBLE` +>>>>> * `TRANSLATION_AMBIGUOUS` +>>>>> * `TOO_COMPLEX` +>>>>> * `NO_TRANSLATION` +>>>>> + @@ -1730 +1788 @@ buildWorkflowAssets -> (tagged union structure) - * [AWS CLI 2.31.37 Command Reference](../../index.html) » + * [AWS CLI 2.31.39 Command Reference](../../index.html) »