AWS quick documentation change
Summary
Complete restructuring and expansion of browser automation documentation with detailed action properties, self-healing capabilities, AI-powered element identification methods, and operational limitations
Security assessment
Added documentation for secure credential handling ('Enter Credential' action uses saved credentials from automation group) and self-healing features that mitigate automation failures. However, no explicit references to patching vulnerabilities or addressing security incidents were found.
Diff
diff --git a/quick/latest/userguide/actions-web-browser.md b/quick/latest/userguide/actions-web-browser.md index 16ede5f1b..c4b89c52b 100644 --- a//quick/latest/userguide/actions-web-browser.md +++ b//quick/latest/userguide/actions-web-browser.md @@ -4,0 +5,2 @@ +OverviewBrowser Session ManagementStart Browser SessionGo to WebpageClickEnter TextEnter CredentialSelect from DropdownExtract TextExtract TableTake ScreenshotVisual Q&AClick and Upload FilesEnter KeystrokeWait for ElementFind Matching ElementsWait for New WindowSwitch WindowClose WindowSave to ClipboardPaste from ClipboardRefresh WebpageRestart BrowserLimitations + @@ -7 +9,483 @@ - * **Start browser session** \- Opens a new browser session. Actions placed inside will interact with this browser. The browser closes automatically when finished. +## Overview + +Browser actions provide a comprehensive automation toolkit for performing web interactions. Browser sessions are automatically managed — opened, maintained, and closed as needed. Quick Automate supports flexible element identification through AI-powered natural language descriptions and precise XPath selectors. Key capabilities include intelligent element targeting with fallback mechanisms, self-healing features that automatically handle popups and retry failed actions, data extraction including structured table content, and a full suite of interaction methods from basic clicks and typing to advanced AI-driven multi-step tasks. + +**Element identification methods** + + * **Description method:** Uses AI to identify elements using natural language descriptions (e.g., "Log In button"), making automations more resilient to UI changes. + + * **XPath selector method:** Uses precise XPath expressions for exact element targeting (e.g., `//button[text()='Log in']`). + + * **Combined approach:** When both methods are enabled, XPath is tried first before falling back to the description method, combining precision with adaptability. + + + + +**Self-Healing features available for type-ins and clicks** + + * **HandlePopups:** Automatically detects and handles unexpected dialogs, cookie notices, and overlays, preventing blocking elements from interrupting workflows. + + * **ValidateAndRetry:** Verifies action success through screenshot comparison and retries if needed, reducing false failures. + + + + +## Browser Session Management + +Browser instances are automatically created, maintained throughout workflows, and properly cleaned up when complete. The `restart_browser` action allows fresh sessions when needed for scenarios such as login timeouts or session expiration. + +## Start Browser Session + +Opens a new browser session. Actions inside is scope interact with this browser. The browser closes automatically when finished. + +**Properties:** + + * **Action Title** (text-only): The title of the action displayed in the process visualization (default: Browser) + + + + +###### Note + + 1. All browser actions must be placed within a browser session scope + + 2. Each browser scope is a browser session. Browser automatically closes when actions inside a scope completes. + + + + +## Go to Webpage + +Navigates to a specific URL. Used to go to a new webpage in the current browser tab. + +**Properties:** + + * **URL** (required): The web address to navigate to (e.g., "example.com") Note: Please provide the complete URL when working with this. + + + + +## Click + +Clicks on a webpage element. Used to interact with buttons, links, or other clickable elements. + +**Properties:** + + * **Find Element with Description** (radio button): Use natural language description to identify the element with AI (default: ON) + + * **Description Field** (conditionally required): Natural language description of the browser element to click (e.g., "Submit button"). Don't use the action in the element, just the description of the element + + * **Find Element with Selector** (radio button): Use XPath expression to identify the element (default: OFF) + + * **XPath Field** (conditionally required): XPath expression (e.g., "//input[@id='xyz']") + + * **Self-healing** (checkbox): Use AI to handle unexpected popups automatically (default: OFF, optional) + + * **Mouse Button** (dropdown): Which mouse button to click - Left, Middle, or Right (default: Left, optional) + + * **Click Type** (dropdown): Single or Double click (default: Single, optional) + + * **Get File Download** (radio button): Enable if click downloads a file (default: OFF, optional) + + * **Downloaded File** (output, conditionally required): Variable name storing the downloaded file (default: downloaded_file) + + + + +**Element Identification:** + + * At least one element identification method must be enabled + + * When both methods are enabled, XPath selector is tried first before falling back to description + + + + +## Enter Text + +Types text into an input field. Used to fill in forms, search boxes, or other text inputs on webpages. + +**Properties:** + + * **Text to Enter** (required): The text you want to type into the field (e.g., "Order #12345") + + * **Find Element with Description** (radio button): Use natural language description to identify the element with AI (default: ON) + + * **Description Field** (conditionally required): Natural language description (e.g., "Order number field") + + * **Find Element with Selector** (radio button): Use XPath expression to identify the element (default: OFF) + + * **XPath Field** (conditionally required): XPath expression (e.g., "//input[@id='xyz']") + + * **Self-healing** (checkbox): Use AI to handle unexpected popups automatically (default: OFF, optional) + + * **Replace Existing Text** (checkbox): Clear any pre-existing text in the field before typing (default: ON) + + + + +**Element Identification:** + + * At least one element identification method must be enabled. Recommended to use element description and move to element selector only if required. + + + + +## Enter Credential + +Types a username or password. Used to securely sign in to a website using saved credentials. + +**Properties:** + + * **Credential** (dropdown, required): Choose which saved credential to use from automation group + + * **Value to Enter** (dropdown, required): Choose whether to enter Username or Password (default: Username) + + * **Find Element with Description** (radio button): Use natural language description to identify the element with AI (default: ON) + + * **Description Field** (conditionally required): Natural language description (e.g., "Username field") + + * **Find Element with Selector** (radio button): Use XPath expression to identify the element (default: OFF) + + * **XPath Field** (conditionally required): XPath expression (e.g., "//input[@id='username']") + + * **Self-healing** (checkbox): Use AI to handle unexpected popups automatically (default: OFF, optional) + + + + +**Element Identification:** + + * At least one element identification method must be enabled + + + + +## Select from Dropdown + +Chooses a value from a dropdown. Used to make selections in forms, filters, or other dropdown menus on webpages. + +**Properties:** + + * **Value to Select** (required): The option you want to select from the dropdown field (e.g., "Complete") + + * **Find Element with Description** (radio button): Use natural language description to identify the element with AI (default: ON) + + * **Description Field** (conditionally required): Natural language description (e.g., "Order status dropdown") + + * **Find Element with Selector** (radio button): Use XPath expression to identify the element (default: OFF) + + * **XPath Field** (conditionally required): XPath expression (e.g., "//select[@id='xyz']") + + * **Self-healing** (checkbox): Use AI to handle unexpected popups automatically (default: OFF, optional) + + + + +**Element Identification:** + + * At least one element identification method must be enabled + + + + +## Extract Text + +Reads a value from a webpage. Used to capture the text from an individual field. + +**Properties:** + + * **Find Element with Description** (radio button): Use natural language description to identify the element with AI (default: ON) +