> ## Documentation Index > Fetch the complete documentation index at: https://docs.optexity.com/llms.txt > Use this file to discover all available pages before exploring further. # Update Example ## OpenAPI ````yaml https://api.optexity.com/openapi.json post /api/v1/update_example openapi: 3.1.0 info: title: Dashboard Backend API version: 0.1.0 servers: [] security: [] paths: /api/v1/update_example: post: tags: - add_example summary: Update Example operationId: update_example_api_v1_update_example_post parameters: - name: x-api-key in: header required: true schema: type: string title: X-Api-Key requestBody: required: true content: application/json: schema: $ref: >- #/components/schemas/Body_update_example_api_v1_update_example_post responses: '200': description: Successful Response content: application/json: schema: {} '422': description: Validation Error content: application/json: schema: $ref: '#/components/schemas/HTTPValidationError' components: schemas: Body_update_example_api_v1_update_example_post: properties: automation: $ref: '#/components/schemas/Automation' description: type: string title: Description endpoint_name: type: string title: Endpoint Name type: object required: - automation - description - endpoint_name title: Body_update_example_api_v1_update_example_post HTTPValidationError: properties: detail: items: $ref: '#/components/schemas/ValidationError' type: array title: Detail type: object title: HTTPValidationError Automation: properties: browser_channel: type: string enum: - chromium - chrome - cloakbrowser - browser-use - rdp title: Browser Channel default: chromium backend: type: string enum: - browser-use - computer-vision title: Backend default: browser-use os_emulation: anyOf: - type: string enum: - windows - linux - type: 'null' title: Os Emulation allow_cookies: type: boolean title: Allow Cookies default: false max_retries: type: integer title: Max Retries default: 0 expected_downloads: type: integer title: Expected Downloads default: 0 remove_empty_nodes_in_axtree: type: boolean title: Remove Empty Nodes In Axtree default: true url: type: string title: Url take_final_screenshot: type: boolean title: Take Final Screenshot default: true parameters: $ref: '#/components/schemas/Parameters' nodes: items: oneOf: - $ref: '#/components/schemas/ActionNode' - $ref: '#/components/schemas/ForLoopNode' - $ref: '#/components/schemas/IfElseNode' - $ref: '#/components/schemas/AssertLocatorNode' discriminator: propertyName: type mapping: action_node: $ref: '#/components/schemas/ActionNode' assert_locator_node: $ref: '#/components/schemas/AssertLocatorNode' for_loop_node: $ref: '#/components/schemas/ForLoopNode' if_else_node: $ref: '#/components/schemas/IfElseNode' type: array title: Nodes automation_description: anyOf: - type: string - type: 'null' title: Automation Description automation_endpoint: anyOf: - type: string - type: 'null' title: Automation Endpoint post_processing_nodes: items: oneOf: - $ref: '#/components/schemas/ActionNode' - $ref: '#/components/schemas/ForLoopNode' - $ref: '#/components/schemas/IfElseNode' - $ref: '#/components/schemas/AssertLocatorNode' discriminator: propertyName: type mapping: action_node: $ref: '#/components/schemas/ActionNode' assert_locator_node: $ref: '#/components/schemas/AssertLocatorNode' for_loop_node: $ref: '#/components/schemas/ForLoopNode' if_else_node: $ref: '#/components/schemas/IfElseNode' type: array title: Post Processing Nodes default: [] type: object required: - url - parameters - nodes title: Automation ValidationError: properties: loc: items: anyOf: - type: string - type: integer type: array title: Location msg: type: string title: Message type: type: string title: Error Type type: object required: - loc - msg - type title: ValidationError Parameters: properties: input_parameters: additionalProperties: items: anyOf: - type: string - type: integer - type: number - type: boolean type: array type: object title: Input Parameters secure_parameters: additionalProperties: items: $ref: '#/components/schemas/SecureParameter' type: array type: object title: Secure Parameters generated_parameters: additionalProperties: items: anyOf: - type: string - type: integer - type: number - type: boolean - type: 'null' type: array type: object title: Generated Parameters type: object required: - input_parameters - generated_parameters title: Parameters ActionNode: properties: type: type: string const: action_node title: Type interaction_action: anyOf: - $ref: '#/components/schemas/InteractionAction' - type: 'null' assertion_action: anyOf: - $ref: '#/components/schemas/AssertionAction' - type: 'null' extraction_action: anyOf: - $ref: '#/components/schemas/ExtractionAction' - type: 'null' python_script_action: anyOf: - $ref: '#/components/schemas/PythonScriptAction' - type: 'null' powershell_action: anyOf: - $ref: '#/components/schemas/PowerShellAction' - type: 'null' sleep_action: anyOf: - $ref: '#/components/schemas/SleepAction' - type: 'null' fail_state_action: anyOf: - $ref: '#/components/schemas/FailStateAction' - type: 'null' captcha_action: anyOf: - $ref: '#/components/schemas/CaptchaAction' - type: 'null' misc_action: anyOf: - $ref: '#/components/schemas/MiscAction' - type: 'null' human_in_loop_action: anyOf: - $ref: '#/components/schemas/HumanInLoopAction' - type: 'null' before_sleep_time: type: number title: Before Sleep Time default: 0 end_sleep_time: type: number title: End Sleep Time default: 5 expect_new_tab: type: boolean title: Expect New Tab default: false max_new_tab_wait_time: type: number title: Max New Tab Wait Time default: 0 localized_axtree_string: anyOf: - type: string - type: 'null' title: Localized Axtree String type: object required: - type title: ActionNode ForLoopNode: properties: type: type: string const: for_loop_node title: Type variable_name: type: string title: Variable Name nodes: items: oneOf: - $ref: '#/components/schemas/ActionNode' - $ref: '#/components/schemas/IfElseNode' - $ref: '#/components/schemas/AssertLocatorNode' discriminator: propertyName: type mapping: action_node: $ref: '#/components/schemas/ActionNode' assert_locator_node: $ref: '#/components/schemas/AssertLocatorNode' if_else_node: $ref: '#/components/schemas/IfElseNode' type: array title: Nodes reset_nodes: items: oneOf: - $ref: '#/components/schemas/ActionNode' - $ref: '#/components/schemas/IfElseNode' - $ref: '#/components/schemas/AssertLocatorNode' discriminator: propertyName: type mapping: action_node: $ref: '#/components/schemas/ActionNode' assert_locator_node: $ref: '#/components/schemas/AssertLocatorNode' if_else_node: $ref: '#/components/schemas/IfElseNode' type: array title: Reset Nodes default: [] on_error_in_loop: type: string enum: - continue - break - raise title: On Error In Loop default: raise type: object required: - type - variable_name - nodes title: ForLoopNode IfElseNode: properties: type: type: string const: if_else_node title: Type condition: type: string title: Condition if_nodes: items: anyOf: - $ref: '#/components/schemas/ActionNode' - $ref: '#/components/schemas/IfElseNode' - $ref: '#/components/schemas/ForLoopNode' - $ref: '#/components/schemas/AssertLocatorNode' type: array title: If Nodes else_nodes: items: anyOf: - $ref: '#/components/schemas/ActionNode' - $ref: '#/components/schemas/IfElseNode' - $ref: '#/components/schemas/ForLoopNode' - $ref: '#/components/schemas/AssertLocatorNode' type: array title: Else Nodes default: [] type: object required: - type - condition - if_nodes title: IfElseNode AssertLocatorNode: properties: type: type: string const: assert_locator_node title: Type locator: type: string title: Locator assertion: type: string enum: - to_be_visible - to_be_hidden title: Assertion output_variable_name: type: string title: Output Variable Name timeout: type: number title: Timeout default: 5 type: object required: - type - locator - assertion - output_variable_name title: AssertLocatorNode description: >- Evaluate a Playwright locator assertion and store the boolean result. The locator is evaluated against `page` via Browser.get_locator_from_command (same `eval("page." + command)` style used by interaction actions). If the assertion holds within `timeout` seconds the result is True, otherwise False. The boolean is stored in generated_variables under `output_variable_name` (as a single-element list, e.g. {output_variable_name: [True]}) so it can be referenced later via `{output_variable_name[0]}`, e.g. in an if_else_node condition. SecureParameter: properties: onepassword: anyOf: - $ref: '#/components/schemas/OnePasswordParameter' - type: 'null' amazon_secrets_manager: anyOf: - $ref: '#/components/schemas/AmazonSecretsManagerParameter' - type: 'null' totp: anyOf: - $ref: '#/components/schemas/TOTPParameter' - type: 'null' type: object title: SecureParameter InteractionAction: properties: max_tries: type: integer title: Max Tries default: 10 max_timeout_seconds_per_try: type: number title: Max Timeout Seconds Per Try default: 1 verify_before_step: type: boolean title: Verify Before Step default: true click_element: anyOf: - $ref: '#/components/schemas/ClickElementAction' - type: 'null' input_text: anyOf: - $ref: '#/components/schemas/InputTextAction' - type: 'null' select_option: anyOf: - $ref: '#/components/schemas/SelectOptionAction' - type: 'null' check: anyOf: - $ref: '#/components/schemas/CheckAction' - type: 'null' uncheck: anyOf: - $ref: '#/components/schemas/UncheckAction' - type: 'null' hover: anyOf: - $ref: '#/components/schemas/HoverAction' - type: 'null' download_url_as_pdf: anyOf: - $ref: '#/components/schemas/DownloadUrlAsPdfAction' - type: 'null' scroll: anyOf: - $ref: '#/components/schemas/ScrollAction' - type: 'null' upload_file: anyOf: - $ref: '#/components/schemas/UploadFileAction' - type: 'null' go_to_url: anyOf: - $ref: '#/components/schemas/GoToUrlAction' - type: 'null' go_back: anyOf: - $ref: '#/components/schemas/GoBackAction' - type: 'null' switch_tab: anyOf: - $ref: '#/components/schemas/SwitchTabAction' - type: 'null' close_current_tab: anyOf: - $ref: '#/components/schemas/CloseCurrentTabAction' - type: 'null' close_all_but_last_tab: anyOf: - $ref: '#/components/schemas/CloseAllButLastTabAction' - type: 'null' close_tabs_until: anyOf: - $ref: '#/components/schemas/CloseTabsUntil' - type: 'null' agentic_task: anyOf: - $ref: '#/components/schemas/AgenticTask' - type: 'null' close_overlay_popup: anyOf: - $ref: '#/components/schemas/CloseOverlayPopupAction' - type: 'null' key_press: anyOf: - $ref: '#/components/schemas/KeyPressAction' - type: 'null' type: object title: InteractionAction AssertionAction: properties: network_call: anyOf: - $ref: '#/components/schemas/NetworkCallAssertion' - type: 'null' llm: anyOf: - $ref: '#/components/schemas/LLMAssertion' - type: 'null' python_script: anyOf: - $ref: '#/components/schemas/PythonScriptAssertion' - type: 'null' type: object title: AssertionAction ExtractionAction: properties: unique_identifier: anyOf: - type: string - type: 'null' title: Unique Identifier allow_none: type: boolean title: Allow None default: false network_call: anyOf: - $ref: '#/components/schemas/NetworkCallExtraction' - type: 'null' llm: anyOf: - $ref: '#/components/schemas/LLMExtraction' - type: 'null' python_script: anyOf: - $ref: '#/components/schemas/PythonScriptExtraction' - type: 'null' screenshot: anyOf: - $ref: '#/components/schemas/ScreenshotExtraction' - type: 'null' state: anyOf: - $ref: '#/components/schemas/StateExtraction' - type: 'null' two_fa_action: anyOf: - $ref: '#/components/schemas/TwoFAAction' - type: 'null' pdf: anyOf: - $ref: '#/components/schemas/PDFExtraction' - type: 'null' ocr_coordinates: anyOf: - $ref: '#/components/schemas/OCRCoordinatesExtraction' - type: 'null' locator: anyOf: - $ref: '#/components/schemas/LocatorExtraction' - type: 'null' vision: anyOf: - $ref: '#/components/schemas/VisionExtraction' - type: 'null' api_call: anyOf: - $ref: '#/components/schemas/APICallExtraction' - type: 'null' type: object title: ExtractionAction PythonScriptAction: properties: execution_code: type: string title: Execution Code type: object required: - execution_code title: PythonScriptAction PowerShellAction: properties: commands: items: type: string type: array title: Commands exit_after_commands: type: boolean title: Exit After Commands default: true type: object required: - commands title: PowerShellAction description: |- Run a list of PowerShell commands on the current RDP Windows machine. Opens PowerShell via Win+R, executes all commands sequentially, and closes the session (sends 'exit' automatically). SleepAction: properties: sleep_time: type: number title: Sleep Time type: object required: - sleep_time title: SleepAction FailStateAction: properties: failure_message: type: string title: Failure Message default: Automation completed at one of the failure states. type: object title: FailStateAction CaptchaAction: properties: locator: type: string title: Locator secondary_locator: anyOf: - type: string - type: 'null' title: Secondary Locator wait_time: type: number title: Wait Time default: 2 llm_provider: type: string const: gemini title: Llm Provider default: gemini llm_model_name: type: string title: Llm Model Name default: gemini-2.5-pro config: additionalProperties: true type: object title: Config type: object required: - locator title: CaptchaAction MiscAction: properties: set_variable: anyOf: - $ref: '#/components/schemas/SetVariableAction' - type: 'null' llm_query: anyOf: - $ref: '#/components/schemas/LLMQueryAction' - type: 'null' type: object title: MiscAction description: |- Container for miscellaneous actions (set_variable, llm_query, etc.). Exactly one sub-action must be provided. HumanInLoopAction: properties: max_wait_time: type: number maximum: 600 exclusiveMinimum: 0 title: Max Wait Time type: object required: - max_wait_time title: HumanInLoopAction OnePasswordParameter: properties: vault_name: type: string title: Vault Name item_name: type: string title: Item Name field_name: type: string title: Field Name type: type: string enum: - raw - totp_secret title: Type default: raw digits: anyOf: - type: integer - type: 'null' title: Digits type: object required: - vault_name - item_name - field_name title: OnePasswordParameter AmazonSecretsManagerParameter: properties: secret_name: type: string title: Secret Name region_name: type: string title: Region Name key: anyOf: - type: string - type: 'null' title: Key type: type: string enum: - raw - totp_secret title: Type default: raw digits: anyOf: - type: integer - type: 'null' title: Digits type: object required: - secret_name - region_name title: AmazonSecretsManagerParameter TOTPParameter: properties: totp_secret: type: string title: Totp Secret digits: type: integer title: Digits default: 6 type: object required: - totp_secret title: TOTPParameter ClickElementAction: properties: xpath: anyOf: - type: string - type: 'null' title: Xpath coordinates: anyOf: - prefixItems: - type: integer - type: integer type: array maxItems: 2 minItems: 2 - prefixItems: - type: string - type: string type: array maxItems: 2 minItems: 2 - type: 'null' title: Coordinates keyword: anyOf: - type: string - type: 'null' title: Keyword command: anyOf: - type: string - type: 'null' title: Command prompt_instructions: type: string title: Prompt Instructions default: '' skip_command: type: boolean title: Skip Command default: false skip_prompt: type: boolean title: Skip Prompt default: false assert_locator_presence: type: boolean title: Assert Locator Presence default: false recording_screenshot: anyOf: - type: string - type: 'null' title: Recording Screenshot bounding_box_variables: anyOf: - items: type: string type: array - type: 'null' title: Bounding Box Variables double_click: type: boolean title: Double Click default: false expect_download: type: boolean title: Expect Download default: false download_filename: anyOf: - type: string - type: 'null' title: Download Filename button: type: string enum: - left - right - middle title: Button default: left mouse_click: type: boolean title: Mouse Click default: false mouse_click_deviation: anyOf: - additionalProperties: anyOf: - type: number - type: integer type: object - type: 'null' title: Mouse Click Deviation force: type: boolean title: Force default: false type: object title: ClickElementAction InputTextAction: properties: xpath: anyOf: - type: string - type: 'null' title: Xpath coordinates: anyOf: - prefixItems: - type: integer - type: integer type: array maxItems: 2 minItems: 2 - prefixItems: - type: string - type: string type: array maxItems: 2 minItems: 2 - type: 'null' title: Coordinates keyword: anyOf: - type: string - type: 'null' title: Keyword command: anyOf: - type: string - type: 'null' title: Command prompt_instructions: type: string title: Prompt Instructions default: '' skip_command: type: boolean title: Skip Command default: false skip_prompt: type: boolean title: Skip Prompt default: false assert_locator_presence: type: boolean title: Assert Locator Presence default: false recording_screenshot: anyOf: - type: string - type: 'null' title: Recording Screenshot bounding_box_variables: anyOf: - items: type: string type: array - type: 'null' title: Bounding Box Variables input_text: anyOf: - type: string - type: 'null' title: Input Text is_slider: type: boolean title: Is Slider default: false fill_or_type: type: string enum: - fill - type - key_press title: Fill Or Type default: fill press_enter: type: boolean title: Press Enter default: false click_before_input: type: boolean title: Click Before Input default: true type: object title: InputTextAction SelectOptionAction: properties: xpath: anyOf: - type: string - type: 'null' title: Xpath coordinates: anyOf: - prefixItems: - type: integer - type: integer type: array maxItems: 2 minItems: 2 - prefixItems: - type: string - type: string type: array maxItems: 2 minItems: 2 - type: 'null' title: Coordinates keyword: anyOf: - type: string - type: 'null' title: Keyword command: anyOf: - type: string - type: 'null' title: Command prompt_instructions: type: string title: Prompt Instructions default: '' skip_command: type: boolean title: Skip Command default: false skip_prompt: type: boolean title: Skip Prompt default: false assert_locator_presence: type: boolean title: Assert Locator Presence default: false recording_screenshot: anyOf: - type: string - type: 'null' title: Recording Screenshot bounding_box_variables: anyOf: - items: type: string type: array - type: 'null' title: Bounding Box Variables select_values: anyOf: - items: type: string type: array - type: 'null' title: Select Values expect_download: type: boolean title: Expect Download default: false download_filename: anyOf: - type: string - type: 'null' title: Download Filename type: object title: SelectOptionAction CheckAction: properties: xpath: anyOf: - type: string - type: 'null' title: Xpath coordinates: anyOf: - prefixItems: - type: integer - type: integer type: array maxItems: 2 minItems: 2 - prefixItems: - type: string - type: string type: array maxItems: 2 minItems: 2 - type: 'null' title: Coordinates keyword: anyOf: - type: string - type: 'null' title: Keyword command: anyOf: - type: string - type: 'null' title: Command prompt_instructions: type: string title: Prompt Instructions default: '' skip_command: type: boolean title: Skip Command default: false skip_prompt: type: boolean title: Skip Prompt default: false assert_locator_presence: type: boolean title: Assert Locator Presence default: false recording_screenshot: anyOf: - type: string - type: 'null' title: Recording Screenshot bounding_box_variables: anyOf: - items: type: string type: array - type: 'null' title: Bounding Box Variables type: object title: CheckAction UncheckAction: properties: xpath: anyOf: - type: string - type: 'null' title: Xpath coordinates: anyOf: - prefixItems: - type: integer - type: integer type: array maxItems: 2 minItems: 2 - prefixItems: - type: string - type: string type: array maxItems: 2 minItems: 2 - type: 'null' title: Coordinates keyword: anyOf: - type: string - type: 'null' title: Keyword command: anyOf: - type: string - type: 'null' title: Command prompt_instructions: type: string title: Prompt Instructions default: '' skip_command: type: boolean title: Skip Command default: false skip_prompt: type: boolean title: Skip Prompt default: false assert_locator_presence: type: boolean title: Assert Locator Presence default: false recording_screenshot: anyOf: - type: string - type: 'null' title: Recording Screenshot bounding_box_variables: anyOf: - items: type: string type: array - type: 'null' title: Bounding Box Variables type: object title: UncheckAction HoverAction: properties: xpath: anyOf: - type: string - type: 'null' title: Xpath coordinates: anyOf: - prefixItems: - type: integer - type: integer type: array maxItems: 2 minItems: 2 - prefixItems: - type: string - type: string type: array maxItems: 2 minItems: 2 - type: 'null' title: Coordinates keyword: anyOf: - type: string - type: 'null' title: Keyword command: anyOf: - type: string - type: 'null' title: Command prompt_instructions: type: string title: Prompt Instructions default: '' skip_command: type: boolean title: Skip Command default: false skip_prompt: type: boolean title: Skip Prompt default: false assert_locator_presence: type: boolean title: Assert Locator Presence default: false recording_screenshot: anyOf: - type: string - type: 'null' title: Recording Screenshot bounding_box_variables: anyOf: - items: type: string type: array - type: 'null' title: Bounding Box Variables type: object title: HoverAction DownloadUrlAsPdfAction: properties: download_filename: type: string title: Download Filename url: anyOf: - type: string - type: 'null' title: Url type: object title: DownloadUrlAsPdfAction ScrollAction: properties: down: type: boolean title: Down default: true amount: type: integer title: Amount default: -1 prompt_instructions: anyOf: - type: string - type: 'null' title: Prompt Instructions type: object title: ScrollAction UploadFileAction: properties: xpath: anyOf: - type: string - type: 'null' title: Xpath coordinates: anyOf: - prefixItems: - type: integer - type: integer type: array maxItems: 2 minItems: 2 - prefixItems: - type: string - type: string type: array maxItems: 2 minItems: 2 - type: 'null' title: Coordinates keyword: anyOf: - type: string - type: 'null' title: Keyword command: anyOf: - type: string - type: 'null' title: Command prompt_instructions: type: string title: Prompt Instructions default: '' skip_command: type: boolean title: Skip Command default: false skip_prompt: type: boolean title: Skip Prompt default: false assert_locator_presence: type: boolean title: Assert Locator Presence default: false recording_screenshot: anyOf: - type: string - type: 'null' title: Recording Screenshot bounding_box_variables: anyOf: - items: type: string type: array - type: 'null' title: Bounding Box Variables file_path: anyOf: - type: string - type: 'null' title: File Path file_url: anyOf: - type: string - type: 'null' title: File Url type: object title: UploadFileAction GoToUrlAction: properties: url: type: string title: Url new_tab: type: boolean title: New Tab default: false type: object required: - url title: GoToUrlAction GoBackAction: properties: {} type: object title: GoBackAction SwitchTabAction: properties: tab_index: type: integer title: Tab Index type: object required: - tab_index title: SwitchTabAction CloseCurrentTabAction: properties: {} type: object title: CloseCurrentTabAction CloseAllButLastTabAction: properties: {} type: object title: CloseAllButLastTabAction CloseTabsUntil: properties: matching_url: anyOf: - type: string - type: 'null' title: Matching Url tab_index: anyOf: - type: integer - type: 'null' title: Tab Index type: object title: CloseTabsUntil AgenticTask: properties: task: type: string title: Task max_steps: type: integer title: Max Steps backend: type: string enum: - browser_use - browserbase title: Backend default: browser_use use_vision: type: boolean title: Use Vision default: false keep_alive: type: boolean title: Keep Alive default: true type: object required: - task - max_steps title: AgenticTask CloseOverlayPopupAction: properties: task: type: string title: Task default: > The primary goal of this task is to **automatically dismiss obstructing overlay popups** to enable a human-like, unobstructed view and interaction with the main website content. --- ### 🎯 Goal Clear the entire viewport of any modal, overlay, or blocking element that prevents access to the underlying webpage content. ### 📜 Scope of Target Overlays Target elements include, but are not limited to, the following common types of overlays: * Cookie Consent Banners/Modals * Privacy Policy Notices * Email/Newsletter Sign-up Prompts * Age Verification Gates * Blocking Promotional Offers ### ⚙️ Action Priority and Rules The agent must only dismiss overlays that a typical human user would close to proceed with the site. The actions must follow these specific rules in order of priority: 1. **Cookie Consent:** When encountering a cookie or privacy consent overlay, **always accept** or agree to the policy. Click buttons labeled "Accept," "Agree," "Got it," "Allow All," or similar positive confirmation phrases. 2. **General Dismissal:** For all other overlays (sign-ups, promotions, etc.), prioritize clicking **dismissive buttons** that close the popup without requiring user input. Look for labels like "Close," "X" (close icon), "No Thanks," "Maybe Later," "Skip," or "Continue to site." 3. **Avoidance:** Do **not** input text, or click buttons like "Sign Up," "Learn More," or links that navigate away from the current page (e.g., "Read Full Policy"). The goal is solely to dismiss the current obstruction. ### 🛑 Completion State The task is considered complete when the main body of the webpage is fully visible and ready for a user to interact with, meaning **no active overlays** are obstructing the content. max_steps: type: integer title: Max Steps default: 5 backend: type: string enum: - browser_use - browserbase title: Backend default: browser_use use_vision: type: boolean title: Use Vision default: true keep_alive: type: boolean title: Keep Alive default: true type: object title: CloseOverlayPopupAction KeyPressAction: properties: xpath: anyOf: - type: string - type: 'null' title: Xpath coordinates: anyOf: - prefixItems: - type: integer - type: integer type: array maxItems: 2 minItems: 2 - prefixItems: - type: string - type: string type: array maxItems: 2 minItems: 2 - type: 'null' title: Coordinates keyword: anyOf: - type: string - type: 'null' title: Keyword command: anyOf: - type: string - type: 'null' title: Command prompt_instructions: type: string title: Prompt Instructions default: '' skip_command: type: boolean title: Skip Command default: false skip_prompt: type: boolean title: Skip Prompt default: false assert_locator_presence: type: boolean title: Assert Locator Presence default: false recording_screenshot: anyOf: - type: string - type: 'null' title: Recording Screenshot bounding_box_variables: anyOf: - items: type: string type: array - type: 'null' title: Bounding Box Variables type: anyOf: - type: string - items: type: string type: array title: Type type: object required: - type title: KeyPressAction NetworkCallAssertion: properties: url_pattern: anyOf: - type: string - type: 'null' title: Url Pattern header_filter: anyOf: - additionalProperties: type: string type: object - type: 'null' title: Header Filter type: object title: NetworkCallAssertion LLMAssertion: properties: llm_provider: type: string enum: - gemini - anthropic - openai title: Llm Provider default: gemini llm_model_name: type: string title: Llm Model Name default: gemini-2.5-flash source: items: type: string enum: - axtree - screenshot type: array title: Source default: - screenshot extraction_format: additionalProperties: true type: object title: Extraction Format default: assertion_result: bool assertion_reason: str extraction_instructions: type: string title: Extraction Instructions recording_screenshot: anyOf: - type: string - type: 'null' title: Recording Screenshot output_variable_names: anyOf: - items: type: string type: array - type: 'null' title: Output Variable Names include_full_page: type: boolean title: Include Full Page default: false type: object required: - extraction_instructions title: LLMAssertion PythonScriptAssertion: properties: script: type: string title: Script type: object required: - script title: PythonScriptAssertion NetworkCallExtraction: properties: url_pattern: anyOf: - type: string - type: 'null' title: Url Pattern extract_from: anyOf: - type: string enum: - request - response - type: 'null' title: Extract From default: response download_from: anyOf: - type: string enum: - request - response - type: 'null' title: Download From default: response download_filename: anyOf: - type: string - type: 'null' title: Download Filename type: object title: NetworkCallExtraction LLMExtraction: properties: llm_provider: type: string enum: - gemini - anthropic - openai title: Llm Provider default: gemini llm_model_name: type: string title: Llm Model Name default: gemini-2.5-flash source: items: type: string enum: - axtree - screenshot type: array title: Source default: - axtree extraction_format: additionalProperties: true type: object title: Extraction Format extraction_instructions: type: string title: Extraction Instructions recording_screenshot: anyOf: - type: string - type: 'null' title: Recording Screenshot output_variable_names: anyOf: - items: type: string type: array - type: 'null' title: Output Variable Names include_full_page: type: boolean title: Include Full Page default: false type: object required: - extraction_format - extraction_instructions title: LLMExtraction PythonScriptExtraction: properties: script: type: string title: Script extraction_format: anyOf: - additionalProperties: true type: object - type: 'null' title: Extraction Format output_variable_names: anyOf: - items: type: string type: array - type: 'null' title: Output Variable Names type: object required: - script title: PythonScriptExtraction ScreenshotExtraction: properties: filename: type: string title: Filename full_page: type: boolean title: Full Page default: true type: object required: - filename title: ScreenshotExtraction StateExtraction: properties: {} type: object title: StateExtraction TwoFAAction: properties: action: oneOf: - $ref: '#/components/schemas/EmailTwoFAAction' - $ref: '#/components/schemas/SlackTwoFAAction' - $ref: '#/components/schemas/SMS2FAAction' title: Action discriminator: propertyName: type mapping: email_two_fa_action: $ref: '#/components/schemas/EmailTwoFAAction' slack_two_fa_action: $ref: '#/components/schemas/SlackTwoFAAction' sms_two_fa_action: $ref: '#/components/schemas/SMS2FAAction' instructions: anyOf: - type: string - type: 'null' title: Instructions output_variable_name: type: string title: Output Variable Name max_wait_time: type: number title: Max Wait Time default: 300 check_interval: type: number title: Check Interval default: 30 start_2fa_time_offset_minutes: type: number title: Start 2Fa Time Offset Minutes default: 0 end_2fa_time_offset_minutes: type: number title: End 2Fa Time Offset Minutes default: 0 type: object required: - action - output_variable_name title: TwoFAAction PDFExtraction: properties: filename: type: string title: Filename extraction_format: additionalProperties: true type: object title: Extraction Format extraction_instructions: type: string title: Extraction Instructions llm_provider: type: string enum: - gemini - anthropic - openai title: Llm Provider default: gemini llm_model_name: type: string title: Llm Model Name default: gemini-2.5-flash type: object required: - filename - extraction_format - extraction_instructions title: PDFExtraction OCRCoordinatesExtraction: properties: source_variable: type: string title: Source Variable output_x_variable: type: string title: Output X Variable default: coords_x output_y_variable: type: string title: Output Y Variable default: coords_y bounding_box_variables: anyOf: - items: type: string type: array - type: 'null' title: Bounding Box Variables type: object required: - source_variable title: OCRCoordinatesExtraction LocatorExtraction: properties: command: type: string title: Command output_variable_name: type: string title: Output Variable Name extraction_format: additionalProperties: true type: object title: Extraction Format extraction_instructions: anyOf: - type: string - type: 'null' title: Extraction Instructions llm_provider: type: string const: gemini title: Llm Provider default: gemini llm_model_name: type: string title: Llm Model Name default: gemini-2.5-flash type: object required: - command - output_variable_name - extraction_format title: LocatorExtraction VisionExtraction: properties: prompt: type: string title: Prompt output_variable_names: items: type: string type: array title: Output Variable Names type: object required: - prompt - output_variable_names title: VisionExtraction APICallExtraction: properties: url: type: string title: Url method: type: string enum: - GET - POST - PUT - PATCH - DELETE title: Method default: GET headers: additionalProperties: type: string type: object title: Headers body: anyOf: - additionalProperties: true type: object - type: string - type: 'null' title: Body query_params: additionalProperties: type: string type: object title: Query Params output_variable_names: items: type: string type: array title: Output Variable Names timeout: type: number title: Timeout default: 30 poll_condition: anyOf: - type: string - type: 'null' title: Poll Condition poll_interval: type: number title: Poll Interval default: 5 max_poll_attempts: type: integer title: Max Poll Attempts default: 10 type: object required: - url title: APICallExtraction SetVariableAction: properties: name: type: string title: Name value: anyOf: - type: integer - type: number - type: string - type: boolean - type: 'null' title: Value expression: anyOf: - type: string - type: 'null' title: Expression type: object required: - name title: SetVariableAction description: |- Set a value in generated_variables. Use `value` for a static value, or `expression` for a computed value (evaluated after variable replacement, e.g. "{counter[0]} + 1"). LLMQueryAction: properties: llm_provider: type: string enum: - gemini - anthropic - openai title: Llm Provider default: gemini llm_model_name: type: string title: Llm Model Name default: gemini-2.5-flash output_format: additionalProperties: true type: object title: Output Format prompt_instructions: type: string title: Prompt Instructions output_variable_names: anyOf: - items: type: string type: array - type: 'null' title: Output Variable Names type: object required: - output_format - prompt_instructions title: LLMQueryAction EmailTwoFAAction: properties: type: type: string const: email_two_fa_action title: Type receiver_email_address: type: string title: Receiver Email Address sender_email_address: type: string title: Sender Email Address integration_email_address: anyOf: - type: string - type: 'null' title: Integration Email Address type: object required: - type - receiver_email_address - sender_email_address title: EmailTwoFAAction SlackTwoFAAction: properties: type: type: string const: slack_two_fa_action title: Type slack_workspace_domain: type: string title: Slack Workspace Domain channel_name: type: string title: Channel Name sender_name: type: string title: Sender Name type: object required: - type - slack_workspace_domain - channel_name - sender_name title: SlackTwoFAAction SMS2FAAction: properties: type: type: string const: sms_two_fa_action title: Type from_number: type: string title: From Number to_number: type: string title: To Number type: object required: - type - from_number - to_number title: SMS2FAAction ````