Interact
A decision block that interacts with the on-screen user interface.
The fiber will proceed immediately without pause.
Only use this block as a last resort if there’s no other way of performing the desired automation.
There are two types of interactions:
- Global actions can be performed at any time and doesn’t require knowledge of the on-screen UI elements.
- Targeted actions which are performed on a specific UI element.
Require an class, text and/or ID.
Use the App start or App in foreground block
to ensure that the correct activity is shown on screen.
A delay between sequential interactions may be needed to ensure the UI has been fully loaded and redrawn.
Note! Interacting with Automate isn’t permitted, for security reasons.
The NO path is executed if the UI element isn’t visible on screen or the action failed to be performed.
Options
- Record interaction — record new UI element interactions.
- Recorded interactions — previously recorded interactions.
Input arguments
- Action — action to perform, default Inspect.
- Content — content to set, currently only used for the Set text action.
- UI element class — class of the UI element to interact with, used for targeted actions.
- UI element text — text or description of the UI element to interact with, used for targeted actions.
- UI element ID — ID of UI element to interact with, used for targeted actions. (Android 4.3+)
Output variables
- Inspected content — variable to assign the text content of the inspected element.