Tap by Description
Tap by Description
Tap an element using natural language description
POST
Tap by Description
Tap an element on screen by describing it in natural language. Uses vision AI to find and tap the described element.
Request
Path Parameters
Query Parameters
Request Body
Response
Synchronous
Asynchronous
Examples
Tap a Button
Tap a Text Element
Python Example
SDK Usage
The Python SDK provides this through thetap() method with a string argument:
Tips
- Be specific in your descriptions (“the blue Submit button” vs just “button”)
- Include visual characteristics like color, position, or text content
- Works best with clearly visible, distinct UI elements
Related Endpoints
- Tap - Tap at specific coordinates
- Double Tap - Double tap gesture