Skip to main content
POST
Tap by Description
Tap an element on screen by describing it in natural language. Uses vision AI to find and tap the described element.

Request

Path Parameters

Query Parameters

Request Body

Response

Synchronous

Asynchronous

Examples

Tap a Button

Tap a Text Element

Python Example

SDK Usage

The Python SDK provides this through the tap() method with a string argument:

Tips

  • Be specific in your descriptions (“the blue Submit button” vs just “button”)
  • Include visual characteristics like color, position, or text content
  • Works best with clearly visible, distinct UI elements
  • Tap - Tap at specific coordinates
  • Double Tap - Double tap gesture