Skip to main content
Gesture methods accept either coordinates (x, y) or natural language descriptions. When you pass a string, TapKit uses vision AI to find and interact with the described element.

Taps

Swipes

Directions: "up", "down", "left", "right"

Drag

For drag() with selectors, both arguments must be strings. You cannot mix coordinates and descriptions.

Pinch

Tips for Selectors

  • Be specific: "the blue Submit button" works better than "button"
  • Include visual details: color, position, text content
  • Works best with clearly visible, distinct UI elements