(x, y) or natural language descriptions. When you pass a string, TapKit uses vision AI to find and interact with the described element.
Taps
Swipes
Directions:
"up", "down", "left", "right"
Drag
For
drag() with selectors, both arguments must be strings. You cannot mix coordinates and descriptions.Pinch
Tips for Selectors
- Be specific:
"the blue Submit button"works better than"button" - Include visual details: color, position, text content
- Works best with clearly visible, distinct UI elements