adb-form-filler

name	adb-form-filler
description	Fill forms and interact with Android apps via ADB Wireless Debugging on user's tablet. Use when automating form input, navigating screens, or controlling Android UI elements through ADB commands.

ADB Form Filler

Fill forms and control Android UI directly via ADB on the user's tablet device.

Context

• User has Android tablet with ADB Wireless Debugging enabled permanently
• Tablet connection is persistent - agent can fill forms on screen vs isolated browser
• Laptop in repair (not permanent) - tablet is primary control surface
• User reviews output, adjusts prices, hits "post" himself

Prerequisites

# Verify connection
adb devices
# Should show tablet IP:port as connected

Core Commands

Navigate

# Tap at coordinates
adb shell input tap <x> <y>

# Swipe
adb shell input swipe <x1> <y1> <x2> <y2> <duration_ms>

# Back button
adb shell input keyevent 4

# Home button
adb shell input keyevent 3

# Text input
adb shell input text "<text>"
# Note: spaces need %s, special chars need escaping

Form Filling

# Type text (use %s for spaces)
adb shell input text "Hello%World"

# Clear field first (tap multiple to select all)
adb shell input tap <x> <y>
adb shell input keyevent 67  # Backspace

# Submit form
adb shell input keyevent 66  # Enter

# Navigate fields
adb shell input keyevent 61  # Tab

Screen Analysis

# Take screenshot for analysis
adb shell screencap -p /sdcard/screen.png
adb pull /sdcard/screen.png

# Get screen dimensions
adb shell wm size

# Find UI elements (if accessible)
adb shell uiautomator dump
adb pull /sdcard/window_dump.xml

Workflow

1. Verify connection - adb devices shows device
2. Screenshot current screen - identify form fields
3. Plan coordinates - map out text field positions
4. Fill fields sequentially - tap, type, tab/submit
5. Verify completion - screenshot after submit

Pitfalls

• ADB disconnects - reconnect before starting: adb connect <IP>:<port>
• Text encoding - special characters may fail, use ASCII where possible
• Screen rotation - coordinates change, always verify orientation
• Overlapping elements - some apps have hidden overlays, screenshot first
• Keyboard popup - may cover fields, dismiss with back button first

Common Patterns

Login Flow

adb shell input tap <username_x> <username_y>
adb shell input text "<username>"
adb shell input tap <password_x> <password_y>
adb shell input text "<password>"
adb shell input keyevent 66

Search & Select

# Search
adb shell input text "<search_term>"
adb shell input keyevent 66
# Wait for results, then tap desired item
adb shell input tap <result_x> <result_y>

Verification

After any form submission:

1. Take screenshot
2. Verify success message or next screen appears
3. Check for error states (red text, popup dialogs)