Agent Device

Overview and fit

Compatibility

Test languages

JavaScript TypeScript Natural language

Runner operating systems

Windows macOS Linux

Target operating systems

Windows macOS Linux iOS Android

Device modes

Real device Emulator Simulator

What it tests

Product kind

Framework, AI testing agent

Testing types

End-to-end, Functional, Regression, Exploratory

Targets

Web app, Native desktop, Native mobile

Use cases

Regression testing, Pull request validation, Test generation

Classification lists positively established capabilities. Absence from a list does not mean lack of support.

Creation and execution

Authoring methods

Code, AI-generated workflow, Autonomous exploration, Imported tests

Execution models

OS input, Real device, Emulator, Simulator, Hybrid

Deployment

Local, Self-hosted

License

Open source (MIT)

Capabilities

Maintenance, reliability, and debugging

Setup difficulty

Low

Maintenance approaches

Manual code, Resilient locators

Maximum concurrency

null

Debug artifacts

Screenshot, Trace, Console log, Network log

Reliability mechanisms

Auto wait, Retry

Interfaces

CLI, API, SDK, MCP

Pricing

Security and deployment

Certifications

None recorded

Data regions

Unknown

Data retention

Unknown

Customer data used for training

Unknown

Support

Channels

Docs, Github issues

Support SLA

Unknown

Limitations

• iOS 'Allow Paste' dialog suppressed under XCUITest — Documented limitation on iOS
• Android non-ASCII text on real devices without the test IME helper — Documented limitation on Android
• Android first helper install can wait on an OEM install dialog — Documented limitation on Android
• Android no clipboard access over adb on Android 16 — Documented limitation on Android

SDK code samples

import { createAgentDeviceClient } from 'agent-device';

async function main() {
  const client = createAgentDeviceClient({
    session: 'qa-integration',
    platform: 'ios',
    udid: 'auto',
  });

  try {
    await client.sessions.open();
    await client.command.openApp({ bundleId: 'com.apple.Preferences' });
    await client.command.tapOn({ text: 'Wi-Fi' });
    await client.command.tapOn({ text: 'Other...' });
    await client.command.inputText({ text: 'MyNetwork', into: 'Network Name' });
    await client.command.tapOn({ text: 'Join' });
  } finally {
    await client.sessions.close();
  }
}

await main();

Related pages

• AI Testing Tools
• Testing Tools with GitHub Integrations
• Native Desktop Testing Tools
• Self-Hosted Testing Tools
• Top 24 AI Testing Tools for Developers
• Top 26 AI Testing Tools for QA Engineers
• Top 16 AI Testing Tools for SDETs
• Top 16 AI Testing Tools for JavaScript
• Top 12 AI Testing Tools for TypeScript
• Top 21 AI Testing Tools for Natural Language
• Top 17 AI Testing Tools for Windows
• Top 15 AI Testing Tools for macOS
• Top 16 AI Testing Tools for Linux
• Top 20 AI Testing Tools for iOS
• Top 20 AI Testing Tools for Android
• Top 20 AI Testing Tools That Run on Windows
• Top 19 AI Testing Tools That Run on macOS
• Top 21 AI Testing Tools That Run on Linux
• Top 13 AI Testing Tools for Real Devices
• Top 14 AI Testing Tools for Emulators
• Top 11 AI Testing Tools for Simulators
• Agent Device alternatives

Sources and verification

1. 1The mobile verification for AI Agents · Official website · Callstack · retrieved 2026-09-26

   Supports 43 claims · Vendor documented, high confidence · verified 2026-09-26

   • Accessibility checks
   • Adapts to UI changes
   • API assertions
   • Browser engines
   • Browser extension testing
   • Browsers
   • Canvas testing
   • Cross-browser testing
   • Cross-platform testing
   • Dark and light mode testing
   • Database assertions
   • Deployment
   • Email testing
   • Failure grouping
   • File download testing
   • File upload testing
   • Free tier
   • Headed execution
   • Headless execution
   • iframe testing
   • Local execution
   • Multi-tab testing
   • Native desktop testing
   • Native mobile testing
   • Network mocking
   • OAuth testing
   • On-premises deployment
   • PDF validation
   • Pricing
   • Pricing models
   • Private network access
   • Product status
   • Secrets injection
   • Self-healing
   • Spelling and grammar checks
   • Support SLA
   • Targets
   • Test data generation
   • Test sharding
   • Tool
   • Trial
   • Vendor
   • Video content validation

   The mobile verificationfor AI Agents: Device automation CLI for AI agents. Real apps on iOS, Android, TV, and desktop.

   Built for agents. Anywhere.: We believe all agents should have access to agent-device running real simulators and devices regardless whether they operate within your desktop or from a cloud sandbox.

   The mobile verificationfor AI Agents: $npm install -g agent-device

   The mobile verificationfor AI Agents: Device automation CLI for AI agents.

   The mobile verificationfor AI Agents: Real apps on iOS, Android, TV, and desktop.

   The mobile verificationfor AI Agents: The mobile verification for AI Agents. Device automation CLI for AI agents.

   Clean-State Testing: agent-deviceMade by Callstack - React and React Native development experts

2. 2GitHub - callstack/agent-device: Mobile app automation and verification for AI coding agents. CLI, MCP server, and typed Node.js API for iOS, Android, HarmonyOS, TV, web, macOS, and Linux. · GitHub · Official repository · Callstack · retrieved 2026-09-26

   Supports 24 claims · Vendor documented, high confidence · verified 2026-09-26

   • Audience
   • Autonomous PR validation
   • CI execution
   • Company size
   • Device modes
   • Execution model
   • GitHub PR checks
   • License
   • License identifiers
   • Max concurrency
   • Merge gating
   • Parallel execution
   • PR comments
   • PR-aware test selection
   • Preview deployment testing
   • Product kind
   • Real device testing
   • Runner OS
   • Scheduled execution
   • Summary
   • Support channels
   • Target OS
   • Testing types
   • Use cases

   Folders and files: Let your coding agent verify its changes in the running app.

   Folders and files: agent-device is a command-line tool and MCP server that lets AI coding agents inspect, control, and verify mobile apps.

   Folders and files: simulators, emulators, and physical devices

   Folders and files: MIT license

   Folders and files: It also coordinates device access across parallel agent worktrees

   Folders and files: macOS, and Linux.

   Folders and files: Docs

   Folders and files: iOS, Android, and HarmonyOS (simulators, emulators, and physical devices), TV (tvOS, Android TV, Vega OS Virtual Device), web, macOS, and Linux.

   Folders and files: Automated pull request and merge validation with replay scripts and captured artifacts.

3. 3Node.js API - agent-device · Official docs · Callstack · retrieved 2026-09-26

   Supports 6 claims · Vendor documented, high confidence · verified 2026-09-26

   • Code authoring
   • Code samples
   • Integrations
   • Interfaces
   • Languages
   • SDK

   #Node.js API: Use createAgentDeviceClient() for typed, deterministic device automation from Node.js instead of shelling out to the CLI.

   #Device cloud sessions: See the BrowserStack, AWS Device Farm, and Limrun guides for provider-specific setup.

4. 4Replay & E2E Testing - agent-device · Official docs · Callstack · retrieved 2026-09-26

   Supports 11 claims · Vendor documented, high confidence · verified 2026-09-26

   • Authoring method
   • Auto-waiting
   • Automatic retries
   • Maintenance approach
   • Parameterized tests
   • Recorder
   • Reliability mechanisms
   • Replay
   • Reusable steps
   • Semantic visual assertions
   • Test import

   #Run Maestro compatibility flows: Agent Device can run a supported subset of Maestro YAML through its typed Maestro runner.

   #Run Maestro compatibility flows: extendedWaitUntil

5. 5AI Agent Setup - agent-device · Official docs · Callstack · retrieved 2026-09-26

   Supports 14 claims · Vendor documented, high confidence · verified 2026-09-26

   • AI executes the app
   • AI failure analysis
   • AI generates code only
   • AI test generation
   • Autonomous exploration
   • Console logs
   • Debug artifacts
   • Execution traces
   • Interactive debugging
   • MCP server
   • Natural language authoring
   • Network logs
   • Uses AI
   • VS Code extension

   #Recommended agent rule: For logs, network, audio, traces, or runtime failures, read `agent-device help debugging`.

6. 6Snapshots - agent-device · Official docs · Callstack · retrieved 2026-09-26

   Supports 1 claim · verified 2026-09-26

   • Vision-based interaction
7. 7Selectors - agent-device · Official docs · Callstack · retrieved 2026-09-26

   Supports 1 claim · verified 2026-09-26

   • Selector-free execution
8. 8Commands - agent-device · Official docs · Callstack · retrieved 2026-09-26

   Supports 6 claims · verified 2026-09-26

   • GitHub
   • Notification testing
   • Performance measurement
   • Screenshots
   • Video recording
   • Visual regression
9. 9Installation - agent-device · Official docs · Callstack · retrieved 2026-09-26

   Supports 1 claim · Editorial inference, high confidence · verified 2026-09-26

   • Setup difficulty

   #Installation: #Global install

10. 10Security & Trust - agent-device · Official docs · Callstack · retrieved 2026-09-26

    Supports 13 claims · Vendor documented, high confidence · verified 2026-09-26

    • Audit logs
    • Certifications
    • Configurable retention
    • Customer data used for training
    • Data regions
    • Data residency
    • Private runners
    • RBAC
    • SCIM
    • Secrets management
    • SSO (OIDC)
    • SSO (SAML)
    • Training opt-out

    #Security & Trust: #Security & Trust

    #Local control: #Local control

11. 11Known Limitations - agent-device · Official docs · Callstack · retrieved 2026-09-26

    Supports 1 claim · Vendor documented, high confidence · verified 2026-09-26

    • Editorial · Limitations

    #Known Limitations: #iOS: "Allow Paste" dialog suppressed under XCUITest

Hands-on tested: no (documentation research only) · Content updated 2026-09-26