以視覺驅動的 Android 裝置自動化工具，使用 Midscene 技術。完全依賴螢幕截圖進行操作 — 無需 DOM 或無障礙標籤。能夠與螢幕上所有可見元素互動，不受技術堆疊限制。透過 ADB 以自然語言指令控制 Android 裝置，執行點擊、滑動、文字輸入、啟動應用程式、截圖等操作。
這是一個專為 Android 裝置設計的視覺驅動自動化技能，底層基於 Midscene.js 技術。它的獨特之處在於完全透過螢幕截圖來理解 UI 狀態，無需 DOM 解析或無障礙標籤，因此可以與任何技術堆疊建構的可見元素互動。使用者只需用自然語言描述操作意圖（例如「點擊登入按鈕」或「滑動到頁面底部」），技能便會透過 ADB 驅動真實 Android 裝置或模擬器執行對應的點擊、滑動、文字輸入、應用程式啟動、截圖驗證等動作。支援的觸發關鍵字涵蓋 android、phone、mobile app、tap、swipe、install app、open app on phone、adb、launch app、mobile screen、test android app 等，適合 QA 工程師、開發者在 CI/CD 流程中進行端到端視覺驗證。此技能可在任何支援 shell 指令與 ADB 的環境（如 Claude Code、Cursor、Codex）中運作，顯著降低了行動應用測試的自動化門檻。
npx skills add https://github.com/web-infra-dev/midscene-skills/tree/main/skills/android-device-automationInstalled? Explore more 影像 skills: steipete/songsee, affaan-m/frontend-design, mattpocock/improve-codebase-architecture · View all 6 →
使用 Midscene 進行視覺驅動的 Android 裝置自動化。完全依賴螢幕截圖操作 — 無需 DOM 或無障礙標籤。能夠與螢幕上所有可見元素互動，不受技術堆疊限制。透過 ADB 以自然語言指令控制 Android 裝置。執行點擊、滑動、文字輸入、應用程式啟動、截圖等操作。觸發關鍵字：android、phone、mobile app、tap、swipe、install app、open app on phone、android device、mobile automation、adb、launch app、mobile screen、test android app、verify mobile app、QA on phone、check the app on android、test on device、see if the app works on phone、end-to-end test on android、visual verification on mobile。技術基於 Midscene.js。
This repo contains 5 individual skills — each has its own dedicated page.
Vision-driven browser automation using Midscene. Operates from screenshots — no DOM or accessibility labels needed. Runs in headless Puppeteer — does NOT take over the user's mouse or keyboard. Also supports CDP mode and Bridge mode to connect to an existing Chrome. Use this skill when the user wants to: - Browse, navigate, or open web pages - Scrape, extract, or collect data from websites - Fill out forms, click buttons, or interact with web elements - Verify, validate, test, or QA frontend UI behavior - Take screenshots of web pages - Automate multi-step web workflows - Test what was just built, see if it works in browser - Connect to Chrome via CDP, DevTools Protocol, or remote debugging - Connect to user's Chrome browser, control my browser, operate my Chrome Powered by Midscene.js (https://midscenejs.com)
Vision-driven desktop automation using Midscene. Control your local desktop (macOS, Windows, Linux) or a remote Windows desktop over RDP with natural language commands. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. ⚠️ In local mode this takes over the user's real mouse and keyboard. For web apps, prefer "Browser Automation" instead. Only use this for desktop-native apps (Electron, Qt, native macOS/Windows/Linux) that cannot run in a browser, or for driving a remote Windows host via RDP. Triggers: open app, press key, desktop, computer, click on screen, type text, screenshot desktop, launch application, switch window, desktop automation, control computer, mouse click, keyboard shortcut, screen capture, find on screen, read screen, verify window, close app, test Electron app, rdp, remote desktop, windows server, connect via rdp Powered by Midscene.js (https://midscenejs.com)
Vision-driven HarmonyOS NEXT device automation using Midscene. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control HarmonyOS devices with natural language commands via HDC. Perform taps, swipes, text input, app launches, screenshots, and more. Trigger keywords: harmony, harmonyos, 鸿蒙, hdc, huawei device, harmony app, harmony automation, harmony phone, harmony tablet, test harmony app, verify on harmonyos, QA on 鸿蒙, check the app on harmony, test on huawei device, see if the app works on harmony, end-to-end test on harmonyos, visual verification on 鸿蒙 Powered by Midscene.js (https://midscenejs.com)
Vision-driven iOS device automation using Midscene CLI. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control iOS devices with natural language commands via WebDriverAgent. Triggers: ios, iphone, ipad, ios app, tap on iphone, swipe, mobile app ios, ios device, ios testing, iphone automation, ipad automation, ios screen, ios navigate, test ios app, verify on iphone, QA on ipad, check the app on ios, test on ios device, see if the app works on iphone, end-to-end test on ios, visual verification on ios Powered by Midscene.js (https://midscenejs.com)
Enhances Vitest with Midscene for AI-powered UI testing across Web (Playwright), Android (ADB), and iOS (WDA). Scaffolds new projects, converts existing projects, and creates/updates/debugs/runs E2E tests using natural-language UI interactions. Triggers: write test, add test, create test, update test, fix test, debug test, run test, e2e test, midscene test, new project, convert project, init project, 写测试, 加测试, 创建测试, 更新测试, 修复测试, 调试测试, 运行测试, 新建工程, 转化工程.
Generate spectrograms and feature-panel visualizations from audio with the songsee CLI.
Create distinctive, production-grade frontend interfaces with high design quality. Use when the user asks to build web components, pages, or applications and the visual direction matters as much as the code quality.
Scan a codebase for deepening opportunities, present them as a visual HTML report, then grill through whichever one you pick.
Add documentation for a new AI provider — usage docs, env vars, Docker config, image resources.
Tests in real browsers via Chrome DevTools MCP. Use when building or debugging anything that runs in a browser. Use when you need to inspect the DOM, capture console errors, analyze network requests, profile performance, or verify visual output with real runtime data. Requires the chrome-devtools MCP server to be configured.
This skill should be used when the user wants to visualize data. It intelligently selects the most suitable chart type from 26 available options, extracts parameters based on detailed specifications, and generates a chart image using a JavaScript script.