Communitygithub.com

web-infra-dev/vitest-midscene-e2e

Erweitert Vitest mit Midscene für KI-gestützte UI-Tests im Web (Playwright), Android (ADB) und iOS (WDA). Ermöglicht das Erstellen neuer Projekte, die Konvertierung bestehender Projekte sowie das Erstellen, Aktualisieren, Debuggen und Ausführen von E2E-Tests mittels natürlichsprachiger UI-Interaktionen.

Was ist vitest-midscene-e2e?

Diese Fähigkeit integriert Midscene in Vitest, um KI-gestützte End-to-End-Tests für Web-, Android- und iOS-Oberflächen zu ermöglichen. Entwickler können UI-Tests mit natürlicher Sprache beschreiben (z. B. „Klicke auf den Anmeldebutton“) und so komplexe Testskripte erheblich vereinfachen. Die Fähigkeit unterstützt die folgenden Aktionen: neue Projekte aufsetzen, bestehende Projekte konvertieren, Testfälle erstellen, aktualisieren, reparieren, debuggen und ausführen – alles über Befehle wie "write test", "add test" oder auf Deutsch "Test schreiben", "Test hinzufügen". Sie funktioniert auf Plattformen wie Web per Playwright, Android per ADB und iOS per WDA und nutzt die natürliche Sprachverarbeitung von Midscene, um Benutzerinteraktionen direkt in Code umzuwandeln. Damit wird der manuelle Aufwand bei der Testautomatisierung drastisch reduziert und die Testwartung wird intuitiver.

Funktioniert mit~Claude Code~Codex CLI~Cursor
Part ofDesign & UI
npx skills add https://github.com/web-infra-dev/midscene-skills/tree/main/skills/vitest-midscene-e2e
Original anzeigen→Alle Skills durchsuchen

In Ihrer bevorzugten KI fragen

Öffnet einen neuen Chat, in dem dieser Agent-Skill bereits geladen ist.

OpenAIChatGPTClaudeClaudeGeminiGeminiGrokGrokPerplexityPerplexityDeepSeekDeepSeek

Dokumentation

Was macht vitest-midscene-e2e?

Erweitert Vitest mit Midscene für KI-gestützte UI-Tests im Web (Playwright), Android (ADB) und iOS (WDA). Ermöglicht das Erstellen neuer Projekte, die Konvertierung bestehender Projekte sowie das Erstellen, Aktualisieren, Debuggen und Ausführen von E2E-Tests mittels natürlichsprachiger UI-Interaktionen. Auslöser: write test, add test, create test, update test, fix test, debug test, run test, e2e test, midscene test, new project, convert project, init project, Test schreiben, Test hinzufügen, Test erstellen, Test aktualisieren, Test reparieren, Test debuggen, Test ausführen, neues Projekt, Projekt konvertieren, Projekt initialisieren.

Individual skills in this repo

This repo contains 5 individual skills — each has its own dedicated page.

web-infra-dev/android-device-automation

Vision-driven Android device automation using Midscene. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control Android devices with natural language commands via ADB. Perform taps, swipes, text input, app launches, screenshots, and more. Trigger keywords: android, phone, mobile app, tap, swipe, install app, open app on phone, android device, mobile automation, adb, launch app, mobile screen, test android app, verify mobile app, QA on phone, check the app on android, test on device, see if the app works on phone, end-to-end test on android, visual verification on mobile Powered by Midscene.js (https://midscenejs.com)

web-infra-dev/browser-automation

Vision-driven browser automation using Midscene. Operates from screenshots — no DOM or accessibility labels needed. Runs in headless Puppeteer — does NOT take over the user's mouse or keyboard. Also supports CDP mode and Bridge mode to connect to an existing Chrome. Use this skill when the user wants to: - Browse, navigate, or open web pages - Scrape, extract, or collect data from websites - Fill out forms, click buttons, or interact with web elements - Verify, validate, test, or QA frontend UI behavior - Take screenshots of web pages - Automate multi-step web workflows - Test what was just built, see if it works in browser - Connect to Chrome via CDP, DevTools Protocol, or remote debugging - Connect to user's Chrome browser, control my browser, operate my Chrome Powered by Midscene.js (https://midscenejs.com)

web-infra-dev/desktop-computer-automation

Vision-driven desktop automation using Midscene. Control your local desktop (macOS, Windows, Linux) or a remote Windows desktop over RDP with natural language commands. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. ⚠️ In local mode this takes over the user's real mouse and keyboard. For web apps, prefer "Browser Automation" instead. Only use this for desktop-native apps (Electron, Qt, native macOS/Windows/Linux) that cannot run in a browser, or for driving a remote Windows host via RDP. Triggers: open app, press key, desktop, computer, click on screen, type text, screenshot desktop, launch application, switch window, desktop automation, control computer, mouse click, keyboard shortcut, screen capture, find on screen, read screen, verify window, close app, test Electron app, rdp, remote desktop, windows server, connect via rdp Powered by Midscene.js (https://midscenejs.com)

web-infra-dev/harmonyos-device-automation

Vision-driven HarmonyOS NEXT device automation using Midscene. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control HarmonyOS devices with natural language commands via HDC. Perform taps, swipes, text input, app launches, screenshots, and more. Trigger keywords: harmony, harmonyos, 鸿蒙, hdc, huawei device, harmony app, harmony automation, harmony phone, harmony tablet, test harmony app, verify on harmonyos, QA on 鸿蒙, check the app on harmony, test on huawei device, see if the app works on harmony, end-to-end test on harmonyos, visual verification on 鸿蒙 Powered by Midscene.js (https://midscenejs.com)

web-infra-dev/ios-device-automation

Vision-driven iOS device automation using Midscene CLI. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control iOS devices with natural language commands via WebDriverAgent. Triggers: ios, iphone, ipad, ios app, tap on iphone, swipe, mobile app ios, ios device, ios testing, iphone automation, ipad automation, ios screen, ios navigate, test ios app, verify on iphone, QA on ipad, check the app on ios, test on ios device, see if the app works on iphone, end-to-end test on ios, visual verification on ios Powered by Midscene.js (https://midscenejs.com)

Verwandte Skills

steipete/sag

ElevenLabs text-to-speech with mac-style say UX.

community

steipete/oracle

Oracle CLI second-model review/debug/refactor/design with selected files, dry-run token checks, API or browser engine.

community

steipete/peekaboo

Capture and automate macOS UI with the Peekaboo CLI.

community

mattpocock/design-an-interface

Generate multiple radically different interface designs for a module using parallel sub-agents. Use when user wants to design an API, explore interface options, compare module shapes, or mentions "design it twice".

community

mattpocock/prototype

Build a throwaway prototype to flesh out a design — a runnable terminal app for state/business-logic questions, or several radically different UI variations toggleable from one route.

community

mattpocock/grill-me

Interview the user relentlessly about a plan or design until reaching shared understanding, resolving each branch of the decision tree. Use when user wants to stress-test a plan, get grilled on their design, or mentions "grill me".

community