Community이미지github.com

web-infra-dev/harmonyos-device-automation

Midscene 기반의 비전 중심 HarmonyOS NEXT 장치 자동화. DOM이나 접근성 레이블 없이 스크린샷만으로 모든 보이는 요소와 상호작용하며, HDC를 통해 자연어 명령으로 탭, 스와이프, 텍스트 입력, 앱 실행, 스크린샷 등을 수행합니다.

harmonyos-device-automation란 무엇인가요?

이 스킬은 Midscene.js를 활용하여 HarmonyOS NEXT 장치를 시각적으로 자동화하는 도구입니다. DOM이나 접근성 레이블에 의존하지 않고 스크린샷 기반으로 작동하므로, 어떤 기술 스택으로 개발된 앱이든 화면에 보이는 모든 요소와 상호작용할 수 있습니다. HDC(Huawei Device Connector)를 통해 자연어 명령을 사용하여 탭, 스와이프, 텍스트 입력, 앱 실행, 스크린샷 캡처 등 다양한 작업을 수행할 수 있습니다. 주로 'harmony', 'harmonyos', '鸿蒙', 'hdc', 'huawei device', 'harmony app', 'harmony automation', 'harmony phone', 'harmony tablet', 'test harmony app', 'verify on harmonyos', 'QA on 鸿蒙', 'check the app on harmony', 'test on huawei device', 'see if the app works on harmony', 'end-to-end test on harmonyos', 'visual verification on 鸿蒙' 등의 키워드로 트리거됩니다. 이는 크로스 플랫폼 앱, 네이티브 앱, 웹뷰 등 다양한 환경에서 일관된 자동화를 가능하게 하며, 엔드투엔드 테스트와 시각적 검증에 특히 유용합니다. Midscene.js (https://midscenejs.com)에 의해 구동됩니다.

지원 대상~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/web-infra-dev/midscene-skills/tree/main/skills/harmonyos-device-automation

Installed? Explore more 이미지 skills: steipete/songsee, affaan-m/frontend-design, mattpocock/improve-codebase-architecture · View all 6 →

원본 보기→모든 스킬 둘러보기

즐겨 사용하는 AI에게 물어보기

이 에이전트 스킬이 미리 로드된 새 채팅을 엽니다.

OpenAIChatGPTClaudeClaudeGeminiGeminiGrokGrokPerplexityPerplexityDeepSeekDeepSeek

문서

harmonyos-device-automation은(는) 무엇을 하나요?

Midscene을 활용한 비전 중심 HarmonyOS NEXT 장치 자동화. DOM이나 접근성 레이블이 필요 없이 스크린샷만으로 완전히 작동합니다. 기술 스택에 관계없이 화면에 보이는 모든 요소와 상호작용할 수 있습니다. HDC를 통해 자연어 명령으로 HarmonyOS 장치를 제어하세요. 탭, 스와이프, 텍스트 입력, 앱 실행, 스크린샷 등 더 많은 작업을 수행할 수 있습니다. 트리거 키워드: harmony, harmonyos, 鸿蒙, hdc, huawei device, harmony app, harmony automation, harmony phone, harmony tablet, test harmony app, verify on harmonyos, QA on 鸿蒙, check the app on harmony, test on huawei device, see if the app works on harmony, end-to-end test on harmonyos, visual verification on 鸿蒙 Midscene.js (https://midscenejs.com) 기반

Individual skills in this repo

This repo contains 5 individual skills — each has its own dedicated page.

web-infra-dev/android-device-automation

Vision-driven Android device automation using Midscene. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control Android devices with natural language commands via ADB. Perform taps, swipes, text input, app launches, screenshots, and more. Trigger keywords: android, phone, mobile app, tap, swipe, install app, open app on phone, android device, mobile automation, adb, launch app, mobile screen, test android app, verify mobile app, QA on phone, check the app on android, test on device, see if the app works on phone, end-to-end test on android, visual verification on mobile Powered by Midscene.js (https://midscenejs.com)

web-infra-dev/browser-automation

Vision-driven browser automation using Midscene. Operates from screenshots — no DOM or accessibility labels needed. Runs in headless Puppeteer — does NOT take over the user's mouse or keyboard. Also supports CDP mode and Bridge mode to connect to an existing Chrome. Use this skill when the user wants to: - Browse, navigate, or open web pages - Scrape, extract, or collect data from websites - Fill out forms, click buttons, or interact with web elements - Verify, validate, test, or QA frontend UI behavior - Take screenshots of web pages - Automate multi-step web workflows - Test what was just built, see if it works in browser - Connect to Chrome via CDP, DevTools Protocol, or remote debugging - Connect to user's Chrome browser, control my browser, operate my Chrome Powered by Midscene.js (https://midscenejs.com)

web-infra-dev/desktop-computer-automation

Vision-driven desktop automation using Midscene. Control your local desktop (macOS, Windows, Linux) or a remote Windows desktop over RDP with natural language commands. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. ⚠️ In local mode this takes over the user's real mouse and keyboard. For web apps, prefer "Browser Automation" instead. Only use this for desktop-native apps (Electron, Qt, native macOS/Windows/Linux) that cannot run in a browser, or for driving a remote Windows host via RDP. Triggers: open app, press key, desktop, computer, click on screen, type text, screenshot desktop, launch application, switch window, desktop automation, control computer, mouse click, keyboard shortcut, screen capture, find on screen, read screen, verify window, close app, test Electron app, rdp, remote desktop, windows server, connect via rdp Powered by Midscene.js (https://midscenejs.com)

web-infra-dev/ios-device-automation

Vision-driven iOS device automation using Midscene CLI. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control iOS devices with natural language commands via WebDriverAgent. Triggers: ios, iphone, ipad, ios app, tap on iphone, swipe, mobile app ios, ios device, ios testing, iphone automation, ipad automation, ios screen, ios navigate, test ios app, verify on iphone, QA on ipad, check the app on ios, test on ios device, see if the app works on iphone, end-to-end test on ios, visual verification on ios Powered by Midscene.js (https://midscenejs.com)

web-infra-dev/vitest-midscene-e2e

Enhances Vitest with Midscene for AI-powered UI testing across Web (Playwright), Android (ADB), and iOS (WDA). Scaffolds new projects, converts existing projects, and creates/updates/debugs/runs E2E tests using natural-language UI interactions. Triggers: write test, add test, create test, update test, fix test, debug test, run test, e2e test, midscene test, new project, convert project, init project, 写测试, 加测试, 创建测试, 更新测试, 修复测试, 调试测试, 运行测试, 新建工程, 转化工程.

관련 스킬

steipete/songsee

Generate spectrograms and feature-panel visualizations from audio with the songsee CLI.

community

affaan-m/frontend-design

Create distinctive, production-grade frontend interfaces with high design quality. Use when the user asks to build web components, pages, or applications and the visual direction matters as much as the code quality.

community

mattpocock/improve-codebase-architecture

Scan a codebase for deepening opportunities, present them as a visual HTML report, then grill through whichever one you pick.

community

lobehub/add-provider-doc

Add documentation for a new AI provider — usage docs, env vars, Docker config, image resources.

community

addyosmani/browser-testing-with-devtools

Tests in real browsers via Chrome DevTools MCP. Use when building or debugging anything that runs in a browser. Use when you need to inspect the DOM, capture console errors, analyze network requests, profile performance, or verify visual output with real runtime data. Requires the chrome-devtools MCP server to be configured.

community

bytedance/chart-visualization

This skill should be used when the user wants to visualize data. It intelligently selects the most suitable chart type from 26 available options, extracts parameters based on detailed specifications, and generates a chart image using a JavaScript script.

community
← More 이미지 skills