Communitygithub.com

David-Li0406/meta-skill-evloving

一个使用 VideoMAEForPreTraining 模型检测视频异常的 Python 程序。它将视频分割为16帧片段,使用未掩码布尔掩码提取嵌入,并通过均方误差(MSE)与正常行为配置文件进行比较。

meta-skill-evloving 是什么?

该技能提供了一个基于 Hugging Face transformers 库中 VideoMAEForPreTraining 模型的视频异常检测方案。用户可以利用 OpenCV 读取视频并分割成16帧片段,通过 AutoImageProcessor 预处理后,借助布尔掩码(bool_masked_pos)禁用掩码,从模型中提取视频嵌入。然后,程序通过聚合正常视频的嵌入构建“正常行为配置文件”,并计算当前视频嵌入与该配置文件之间的均方误差(MSE)来识别异常。该技能支持完整的流程实现,包括模型加载、视频处理、特征提取、正常行为配置构建和异常检测,并明确避免使用不存在的方法(如 get_image_features)或跳过必要参数(如 bool_masked_pos)。它适用于任何需要从视频中自动检测异常行为的场景,如监控、工业质检等。

兼容平台~Claude Code~Codex CLI~Cursor
npx skills add https://github.com/David-Li0406/meta-skill-evloving/tree/HEAD/AutoSkill/SkillBank/ConvSkill/english_gpt4_8/video-anomaly-detection-with-videomae

在你喜欢的 AI 中提问

打开一个已预加载此 Agent Skill 的新对话。

文档

基于 VideoMAE 的视频异常检测

一个使用 VideoMAEForPreTraining 模型检测视频异常的 Python 程序。它将视频分割为16帧片段,使用未掩码布尔掩码提取嵌入,并通过均方误差(MSE)与正常行为配置文件进行比较。

提示

角色与目标

你是一名专注于计算机视觉和 PyTorch 的机器学习工程师。你的任务是编写一个 Python 程序,使用 Hugging Face transformers 库中的 VideoMAEForPreTraining 模型执行视频异常检测。

操作规则与约束

  1. 模型加载:使用 VideoMAEForPreTraining.from_pretrained("MCG-NJU/videomae-base") 以及来自同一检查点的 AutoImageProcessor。
  2. 视频处理:实现一个函数,使用(例如)OpenCV 读取视频文件,并将其分割为恰好16帧的片段。
  3. 预处理:使用 AutoImageProcessor 将帧列表预处理为 pixel_values。
  4. 特征提取:
    • 根据模型配置和帧数计算 num_patches_per_frame 和 seq_length。
    • 将 bool_masked_pos 初始化为全零张量(全部为 False),以在推理时禁用掩码。
    • 将 pixel_values 和 bool_masked_pos 传递给模型,获取输出。
  5. 正常行为配置文件:实现一个函数,通过聚合(例如,平均)从正常视频数据集中提取的嵌入来计算“正常行为配置文件”。
  6. 异常检测:实现一个函数,通过计算当前视频片段的嵌入与正常行为配置文件之间的均方误差(MSE)来检测异常。如果误差超过定义的阈值,则将帧或片段标记为异常。

反模式

  • 不要使用 get_image_features,因为该方法在 VideoMAEForPreTraining 中不存在。
  • 不要在没有必需的 bool_masked_pos 参数的情况下调用模型的前向传播。
  • 不要假设模型直接输出 last_hidden_state,而不验证输出对象的结构(可能需要访问特定属性或处理输出对象)。
  • 不要在最终实现中使用随机数据作为正常行为配置文件;应使用真实的正常数据。

触发器

  • 编写一个使用 videoMAE 模型进行异常检测的 Python 程序
  • 使用 VideoMAEForPreTraining 进行视频异常检测
  • 使用 videomae 和未掩码布尔掩码检测视频中的异常

Individual skills in this repo

This repo contains 20 individual skills — each has its own dedicated page.

David-Li0406/meta-skill-evloving

Browser automation with persistent page state. Use when users ask to navigate websites, fill forms, take screenshots, extract web data, test web apps, or automate browser workflows. Trigger phrases include "go to [url]", "click on", "fill out the form", "take a screenshot", "scrape", "automate", "test the website", "log into", or any browser interaction request.

David-Li0406/meta-skill-evloving

Create technical diagrams using Mermaid syntax for architecture, sequences, ERDs, flowcharts, and state machines. Use for visualizing system design, data flows, and processes. Triggers: diagram, mermaid, architecture diagram, sequence diagram, flowchart, ERD, entity relationship, state diagram, C4 model, component diagram, visualize, draw.

David-Li0406/meta-skill-evloving

Comprehensive document creation, editing, and analysis with support for tracked changes, comments, formatting preservation, and text extraction. When Claude needs to work with professional documents (.docx files) for: (1) Creating new documents, (2) Modifying or editing content, (3) Working with tracked changes, (4) Adding comments, or any other document tasks

David-Li0406/meta-skill-evloving

Complete color manipulation and green screen effects system. PROACTIVELY activate for: (1) Green screen/chromakey removal, (2) Color grading with LUTs, (3) Color correction (levels, curves, white balance), (4) Colorkey/color removal effects, (5) Hue/saturation manipulation, (6) Color space conversions (BT.709, BT.2020, HDR), (7) Color isolation effects, (8) Teal and orange look, (9) Vintage/film looks, (10) Color keying for transparency. Provides: chromakey and colorkey filters, LUT application (lut3d), curves and levels adjustment, color balance, selective color manipulation, color space handling, HDR tone mapping, professional color grading chains.

David-Li0406/meta-skill-evloving

Convert files and office documents to Markdown. Supports PDF, DOCX, PPTX, XLSX, images (with OCR), audio (with transcription), HTML, CSV, JSON, XML, ZIP, YouTube URLs, EPubs and more.

David-Li0406/meta-skill-evloving

Guide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK).

David-Li0406/meta-skill-evloving

Build with OpenAI's stateless APIs - Chat Completions (GPT-5, GPT-4o), Embeddings, Images (DALL-E 3), Audio (Whisper + TTS), and Moderation. Includes Node.js SDK and fetch-based approaches for Cloudflare Workers. Use when: implementing chat completions with GPT-5/GPT-4o, streaming responses with SSE, using function calling/tools, creating structured outputs with JSON schemas, generating embeddings for RAG (text-embedding-3-small/large), generating images with DALL-E 3, editing images with GPT-Image-1, transcribing audio with Whisper, synthesizing speech with TTS (11 voices), moderating content (11 safety categories), or troubleshooting rate limits (429), invalid API keys (401), function calling failures, streaming parse errors, embeddings dimension mismatches, or token limit exceeded.

David-Li0406/meta-skill-evloving

Comprehensive PDF manipulation toolkit for extracting text and tables, creating new PDFs, merging/splitting documents, and handling forms. When Claude needs to fill in a PDF form or programmatically process, generate, or analyze PDF documents at scale.

David-Li0406/meta-skill-evloving

Presentation creation, editing, and analysis. When Claude needs to work with presentations (.pptx files) for: (1) Creating new presentations, (2) Modifying or editing content, (3) Working with layouts, (4) Adding comments or speaker notes, or any other presentation tasks

David-Li0406/meta-skill-evloving

Comprehensive spreadsheet creation, editing, and analysis with support for formulas, formatting, data analysis, and visualization. When Claude needs to work with spreadsheets (.xlsx, .xlsm, .csv, .tsv, etc) for: (1) Creating new spreadsheets with formulas and formatting, (2) Reading or analyzing data, (3) Modify existing spreadsheets while preserving formulas, (4) Data analysis and visualization in spreadsheets, or (5) Recalculating formulas

David-Li0406/meta-skill-evloving

Download YouTube videos with customizable quality and format options. Use this skill when the user asks to download, save, or grab YouTube videos. Supports various quality settings (best, 1080p, 720p, 480p, 360p), multiple formats (mp4, webm, mkv), and audio-only downloads as MP3.

David-Li0406/meta-skill-evloving

Best practices for Remotion - Video creation in React

David-Li0406/meta-skill-evloving

Provides bidirectional translation (Chinese/English), grammar checking, and sentence polishing. Supports specific tense constraints, context-aware tone adjustment, and natural expression optimization. Outputs direct text without formatting.

David-Li0406/meta-skill-evloving

指导如何通过自定义注解(如@Unicom)标识Dubbo接口,利用BeanDefinitionRegistryPostProcessor在启动时扫描并动态注册ReferenceBean,实现RPC调用的封装。

David-Li0406/meta-skill-evloving

生成Python脚本,利用FFmpeg将图片序列按3x3布局合并,或将合并图拆分。要求使用subprocess模块执行命令,并支持用户交互式输入路径。

David-Li0406/meta-skill-evloving

SOP for extracting and analyzing promotional activity details, handling time formatting, location mapping, payment logic, and step-by-step process validation.

David-Li0406/meta-skill-evloving

Specializes in creating TikTok short video scripts using an anthropomorphic 'Chef' perspective to explain wildlife food chains and survival environments, utilizing real field footage.

David-Li0406/meta-skill-evloving

针对TikTok平台,以拟人化视角(如动物作为厨师)创作系列短视频脚本。重点介绍野生动物、食物链及生态环境,要求使用野外实拍素材,风格幽默且具有教育意义。

David-Li0406/meta-skill-evloving

Generates KWL (Know, Want to know, Learned) charts for educational videos, specifically BrainPOP, using simple 7th-grade language and short, concise bullet points.

David-Li0406/meta-skill-evloving

Tracks complex, multi-session work using the Beads issue tracker and dependency graphs, and provides persistent memory that survives conversation compaction. Use when work spans multiple sessions, has complex dependencies, or needs persistent context across compaction cycles. Trigger with phrases like "create task for", "what's ready to work on", "show task", "track this work", "what's blocking", or "update status".

相关技能