Agent Skills › vllm-project/vllm-omni › music-video-subtitle-generator

music-video-subtitle-generator

GitHub

用于规划、创作和审核配乐视频及歌词排版。通过同步音乐节拍与视觉元素,生成包含镜头调度、角色场景参考及文字排版的详细时间线和提示词,支持从审计到完整视频交付的全流程。

.agents/skills/music-video-subtitle-generator/SKILL.md vllm-project/vllm-omni

Trigger Scenarios

需要制作带有歌词同步的音乐视频 要求根据音乐节奏生成视觉叙事或分镜脚本 请求对配乐视频进行内容审计或提示词优化

Install

npx skills add vllm-project/vllm-omni --skill music-video-subtitle-generator -g -y
More Options

Non-standard path

npx skills add https://github.com/vllm-project/vllm-omni/tree/main/.agents/skills/music-video-subtitle-generator -g -y

Use without installing

npx skills use vllm-project/vllm-omni@music-video-subtitle-generator

指定 Agent (Claude Code)

npx skills add vllm-project/vllm-omni --skill music-video-subtitle-generator -a claude-code -g -y

安装 repo 全部 skill

npx skills add vllm-project/vllm-omni --all -g -y

预览 repo 内 skill

npx skills add vllm-project/vllm-omni --list

SKILL.md

Frontmatter
{
    "name": "music-video-subtitle-generator",
    "metadata": {
        "compatibility": "File-based workflow with sibling h3-prompt-writing; audio analysis, generation, and final assembly use available tools and backends."
    },
    "description": "Plan, write, audit, or produce music videos with coordinated music, imagery, camera motion, optional performance, and lyric typography. Use for beat-aware MVs and instrumental visual narratives, not ordinary subtitle cleanup or unrelated video edits."
}

Music Video and Lyric Typography

Read the portable workflow and, when building a timeline, music timeline. Deliver the requested scope: audit, prompt, storyboard, or complete video.

Lock the musical and visual intent

Identify duration, ratio, output resolution, music source/excerpt, visual style, character/scene references, performance mode, and whether text is wanted. Treat a supplied song as the master track unless the user requests replacement. Preserve provided lyrics exactly; do not translate or rewrite them unasked. For instrumental work, do not invent singing, lyrics, a performer, or typography. Generate original lyrics only when requested or clearly within an authorized songwriting brief.

Measure supplied audio duration and inspect/listen for beat, phrase, breath, drop, and energy changes using available tools. Label estimated or planned timing when measurement is unavailable. If the requested excerpt exceeds the audio, resolve the discrepancy without silently stretching or looping it.

Reference roles

  • Character references control identity, silhouette, wardrobe, and presence.
  • Scene references control environment, time of day, spatial anchors, and lighting.
  • Typography references control letter treatment, layout, and motion, not people or scenery visible in those references.
  • Music references control the requested track or sound style; distinguish copying a supplied recording from generating similar instrumentation.

Do not apply a preset's grain, darkness, hard cuts, or constant close-ups to an incompatible brief. A bright nighttime scene remains night. A continuous flat vector morph keeps smooth color fields and uses elastic shape motion for accents. Use hard cuts, slow holds, or dissolves only when appropriate to the user's intent.

Compose the timeline and H3 prompts

Map visual actions, camera moves, scene changes, and optional text to the music's global time. Build a causal visual progression instead of defaulting to one person singing throughout. Allow room to read a shape, gesture, or lyric before changing it.

For longer work, choose a supported continuation or clip-assembly approach through the portable workflow. Keep visual shot boundaries distinct from generation windows. Local window prompts must account for overlap without replaying the full previous action. A new scene may require a new reference rather than inheritance of the old scene. Record entry/exit states for each planned segment.

Compile the timeline into H3's base or Ref2VA fields, preserving dialogue, lyrics, and visible text verbatim. Include concrete instrumentation and rhythmic accents, but treat requested BPM and beat alignment as targets until checked in the output.

Typography and finishing

When requested, give each shot one main readable text event. Keep words away from eyes and critical lip motion. Match sung text to the active phrase, and distinguish spatial typography from subtitle bars. Reduce text complexity if the model cannot render it, or use a disclosed overlay consistent with the requested deliverable.

For supplied audio, assemble clips to one global master track, maintaining phrase and lip continuity; avoid cuts inside a vowel. For native audio, inspect actual continuity across generation windows. Preserve useful SFX and avoid layered duplicate music. Retiming, grain, grading, interpolation, and upscaling are deliberate editing choices, not automatic finishing requirements.

Verify transformation/story order, identities, scene changes, requested text, musical continuity, timing, and full media decode. Label raw and processed versions. Deliver the final file and current prompt/timeline files, with measured properties and remaining limitations rather than claims of perfect synchronization.

Version History

  • f7e2834 Current 2026-09-22 16:47

Same Skill Collection

.agents/skills/3d-animation-short-generator/SKILL.md
.agents/skills/brand-promo-video-generator/SKILL.md
.agents/skills/co-op-game-intro-generator/SKILL.md
.agents/skills/h3-prompt-writing/SKILL.md
.agents/skills/handdrawn-live-video-generator/SKILL.md
.agents/skills/minimalist-product-ad-generator/SKILL.md
.agents/skills/paper-collage-explainer-generator/SKILL.md
.agents/skills/papercraft-stop-motion-explainer/SKILL.md
.claude/skills/add-diffusion-model/SKILL.md
.claude/skills/add-recipe/SKILL.md
.claude/skills/add-tts-model/SKILL.md
.claude/skills/diffusion-perf-opt/SKILL.md
.claude/skills/find-simplifications/SKILL.md
.claude/skills/precheck-pr/SKILL.md
.claude/skills/quantization/SKILL.md
.claude/skills/vllm-omni-npu-upgrade/SKILL.md
.claude/skills/vllm-omni-test/SKILL.md
.claude/skills/production-add-diffusion-model/SKILL.md
.claude/skills/review-pr/SKILL.md

Metadata

Files
0
Version
817f5d0
Hash
5ddb10d2
Indexed
2026-09-22 16:47

ホーム - Wiki
Copyright © 2011-2026 iteam. Current version is 2.155.2. UTC+08:00, 2026-09-30 04:24
浙ICP备14020137号-1