Agent Skills › leamsigc/ShortsGenerator › ig-research-scrape

ig-research-scrape

GitHub

自动化抓取Instagram热门帖子及竞品数据,提取互动指标、截图和音频,用于社交媒体内容研究。

skills/ig-research-scrape/SKILL.md leamsigc/ShortsGenerator

Trigger Scenarios

需要收集Instagram帖子数据 分析竞品账号表现 获取Reels视频素材

Install

npx skills add leamsigc/ShortsGenerator --skill ig-research-scrape -g -y
More Options

Use without installing

npx skills use leamsigc/ShortsGenerator@ig-research-scrape

指定 Agent (Claude Code)

npx skills add leamsigc/ShortsGenerator --skill ig-research-scrape -a claude-code -g -y

安装 repo 全部 skill

npx skills add leamsigc/ShortsGenerator --all -g -y

预览 repo 内 skill

npx skills add leamsigc/ShortsGenerator --list

SKILL.md

Frontmatter
{
    "name": "ig-research-scrape",
    "version": "1.0.0",
    "description": "Scrape state — runs the Instagram scraper via Chrome DevTools Protocol.\nRequires config.json to exist in the project directory.\nReads search terms + competitors from config, scrapes engagement data,\ndownloads audio, and captures hook screenshots.\n",
    "allowed-tools": [
        "Bash",
        "Read",
        "Write"
    ]
}

Social Research — Scrape State

Scrapes top-performing Instagram posts in a niche. Requires Chrome running with --remote-debugging-port=9222 and user logged into Instagram.

Before running

Ensure:

  1. Chrome is open with --remote-debugging-port=9222 flag
  2. Instagram is logged in (tab stays open)
  3. Config exists at .ig-research/projects/<project-name>/config.json

Run

node "$CLAUDE_SKILL_ROOT/scripts/scrape.js" <project-name> [sessionId]
# fallback: node ./skills/ig-research/scripts/scrape.js <project-name> --session $SESSION

Important: Keep the Instagram tab in the foreground (visible, not minimized) while this runs. Chrome throttles background tabs and screenshots will fail.

What it does

  1. Navigates to Instagram hashtag search pages (from config.searchTerms)
  2. Scrolls to collect post links
  3. Visits each post and extracts: likes, comments, shares, caption, author, post type
  4. Pauses video and captures screenshots at 0s, 1s, 2s (reels only)
  5. Downloads audio via yt-dlp (reels only)
  6. Navigates to competitor profiles (if configured) and repeats
  7. Deduplicates and sorts results by engagement
  8. Saves raw-posts.json

Output

.ig-research/projects/<project-name>/
├── raw-posts.json        # All scraped data, sorted by engagement
├── hook-screenshots/     # First 3 frames of each Reel (jpg)
└── transcripts/          # Audio files (m4a) for transcription

Platform-specific scrapers

  • Instagram: scripts/scrape.js (default)
  • Future: platforms/<name>/scrape.js

Override by setting config.platform and using the corresponding scraper:

node "$CLAUDE_SKILL_ROOT/platforms/<platform>/scrape.js" <project-name> --session $SESSION

Version History

  • 7b83166 Current 2026-08-29 02:31

Same Skill Collection

skills/facebook-research-analyze/SKILL.md
skills/facebook-research-engage/SKILL.md
skills/facebook-research-report/SKILL.md
skills/facebook-research-scrape/SKILL.md
skills/facebook-research-setup/SKILL.md
skills/facebook-research/facebook-research-template/SKILL.md
skills/ig-research-analyze/SKILL.md
skills/ig-research-report/SKILL.md
skills/ig-research-setup/SKILL.md
skills/ig-research-transcribe/SKILL.md
skills/ig-research/SKILL.md
skills/list-workflows/SKILL.md
skills/new-workflow/SKILL.md
skills/onboard/SKILL.md
skills/reddit-research-generate/SKILL.md
skills/reddit-research-scrape/SKILL.md
skills/reddit-research/SKILL.md
skills/short-generator/SKILL.md
skills/twitter-research-analyze/SKILL.md
skills/twitter-research-report/SKILL.md
skills/twitter-research-scrape/SKILL.md
skills/twitter-research-setup/SKILL.md
skills/twitter-research-topics/SKILL.md
skills/workflow-conventions/SKILL.md
skills/facebook-research-grow/SKILL.md
skills/facebook-research/SKILL.md
skills/twitter-research/SKILL.md

Metadata

Files
0
Version
b971266
Hash
6fd331de
Indexed
2026-08-29 02:31

Home - Wiki
Copyright © 2011-2026 iteam. Current version is 2.155.2. UTC+08:00, 2026-09-29 12:52
浙ICP备14020137号-1