Agent Skills
› firecrawl/cli
› firecrawl-scrape
firecrawl-scrape
GitHub从指定URL提取网页内容，支持JS渲染SPA及多URL并发抓取，输出LLM优化的Markdown。用于替代WebFetch进行页面内容获取。
Trigger Scenarios
用户提供URL并要求获取内容
使用scrape、grab、fetch等关键词
Install
npx skills add firecrawl/cli --skill firecrawl-scrape -g -y
SKILL.md
Frontmatter
{
"name": "firecrawl-scrape",
"description": "Extract clean markdown from any URL, including JavaScript-rendered SPAs. Use this skill whenever the user provides a URL and wants its content, says \"scrape\", \"grab\", \"fetch\", \"pull\", \"get the page\", \"extract from this URL\", or \"read this webpage\". Handles JS-rendered pages, multiple concurrent URLs, and returns LLM-optimized markdown. Use this instead of WebFetch for any webpage content extraction.\n",
"allowed-tools": [
"Bash(firecrawl *)",
"Bash(npx firecrawl-cli *)"
]
}
firecrawl scrape
Scrape one or more URLs. Returns clean, LLM-optimized markdown. Multiple URLs are scraped concurrently.
When to use
- You have a specific URL and want its content
- The page is static or JS-rendered (SPA)
- Step 2 in the workflow escalation pattern: search → scrape → map + scrape → crawl → monitor → interact
Quick start
# Basic markdown extraction
firecrawl scrape "<url>" -o .firecrawl/page.md
# Main content only, no nav/footer
firecrawl scrape "<url>" --only-main-content -o .firecrawl/page.md
# Wait for JS to render, then scrape
firecrawl scrape "<url>" --wait-for 3000 -o .firecrawl/page.md
# Multiple URLs (markdown only; each saved to .firecrawl/; -o is ignored)
firecrawl scrape https://example.com https://example.com/blog https://example.com/docs
# Get markdown and links together
firecrawl scrape "<url>" --format markdown,links -o .firecrawl/page.json
# Ask a question about the page
firecrawl scrape "https://example.com/pricing" --query "What is the enterprise plan price?"
Options
| Option | Description |
|---|---|
-f, --format <formats> |
Output formats: markdown, html, rawHtml, links, images, screenshot, summary, changeTracking, json, attributes, branding |
-Q, --query <prompt> |
Ask a question about the page content (5 credits) |
-H, --html |
Output raw HTML (shortcut for --format html) |
--only-main-content |
Strip nav, footer, sidebar — main content only |
--wait-for <ms> |
Wait for JS rendering before scraping |
--include-tags <tags> |
Only include these HTML tags |
--exclude-tags <tags> |
Exclude these HTML tags |
--redact-pii |
Redact personally identifiable information from output |
-o, --output <path> |
Output file path |
Tips
- Prefer plain scrape over
--query. Scrape to a file, then usegrep,head, or read the markdown directly — you can search and reason over the full content yourself. Use--queryonly when you want a single targeted answer without saving the page (costs 5 extra credits). - Try scrape before interact. Scrape handles static pages and JS-rendered SPAs. Only escalate to
interactwhen you need interaction (clicks, form fills, pagination). - Multiple URLs are scraped concurrently — check
firecrawl --statusfor your concurrency limit. This mode saves markdown only and ignores-o; other requested formats are dropped. If markdown wasn't requested, the whole JSON response is written into the.mdfile. - Single format outputs raw content. Multiple formats (e.g.,
--format markdown,links) output JSON. - Always quote URLs — shell interprets
?and&as special characters. - Naming convention:
.firecrawl/{site}-{path}.md
See also
- firecrawl-search — find pages when you don't have a URL
- firecrawl-interact — when scrape can't get the content, use
interactto click, fill forms, etc. - firecrawl-download — bulk download an entire site to local files
Version History
-
253abde
Current 2026-08-19 19:06
修复-H参数描述错误，澄清多URL抓取时非Markdown格式的处理逻辑，并修正相关文档中的行为声明。
- 6c50c5d 2026-07-24 11:49
