firecrawl crawl
SkillWeb & browsingThis skill gives your AI the ability to work with web content. Once added, it can scrape web pages, search the web, and browse through site content to find what you need.
Available today. Use it from your connected AI after setup.
No other account needed.
Add the skill, then ask your AI to look up or pull content from a web page or site.
Then ask your AI: use the firecrawl crawl skill
What your AI can do with it
- Scrape the contents of web pages
- Search the web for information
- Browse content across a website
What this skill tells your AI
The instructions your AI receives, as published by firecrawl/cli in skills/firecrawl-crawl/SKILL.md and read by ahel’s review.
Bulk extract content from a website. Crawls pages following links up to a depth/limit.
Prerequisite: crawl requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login.
Quick start
# Crawl a docs section
firecrawl crawl "<url>" --include-paths /docs --limit 50 --wait -o .firecrawl/crawl.json
# Full crawl with depth limit
firecrawl crawl "<url>" --max-depth 3 --wait --progress -o .firecrawl/crawl.json
# Check status of a running crawl
firecrawl crawl <job-id>
Run firecrawl crawl --help for the full option list.
Done when: the crawl reaches a terminal status and the saved output under .firecrawl/ contains the expected pages.
Tips
- Use
--waitwhen you need the results immediately. It has no default timeout; use--timeout <seconds>to bound polling. Without--wait, crawl returns a job ID for async polling. - Scope crawls with
--include-pathswhenever the request names a section — crawl only the pages you need. - Crawl consumes credits per page. Check
firecrawl credit-usagebefore large crawls (credit-usagerequires authentication).
See also
- firecrawl-scrape — scrape individual pages
- firecrawl-map — discover URLs before deciding to crawl
- firecrawl-download — download site to local files (uses map + scrape)
- firecrawl-build-scrape — building bulk extraction into an app instead of running it here
Signals
- GitHub stars
- 629
- Forks
- 98
- Last commit
- Sep 2026
- Installs
- 79k installs
Advanced
- Catalog kind
- skill
- Gateway key
firecrawl-crawl- Source
- github.com/firecrawl/cli