firecrawl crawl

Bulk extract content from a website. Crawls pages following links up to a depth/limit.

When to use

You need content from many pages on a site (e.g., all

/docs/

)

You want to extract an entire site section

Step 4 in the

workflow escalation pattern

search → scrape → map → crawl → interact Quick start

Crawl a docs section

firecrawl crawl "" --include-paths /docs --limit 50 --wait -o .firecrawl/crawl.json

Full crawl with depth limit

firecrawl crawl "" --max-depth 3 --wait --progress -o .firecrawl/crawl.json

Check status of a running crawl

firecrawl crawl < job-id

Options Option Description --wait Wait for crawl to complete before returning --progress Show progress while waiting --limit Max pages to crawl --max-depth Max link depth to follow --include-paths Only crawl URLs matching these paths --exclude-paths Skip URLs matching these paths --delay Delay between requests --max-concurrency Max parallel crawl workers --pretty Pretty print JSON output -o, --output Output file path Tips Always use --wait when you need the results immediately. Without it, crawl returns a job ID for async polling. Use --include-paths to scope the crawl — don't crawl an entire site when you only need one section. Crawl consumes credits per page. Check firecrawl credit-usage before large crawls. See also firecrawl-scrape — scrape individual pages firecrawl-map — discover URLs before deciding to crawl firecrawl-download — download site to local files (uses map + scrape)