# Firecrawl ## Docs - [Introduction](https://mintlify.wiki/firecrawl/firecrawl/introduction.md): Turn websites into LLM-ready data with Firecrawl's powerful scraping, crawling, and extraction API - [Quickstart](https://mintlify.wiki/firecrawl/firecrawl/quickstart.md): Get started with Firecrawl in 5 minutes - scrape your first website and extract structured data - [Authentication](https://mintlify.wiki/firecrawl/firecrawl/authentication.md): Learn how to authenticate with the Firecrawl API using API keys and manage your credentials securely - [Scrape](https://mintlify.wiki/firecrawl/firecrawl/features/scrape.md): Convert any URL to clean markdown, HTML, screenshots, or structured data - [Crawl](https://mintlify.wiki/firecrawl/firecrawl/features/crawl.md): Crawl an entire website and extract content from all pages - [Map](https://mintlify.wiki/firecrawl/firecrawl/features/map.md): Discover all URLs on a website instantly without scraping - [Search](https://mintlify.wiki/firecrawl/firecrawl/features/search.md): Search the web and get full page content from results - [Agent](https://mintlify.wiki/firecrawl/firecrawl/features/agent.md): Autonomous data gathering - just describe what you need - [Batch Scrape](https://mintlify.wiki/firecrawl/firecrawl/features/batch-scrape.md): Scrape multiple URLs asynchronously with parallel processing - [Actions](https://mintlify.wiki/firecrawl/firecrawl/advanced/actions.md): Interact with pages before scraping using actions like click, scroll, type, and wait - [Output Formats](https://mintlify.wiki/firecrawl/firecrawl/advanced/formats.md): Customize the output format of your scraped data with markdown, HTML, JSON, screenshots, and more - [Webhooks](https://mintlify.wiki/firecrawl/firecrawl/advanced/webhooks.md): Receive real-time notifications for crawl and batch scrape events via webhooks - [Manual Pagination](https://mintlify.wiki/firecrawl/firecrawl/advanced/pagination.md): Manually control pagination for crawl and batch scrape status responses - [Error Handling](https://mintlify.wiki/firecrawl/firecrawl/advanced/error-handling.md): Handle errors and understand status codes when using the Firecrawl API - [Self-Hosting Overview](https://mintlify.wiki/firecrawl/firecrawl/self-hosting/overview.md): Learn about self-hosting Firecrawl and how it compares to the cloud version - [Self-Hosting Setup](https://mintlify.wiki/firecrawl/firecrawl/self-hosting/setup.md): Step-by-step guide to installing and running a self-hosted Firecrawl instance - [Configuration](https://mintlify.wiki/firecrawl/firecrawl/self-hosting/configuration.md): Configure your self-hosted Firecrawl instance with environment variables and settings - [API Reference Introduction](https://mintlify.wiki/firecrawl/firecrawl/api-reference/introduction.md): Get started with the Firecrawl API to scrape, crawl, and extract structured data from websites - [Rate Limits](https://mintlify.wiki/firecrawl/firecrawl/api-reference/rate-limits.md): Understanding rate limits and usage guidelines for the Firecrawl API - [Scrape a single URL](https://mintlify.wiki/firecrawl/firecrawl/api-reference/scraping/scrape.md): Scrape a single URL and optionally extract information using an LLM - [Batch scrape multiple URLs](https://mintlify.wiki/firecrawl/firecrawl/api-reference/scraping/batch-scrape.md): Scrape multiple URLs and optionally extract information using an LLM - [Get batch scrape status](https://mintlify.wiki/firecrawl/firecrawl/api-reference/scraping/get-batch-status.md): Get the status of a batch scrape job - [Cancel batch scrape](https://mintlify.wiki/firecrawl/firecrawl/api-reference/scraping/cancel-batch.md): Cancel a batch scrape job - [Get batch scrape errors](https://mintlify.wiki/firecrawl/firecrawl/api-reference/scraping/get-batch-errors.md): Get the errors of a batch scrape job - [Start Crawl](https://mintlify.wiki/firecrawl/firecrawl/api-reference/crawling/crawl.md): Crawl multiple URLs based on options - [Get Crawl Status](https://mintlify.wiki/firecrawl/firecrawl/api-reference/crawling/get-crawl-status.md): Get the status and results of a crawl job - [Cancel Crawl](https://mintlify.wiki/firecrawl/firecrawl/api-reference/crawling/cancel-crawl.md): Cancel an ongoing crawl job - [Get Crawl Errors](https://mintlify.wiki/firecrawl/firecrawl/api-reference/crawling/get-crawl-errors.md): Retrieve errors that occurred during a crawl job - [Get Active Crawls](https://mintlify.wiki/firecrawl/firecrawl/api-reference/crawling/get-active-crawls.md): Get all active crawl jobs for your team - [Map URLs](https://mintlify.wiki/firecrawl/firecrawl/api-reference/mapping/map.md): Discover all URLs on a website instantly - [Search](https://mintlify.wiki/firecrawl/firecrawl/api-reference/search/search.md): Search the web and optionally scrape search results - [Agent](https://mintlify.wiki/firecrawl/firecrawl/api-reference/agent/agent.md): Autonomous data gathering with AI - [Extract structured data](https://mintlify.wiki/firecrawl/firecrawl/api-reference/extraction/extract.md): Extract structured data from pages using LLMs - [Get extract job status](https://mintlify.wiki/firecrawl/firecrawl/api-reference/extraction/get-extract-status.md): Get the status of an extract job - [Start Deep Research](https://mintlify.wiki/firecrawl/firecrawl/api-reference/research/deep-research.md): Start a deep research operation on a query - [Get Research Status](https://mintlify.wiki/firecrawl/firecrawl/api-reference/research/get-research-status.md): Get the status and results of a deep research operation - [Generate LLMs.txt](https://mintlify.wiki/firecrawl/firecrawl/api-reference/llmstxt/generate-llmstxt.md): Generate LLMs.txt file for a website - [Get LLMs.txt generation status](https://mintlify.wiki/firecrawl/firecrawl/api-reference/llmstxt/get-llmstxt-status.md): Get the status of an LLMs.txt generation job - [Get Credit Usage](https://mintlify.wiki/firecrawl/firecrawl/api-reference/billing/get-credit-usage.md): Get remaining credits for the authenticated team - [Get token usage](https://mintlify.wiki/firecrawl/firecrawl/api-reference/billing/get-token-usage.md): Get remaining tokens for Extract feature - [Python SDK](https://mintlify.wiki/firecrawl/firecrawl/sdks/python.md): Official Python SDK for Firecrawl - scrape, crawl, and extract web data for AI applications - [JavaScript SDK](https://mintlify.wiki/firecrawl/firecrawl/sdks/javascript.md): Official Node.js/JavaScript SDK for Firecrawl - scrape, crawl, and extract web data for AI applications - [Rust SDK](https://mintlify.wiki/firecrawl/firecrawl/sdks/rust.md): Official Rust SDK for Firecrawl - scrape, crawl, and extract web data for AI applications - [Java SDK](https://mintlify.wiki/firecrawl/firecrawl/sdks/java.md): Official Java SDK for Firecrawl - scrape, crawl, and extract web data for AI applications - [CLI & Skill](https://mintlify.wiki/firecrawl/firecrawl/sdks/cli.md): Firecrawl CLI and AI agent skill for seamless web scraping integration - [MCP Server](https://mintlify.wiki/firecrawl/firecrawl/sdks/mcp-server.md): Firecrawl Model Context Protocol (MCP) server for AI assistants like Claude Desktop ## OpenAPI Specs - [openapi](https://mintlify.wiki/firecrawl/firecrawl/api-reference/openapi.json) This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.