Get batch scrape errors

Get the errors of a batch scrape job

Endpoint

GET /v1/batch/scrape/{id}/errors

Authentication

This endpoint requires authentication using a Bearer token. Include your API key in the Authorization header:

Authorization: Bearer YOUR_API_KEY

Path Parameters

id · string · required

The ID of the batch scrape job (UUID format)

Response

errors · array

Errored scrape jobs and error details

Show items

id · string

The unique identifier of the failed scrape job

timestamp · string

ISO timestamp of failure

url · string

The URL that was being scraped

error · string

Error message describing what went wrong

robotsBlocked · array

List of URLs that were attempted in scraping but were blocked by robots.txt

Examples

cURL

curl -X GET https://api.firecrawl.dev/v1/batch/scrape/550e8400-e29b-41d4-a716-446655440000/errors \
  -H 'Authorization: Bearer YOUR_API_KEY'

Response Example

{
  "errors": [
    {
      "id": "123e4567-e89b-12d3-a456-426614174000",
      "timestamp": "2024-01-15T10:30:00Z",
      "url": "https://example.com/page1",
      "error": "Request timeout after 30000ms"
    },
    {
      "id": "123e4567-e89b-12d3-a456-426614174001",
      "timestamp": "2024-01-15T10:31:00Z",
      "url": "https://example.com/page2",
      "error": "Failed to fetch page content"
    }
  ],
  "robotsBlocked": [
    "https://example.com/admin",
    "https://example.com/private"
  ]
}

Error Responses

402 · object

Payment Required - Payment required to access this resource.

{
  "error": "Payment required to access this resource."
}

429 · object

Too Many Requests - Request rate limit exceeded.

{
  "error": "Request rate limit exceeded. Please wait and try again later."
}

500 · object

Server Error - An unexpected error occurred on the server.

{
  "error": "An unexpected error occurred on the server."
}