We provide several powerful API endpoints for web scraping and data extraction. Below is a comprehensive overview of our API features.

API Overview

EndpointDescriptionConcurrency LimitResponse Type
/scrapeWeb content collection20Synchronous
/extractData extraction20Synchronous
/extractTask/batchBatch extraction tasks3000 per batchAsynchronous
/extractTask/infoTask status monitoringN/ASynchronous

Detailed Features

Scrape API

/scrape Endpoint

A powerful web scraping solution designed for collecting web page content.

FeatureDescription
Output FormatsBase64, UTF-8 markdown
Response TypeSynchronous
ConcurrencyUp to 20 requests
Rate LimitingYes
Error HandlingAutomatic retry

Usage Examples:

{
  "url": "https://example.com",
  "format": "markdown"
}

Extract API

/extract Endpoint

Specialized in extracting structured data from specific platforms.

PlatformData TypesFormat
AmazonProduct details, Reviews, PricingJSON
Google MapsBusiness info, Reviews, HoursJSON
Google SearchSearch results, SnippetsJSON

Batch Operations

/extractTask/batch Endpoint

FeatureDescription
Batch SizeUp to 1000 URLs per batch
NotificationWebhook support
Status TrackingReal-time via /extractTask/info
Result FormatJSON

Batch Processing Workflow:

  1. Submit batch task
  2. Receive task ID
  3. Get results through webhook or active polling

Task Management

/extractTask/info Endpoint

FeatureValue
Task StatusRunning/Completed/Failed/Cancelled
Progress TrackingPercentage complete
Request InfoRequest ID, timestamp
Task DetailsTask ID, type, parameters
Result DataExtracted data
Timing InfoProcessing and completion timestamps
Error InfoError code, message, stacktrace

Response Example:

{
  "requestId": "7ef1b803-afb2-4f2c-8a35-9abd173cae27",
  "code": 0,
  "message": "Success",
  "timestamp": 1732087121691,
  "data": {
    "taskId": "6",
    "status": "completed",
    "params": {
      "url": "https://www.google.com/maps/place/...",
      "type": "google-maps",
      "timeout": 25000
    },
    "data": {
      "google_company_name": "Danny's Construction Co",
      "google_address": "86 North Bridge St, Gary, IN 46404, United States",
      "google_phone": "+1 219-883-8821",
      "google_rating": 5,
      "google_reviews_count": 1,
      "google_website": "https://www.dannysconstruction.com/",
      "latitude": 41.610615,
      "longitude": -87.374627
    },
    "finishedOn": 1732086970666,
    "processedOn": 1732086966586,
    "stacktrace": []
  }
}

Best Practices

Limitations

LimitationDescription
JavaScript RenderingDoes not support websites with dynamic JavaScript rendering

Rate Limiting

APIRate LimitBurst Limit
Scrape20 req/sec30 req/sec
Extract20 req/sec30 req/sec
Batch5 batches/min10 batches/min