Crawly
Documentation menu
Core API

Search

Search the web and optionally scrape the top result pages into Markdown.

Request

curl -X POST https://app.crawly.cc/api/v1/search \
  -H "Authorization: Bearer $CRAWLY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"query":"web data APIs for agents","limit":5,"scrapeTop":3}'

Results and cost

Search returns titles, URLs, and snippets. scrapeTop additionally fetches the first result pages into Markdown.

  • Base: 2 credits
  • Scraped result: +1 credit per page
  • Free default: 3 results, scrape top 1

Provider behavior

Crawly selects from providers enabled by the platform administrator. Provider names and credentials are internal and are not part of the customer API contract.