Core API

Map

Discover same-site URLs before choosing what to crawl.

Request

curl -X POST https://app.crawly.cc/api/v1/map \
  -H "Authorization: Bearer $CRAWLY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com","limit":50}'

Use Map before Crawl

Map is link discovery, not full content extraction. Use its same-host URL list to scope a later Crawl or Batch request.

Note: The minimum charge is 1 credit; larger maps are approximately 1 credit per 10 links.