Connect Crawlbase to your AI agent

Data & Analytics 8 actions available

Crawlbase provides APIs for crawling web pages, managing crawler queues, storing crawl results, and monitoring account usage.

We set up the connection using your own Crawlbase account, with keys you control, and keep it running. Your agent picks it up and starts doing the work.

Book a setup call → See pricing
Actions

What your agent can do in Crawlbase

Each one is a real action the agent can take on its own, the same things a person clicking around Crawlbase could do. Read-only by default; write actions are confirmed against your policy.

  • Crawl URL Fetch a public HTTP or HTTPS URL through Crawlbase using the connected Normal token and return its content with separate target and Crawlbase statuses.
  • Delete Stored Pages Irreversibly delete explicitly selected pages from Crawlbase Cloud Storage by request ID and return each page's deletion outcome.
  • Generate User Agents Generate one to ten realistic randomized User-Agent strings for a selected device class.
  • Get Crawling Usage Return current Crawling API usage and optionally previous-month statistics for the connected Crawlbase account.
  • Get Storage Count Return the number of pages currently held in Crawlbase Cloud Storage.
  • Get Stored Page Retrieve the latest Crawlbase Cloud Storage page by exactly one request ID or original URL.
  • Get Stored Pages Retrieve up to 100 Crawlbase Cloud Storage pages by request ID without deleting them. Returns decoded page content and identifies requested IDs that were not found.
  • List Stored Page IDs Return one page of Crawlbase Cloud Storage request IDs and a short-lived continuation cursor.
Setup

How we connect it

  1. 1

    Connect your account

    You create a key in Crawlbase, a key you create and control, and paste it in once. It lives in a secrets store on your server, not with us.

  2. 2

    Set the guardrails

    Read-only by default. You choose which write actions the agent may take, and anything outside that policy gets confirmed with you first.

  3. 3

    We keep it running

    Health checks on every connection, updates handled for you, and we watch the first week of activity to make sure the work lands.

FAQ

Crawlbase questions, answered.

With a key you create and control. You paste it in once, it is stored in a secrets store on your server, permissions are scoped to the minimum the agent needs, and you can revoke it at any time.
The actions Crawlbase's API allows, the same things a person clicking around the app could do. Connections start read-only by default; write actions are confirmed against the policy you set before the agent takes them.
Connections are priced per tool on top of the base plan. Some are included, some are premium. See pricing for how connection charges work.
Standard tools are ready inside 7 business days of the setup call. We test the connection end to end, walk you through how the agent uses it, and watch the first week of activity.

Ready to put Crawlbase to work?

Tell us what your team runs on. We set up the connection, secure it, and your agent takes it from there.

Book a setup call → Browse all connections

All product names, logos, and brands are property of their respective owners; used for identification only. ZeroToClaw is not affiliated with or endorsed by Crawlbase.