View all systems 
Crawlbaseai web scraping
8 available actions
What your AI agent can do in Crawlbase
Crawlbase provides APIs for crawling web pages, managing crawler queues, storing crawl results, and monitoring account usage. This page lists every available action. Your agent only receives the actions and permissions required for the role you approve.
Showing all 8 actions.
Common starting points
- Get Crawling UsageReturn current Crawling API usage and optionally previous-month statistics for the connected Crawlbase account.
- Get Storage CountReturn the number of pages currently held in Crawlbase Cloud Storage.
- Generate User AgentsGenerate one to ten realistic randomized User-Agent strings for a selected device class.
- Delete Stored PagesIrreversibly delete explicitly selected pages from Crawlbase Cloud Storage by request ID and return each page's deletion outcome.
- Crawl URLFetch a public HTTP or HTTPS URL through Crawlbase using the connected Normal token and return its content with separate target and Crawlbase statuses.
Browse all 8 actions by capability
Open a capability to see every supported action and its description.
Find & reviewLook up and review existing recordsView 5 actions
- Get Crawling UsageReturn current Crawling API usage and optionally previous-month statistics for the connected Crawlbase account.
- Get Storage CountReturn the number of pages currently held in Crawlbase Cloud Storage.
- Get Stored PageRetrieve the latest Crawlbase Cloud Storage page by exactly one request ID or original URL.
- Get Stored PagesRetrieve up to 100 Crawlbase Cloud Storage pages by request ID without deleting them.
- List Stored Page IDsReturn one page of Crawlbase Cloud Storage request IDs and a short-lived continuation cursor.
Create & communicateCreate records or send supported messagesView 1 action
- Generate User AgentsGenerate one to ten realistic randomized User-Agent strings for a selected device class.
Remove & cancelRemove records or cancel supported workView 1 action
- Delete Stored PagesIrreversibly delete explicitly selected pages from Crawlbase Cloud Storage by request ID and return each page's deletion outcome.
Other actionsSpecialist and administrative actions.View 1 action
- Crawl URLFetch a public HTTP or HTTPS URL through Crawlbase using the connected Normal token and return its content with separate target and Crawlbase statuses.
Connection record
A connection you can control.
- Sign-in
- Customer-managed key
- Setup
- Use a key you create and control. It is stored securely and limited to the work agreed for the role.
- Boundaries
- Only the approved role and actions.
- Off switch
- Revoke the connection from your account.
FAQ
Before you connect Crawlbase
How does the agent connect to Crawlbase?
With a key you create and control. It is stored securely, permissions are limited to what the agent needs, and you can revoke it at any time.
What can the agent actually do in Crawlbase?
The page above lists the 8 actions currently available through the Crawlbase connection. The role determines which of those actions the agent may use, and write access is only enabled when the workflow needs it.
Is Crawlbase included in my plan?
Connections are priced per tool on top of the base plan. Some are included and some are premium. See pricing for how connection charges work.
How long until Crawlbase is ready?
Timing depends on the sign-in method, permissions and workflow being connected. We confirm the scope and setup plan before enabling the connection.
Bring the workflow together
Ready to put Crawlbase to work?
Start with the responsibility you want off your plate. We’ll map the connection and the boundaries around it.