+Beyond-Bot.ai + Crawlbase
Crawlbase provides APIs for crawling web pages, managing crawler queues, storing crawl results, and monitoring account usage.
What You Can Do with this Integration
Automate Data Entry
Automatically sync new contacts or deals from Beyond-Bot.ai to Crawlbase.
Enrich Customer Profiles
Use Beyond-Bot.ai to find and add new information to your records in Crawlbase.
Trigger Workflows
Start automated workflows in Crawlbase based on conversations with your virtual expert.
Available Actions
Here are the specific actions your virtual expert can perform within Crawlbase.
Crawl Url
Fetch a public HTTP or HTTPS URL through Crawlbase using the connected Normal token and return its content with separate target and Crawlbase statuses.
Delete Stored Pages
Irreversibly delete explicitly selected pages from Crawlbase Cloud Storage by request ID and return each page's deletion outcome.
Generate User Agents
Generate one to ten realistic randomized User-Agent strings for a selected device class.
Get Crawling Usage
Return current Crawling API usage and optionally previous-month statistics for the connected Crawlbase account.
Get Storage Count
Return the number of pages currently held in Crawlbase Cloud Storage.
Get Stored Page
Retrieve the latest Crawlbase Cloud Storage page by exactly one request ID or original URL.
Get Stored Pages
Retrieve up to 100 Crawlbase Cloud Storage pages by request ID without deleting them. Returns decoded page content and identifies requested IDs that were not found.
List Stored Page Ids
Return one page of Crawlbase Cloud Storage request IDs and a short-lived continuation cursor.