crawl_status | Fetch the status and results of a crawl job. Arguments: crawl_id (string, required — the crawl job ID returned by crawl_start). |
extract_status | Fetch the status and result of an extract job started by extract. Arguments: extract_id (string, required — the extract job ID returned by extract). |
map | Fetch and map a website, returning a list of all discovered URLs. Consumes 1 credit. Arguments: url (string, required — the root URL to map), search (string, optional — filter URLs by keyword), sitemap (string, optional — “skip” | “include” | “only”, default “skip”), includeSubdomains (boolean, optional — include subdomains, default false), ignoreQueryParameters (boolean, optional — strip query params from URLs, default false), limit (number, optional — max URLs 1–100000), timeout (number, optional — max ms for the request). |
scrape | Fetch and scrape a single URL, returning its content as markdown, HTML, links, or a screenshot. Consumes 1 credit per request. Arguments: url (string, required — the page to scrape), formats (array of “markdown” | “html” | “links” | “screenshot” | “rawHtml”, optional — output formats, default [“markdown”]), onlyMainContent (boolean, optional — skip nav/footer, default true), includeTags (array of strings, optional — HTML tags to include), excludeTags (array of strings, optional — HTML tags to exclude), waitFor (number, optional — ms to wait for dynamic content), timeout (number, optional — max ms, 1000–300000, default 30000), proxy (string, optional — “basic” | “enhanced” | “auto”). |
search | Search the web and optionally scrape each result. Consumes 1 credit per result (more with scrapeOptions). Arguments: query (string, required, 1–500 chars — the search query), limit (number, optional — max results 1–100), includeDomains (array of strings, optional — restrict to these domains), excludeDomains (array of strings, optional — exclude these domains), tbs (string, optional — time-based search filter), location (string, optional — geographic location for results), country (string, optional — country code), safe (boolean, optional — enable safe search). |
team_credits | Fetch remaining credits and billing period for the team. |