Enterprise AI Resource Hub - 302.AI | Pay-as-you-go, Comprehensive AI model API Access, Instant Online App Usage

Web Data Extraction Tool

Web Data Extraction Tool

Automatically crawl web pages to output markdown and structured data

2025-01-20

Tools API

Pricing:

Refer to LLM

Bulk order? Contact your manager for exclusive deals

API Overview

Automatically crawl web pages to output markdown and structured data

API Console

Log in to explore more features! Click to Log In

API Reference (3)

API Description	API Endpoint	Request Method	Stability	Parameter Description
Generate Schema	https://api.302.ai /302/crawler/generate-schema	POST	Stable	View Details
Document Details Generate corresponding Schema through web page and description Price: Charged according to the model called Request Parameters Header Parameters Authorizationstring Required Example Value:`Bearer {{YOUR_API_KEY}}` Modelstring Optional Example Value:`gpt-4o-mini` Request Body text/plain string
Create an extraction task	https://api.302.ai/302/crawler/task	POST	Stable	View Details
Document Details Create a web crawling task Price: Charged according to the model called Request Parameters Header Parameters Authorizationstring Required Example Value:`Bearer {{YOUR_API_KEY}}` Modelstring Optional Example Value:`gpt-4o-mini` Request Body application/x-msgpack urlsarray[string] Required Web page links that need to be crawled targetstring Required Detailed task descriptions are conducive to the accuracy of crawling data schemaobject Optional The data format structure that needs to be returned recursiveConfigobject Required Basic crawler settings matchTypestring Required Automatically obtain information directly, and manually obtain the corresponding crawler code first. searchModelstring Required By default, only incoming links are crawled, and the depth is to automatically retrieve related links. outputMdboolean Required Whether to output markdown content extracted by web pages maxDepthinteger Required Turn on the depth limit of depth mode maxUrlsinteger Required Maximum search link restrictions proxyConfigobject Optional The proxy service used when opening a web page proxyUrlstring Optional proxyUsernamestring Optional proxyPasswordstring Optional browserConfigobject Optional Browser detailed settings headlessboolean Optional browserTypestring Optional viewportWidthinteger Optional viewportHeightinteger Optional userAgentstring Optional cacheEnabledboolean Optional jsEnabledboolean Optional lightModeboolean Optional textModeboolean Optional cookiesarray[string] Optional headersobject Optional Accept-Languagestring Required
Query extraction progress	https://api.302.ai /302/crawler/task/{taskId}	GET	Stable	View Details
Document Details Get the progress of web crawling tasks Price：0 PTC/call Request Parameters Path Parameters taskIdstring Required Example Value:`44dd2497-0057-4610-ba96-c64608819a46` Header Parameters Authorizationstring Required Example Value:`Bearer {{YOUR_API_KEY}}` Request Body application/json object

API Pricing

$￥円 ₽

Model	Description	302.AI Price

Generate Schema	Generate Schema	Refer to LLM
Create an extraction task	Create an extraction task	Refer to LLM
Query extraction progress	Query extraction progress	$0/call

Recommended