跳到主要内容

Create a crawler

POST 

/bv/aisk/v1/crawlers

This API is used to create a crawler resource.

Request

Body

required
    crawler objectrequired

    Required. The crawler resource to be created.

    start_urls string[]

    Input only. The list of URLs which the crawler will begin to crawl from.

Responses

A successful response.

Schema
    crawler object
    id string

    Output only. The uuid of the crawler.

    start_urls string[]

    Input only. The list of URLs which the crawler will begin to crawl from.

    status string

    Possible values: [CRAWLER_STATUS_RUNNING, CRAWLER_STATUS_COMPLETED, CRAWLER_STATUS_FAILED]

    Output only. The status of the crawler.

    crawled_urls string[]

    Output only. The list of URLs that the crawler found.

Loading...