Overview

Scrape web pages for data.

Inputs

Standard Inputs

• Extract Text Onlyboolean · optional

  Whether to extract only text content or include HTML

  Required

  No

  Multiple

  No

  Default

  true

• CSS Selectortext · optional

  CSS selector to extract specific elements from the page

  Required

  No

  Multiple

  No

• URLtext · required

  The URL of the webpage to scrape

  Required

  Yes

  Multiple

  No

• Wait Time (seconds)number · optional

  Time to wait for the page to fully load before scraping

  Required

  No

  Multiple

  No

  Default

  2

  Constraints

  min: 0 · max: 30 · step: 1 (seconds)

Outputs

• Scraped Datajson

  The scraped data from the webpage

• Successboolean

  Success state of the scraping operation

• Page Titletext

  The title of the scraped webpage

• Final URLtext

  The final URL after redirects