Web and site audits

Web page scrape

Fetches one or more web pages and returns each page title plus its cleaned text content, with navigation, headers, footers and cookie banners stripped out.

Works on any public URL and is tied to no particular site.

When to use it

Use when you have URLs and need what is actually on those pages, and no site-specific tool fits: an article, a docs page, a pricing or about page, or a link another tool handed you. Not a search engine, so give it URLs rather than a query, and reach for web.search or news.search when you need to find the pages first. One result, and one billable item, per URL, including URLs that fail to load.

Inputs

Web page scrape takes 1 field, 1 of them required. Anything you leave out falls back to the tool's own default.

How to call it

Connect once and your agent can reach Web page scrape the same way it reaches everything else in the catalog. Add Goro as an MCP connector, or paste the setup line into an agent that reads skills.

Or plain HTTP

POST /v1/run

{
  "endpoint": "web.scrape",
  "input": {
    "urls": [
      "<urls>"
    ]
  }
}