developers.cloudflare.com
Crawl entire websites with a single API call using Browser Rendering
Browser Rendering's new /crawl endpoint lets you submit a starting URL and automatically discover, render, and return content from an entire website as HTML, Markdown, or structured JSON.