crawling the entire google
I inputed a publish google doc url and your crawlers are almost ingesting the entirety of google. See image with 1000+ pages 🤯 when its just a single google doc page
I have done this with your competitors and it works just fine.
Please try to fix.

Log in to comment and vote
Comments3
David Hawkins
Sep 18, 2024
I’ve had a similar issue with subdomains. If I enter the main domain of a site, it would crawl all subdomains too. It would be great if you could limit that somehow.
Patrick .G.
Jul 16, 2024
https://docs.google.com/document/d/e/2PACX-1vRwy4581v3YbYz4J0fRCIdrcAYsTER1Rs8HtyayxqcxUuRdX09A9Mm66VHiCZ5MBbevzpPvVAJUOJUn/pub
Ali Mahdi
Jul 15, 2024
Hi, can you provide the URL you inputted?
If you want to enter a single URL, use the “URL list” option.