Using the URL crawler to add sources.

Hi,

When the crawler returns > 500 URLs, you have to manually remove the existing ones, which in my case was > 50. That's a very tedious and time-consuming task.

And something that will require looking for the existing ones one by one and removing them from URLs that have just been crawled.

Do you have any solutions to this? Except for removing all the sources I added earlier and completing a fresh crawl,

I truly appreciate any assistance you may offer.

Please authenticate to join the conversation.

Upvoters
Status

Completed

Board

📥 Feedback

Date

About 3 years ago

Author

Anders Eilertsen

Subscribe to request

Get notified by email when there are changes.