Using the URL crawler to add sources.

Hi,

When the crawler returns > 500 URLs, you have to manually remove the existing ones, which in my case was > 50. That's a very tedious and time-consuming task.

And something that will require looking for the existing ones one by one and removing them from URLs that have just been crawled.

Do you have any solutions to this? Except for removing all the sources I added earlier and completing a fresh crawl,

I truly appreciate any assistance you may offer.

Please authenticate to join the conversation.

Upvoters
Status

Completed

Board

πŸ“₯ Feedback

Date

Over 2 years ago

Author

Anders Eilertsen

Subscribe to post

Get notified by email when there are changes.