Abort site spidering

Is there any way of aborting a site spider? Yesterday it got very confused and ended up in an endless loop which I could only fix by turning off the server.

The cause was it adding on the same parameter multiple times in the URL for a certain page which I’ve fixed on my side by telling it not to crawl pages with that parameter but would still be useful I think to have an abort link like with deploys.

thank you @alex1 you are right, I’m converting this into a feature request!

1 Like