A Web crawler is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing.
A Web crawler may also be called a Web spider, an ant, an automatic indexer, or (in the FOAF software context) a Web scutter.
Web search engines and some other sites use Web crawling or spidering software to update their web content or indexes of others sites' web content. Web crawlers can copy all the pages they visit for later processing by a search engine that indexes the downloaded pages so that users can search them much more quickly.
In short when you see Spider bots, they are harmless. They just do work for search engines making sure that websites are more easily accessible in search results.
"A lie can travel half way around the world while the truth is putting on its shoes." ~ Charles Spurgeon Want to add me on Discord? Send me a PM!
Gemini wrote:Spider/crawl bots or whatever they are called methinks. I get them from time to time on my own community, we see them trying to access hidden forums and trying to post a message. I guess their programming just stated to try and post messages. Even when I turn on Guest Posting for a particular forum, they don't post anything. They just sit there and act like they are posting something.
But they have separate accounts:
Balance is imperative; without it, total collapse and destruction is imminent.
Wow, I don't know why, but I noticed after Spammageddon I became to post in 3.2x times more! As in old good times! :D
Or... is it magic of Submachine screenshot and dev process?..
or the magic of upcoming Christmas XD who knows, but it's true that the forum seems to have finally awakened, let's see how much this lasts. I hope for a long time!