answall
Interesting
All questions
Tags

What is "web-crawler"

The Web Crawler (also known as Web Spider) is a computer program that navigates the World Wide Web in a methodical and automated manner or in an orderly manner. Other terms for web crawlers are Ants, automatic indexers, bots, spiders/Spiders, web robots, or - especially in the FOAF community - Web scutters.

View questions tagged web-crawler