A web crawler uses a search algorithm to traverse the web.
The web crawler is responsible for the process of browsing the net. It systematically browses the World Wide Web by looking at the keywords in the pages, the kind of content each page has and the links, and then return this information to the search engine.
The process is called Web crawling or spidering.
