תרגום של "web crawler" ל-עברית

internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering)

An automated program that searches the Internet for new Web documents and places their addresses and content-related information in a database, which can be accessed with a search engine. Generally considered to be a type of bot, or Internet robot.