Saturday, September 6, 2008

Robot

Also known as( crawler and spider) a robot is an a search ingine program that" crawls" the web collecting data following links making copies of new and updated sites,and storing urls in the search engine index.

No comments: