I was wondering, how does a Web Crawler [wikipedia.org] actually work. Did a search and found out... Googlebot is Google’s…