Sometime we might want to change something in kernel itself in order to get some hardware to work or just small patch to tune it better. Whatever the cause.. this
Day: May 19, 2009
Instructing GoogleBot using robots.txtInstructing GoogleBot using robots.txt
According to Google .., their crawler for indexing purpose (GoogleBot) do respect the robots.txt content.. If we happened to specify something in robots.txt .. such as of Disallow: /restrict_folder/ Its