Google
Google Image
Google Mobile
MSN Search
Yahoo
Yahoo MM
Generated robots.txt will appear here…
After generating, create a ‘robots.txt’ file in your root directory and paste the content.