############################### # # sample robots.txt file # # addresses all robots by using wild card * # User-agent: * # list folders robots are not allowed to index Disallow: /Terminal/Test/ Disallow: /Terminal/Backup/ Disallow: /Terminal/media/Ringtones Disallow: /Staging # # list specific files robots are not allowed to index # Disallow: /Test/index.htm Dissalow: /Terminal/thankyou.html Dissalow: /Terminal/thankyou2.html # # End of robots.txt file # ###############################