#--------------------------------------------------------- # path : /web/docs/RSS/robots.txt # # specification : # include *.rss.canoe.ca/ # exclude: http://rss.canoe.ca/ (all the directory, except the homepage) #--------------------------------------------------------- # Domain: http://rss.canoe.ca/ # Creation: 11/28/2007 # Update: 11/28/2007 User-agent: Yahoo! DE Slurp Allow: /home.html Disallow: /2006/ Disallow: /Autonet/ Disallow: /BlogsInclude/ Disallow: /CHealth/ Disallow: /CNEWS/ Disallow: /Canoe/ Disallow: /Fulltext/ Disallow: /HG/ Disallow: /Homepage/ Disallow: /Jam/ Disallow: /LIPSO/ Disallow: /Lifewise/ Disallow: /Money/ Disallow: /Slam/ Disallow: /TechNews/ Disallow: /Technology/ Disallow: /Travel/ Disallow: /Wham/ # Sitemap: http://www.canoe.com/sitemap_canoe_index.xml # EOF