Can You Use Robots.txt to Influence Which Part of Your Site Gets Crawled?

Posted by Melissa in Video on August 22, 2010

Please watch and listen to Matt Cutts response and suggestions. Robots.txt should not be used to try and optimize or manipulate google’s crawl.

One response to “Can You Use Robots.txt to Influence Which Part of Your Site Gets Crawled?”

  1. Alltop SEO

    Can You Use Robots.txt to Influence Which Part of Your Site Gets Crawled? http://bit.ly/bGLT8B

Leave a Reply