Tag: robot.txt

SEO and Robot.txt

As we know, the “spiders” of certain electronic search engines like Google, always look in the root directory of a website the file “robots.txt”, basically to find out which files should or should not include in its database. These are three questions…