If you read this…

Then you have passed the robots.txt file :) I have disabled the site from all crawlers. Using robots.txt.

Tags: ,