2
I created a robots.txt and Mapeed it on my host to be found at the root, but I realized that I climbed with spaces before the bar, many spaces.
And as the process of deploy is very bureaucratic I wonder if even with the spaces the search engines will understand the rule of the archive?
See how the file turned out.
User-agent: *
Disallow: /
2
Dude, you find out about this and other things about how Google reads robots.txt easily by running a test through the Search Console on Google Webmasters Tools.
But just in case, the best thing is to delete the spaces because Google can read, but who can guarantee that all other search engines can also?
Browser other questions tagged seo robots
You are not signed in. Login or sign up in order to post.