1
When I search my site on google appears the message:
There is no information available for this page.
To get the description, I’ve already put the tag meta description in the header and my robots.txt is that way:
User-agent: *
Disallow: /
Do you need to do anything else? I know it takes time to google sweep the website to get the new information, but it’s been like this for a long time.
Why do you have the
Disallow: /? *The "User-agent: " Means this Section applies to all robots. The "Disallow: /" Tells the robot that it should not visit any pages on the site., documentation– Woss
This file was already created before I started working on this site. I thought that the "/" would block everything from being attached, but the site is being displayed normal in the searches, the only problem is the description. Do you think that if I remove the "/", it will normally read the meta?
– Diego Vieira
Man for starters had that bar for sure. But remember to block Russian bots, Chinese etc, if you don’t care that these bots scan your site. Another thing, if you changed the Discription a short time it is normal that Google takes up to a week to update that text
– hugocsl
@hugocsl Okay, I’m going to do this. Just one thing, even with the bar, google is indexing the site, it shouldn’t be happening right? Since the bar is blocking every site.
– Diego Vieira
In fact if you search vc will see that Robots is not a guarantee of no indexing, especially if you use other services like Google Analytics on your page...
– hugocsl