In the Google Webmaster status index the problem of URLs blocked by robots.txt like this one happens. With the renewal of features on Google Webmasters, some of the blog owners have problems with indexing on their blogs. One of them is Error Index Coverage. Then How to Overcome Indexed Though Blocked by robots.txt?

Overview:



How to Overcome Indexed Though Blocked by robots.txt?
Overcome Indexed Though Blocked by robots.txt

What is Index Coverage Error?

If you are a blog owner and have received an email like below, it means that your blog is experiencing index problems. I got this email when this blog experienced indexing problems with Google webmasters.

The New Index coverage issue was detected for the site https://www.techgydbysm.com/.
To the owner of https://www.techgydbysm.com/, the Search Console was identified by the new Index coverage related issue. This means that index coverage may be negatively acted in Google Search results. We encourage you to fix this issue.
New issue found: Indexed, though  blocked by robots.txt

I received the notification email on November 28, 2018, which told that there was an error in my blog index. Then how do you overcome the error index coverage at google webmaster tools?

How to Overcome Indexed Though Blocked by robots.txt?

After I searched, it turned out that in the robot.txt section of my blog there was a blocking that caused the error, then I fixed it by removing some code that blocks crawling, by changing the code "Disallow: /search with "Disallow: /" as below the robot.txt setting that caused an error on my blog.

User-agent: *
Disallow: /search
Allow: /
Sitemap: https://www.techgydbysm.com/sitemap.xml

Then I changed the format to like below

User-agent: *
Disallow: /
Allow: /
Sitemap: https://www.techgydbysm.com/sitemap.xml

That way after a week I checked the webmaster tools again if there was an error in the Index Coverage, and the results were very good as shown below.


Indexed Though Blocked by robots.txt
Indexed Coverage Status

Then it can be concluded from the occurrence of the error above stating that in the "/search" section that causes an error index coverage so that it will not be indexed by search engines, even though you can ignore this because it does not affect your blog. Then don't panic if there is an Error Index Coverage in your webmaster tools. If you want to know more about the status coverage index, you can visit the official page of Google: Index Coverage Status Repo.

I hope this post met your queries. For more such interesting post keep in touch. I'll see y'all around.