How to remove Adsense Crawl Errors in WordPress Preview

If you are using Adsense on your wordpress blog then you might be facing this problem. You must be getting these crawl errors in adsense account settings. These crawl errors are mostly caused due to the post preview feature of wordpress. Check the images below, these are the crawl errors i used to get :

crawl_errors

crawl_errors2

How to fix Adsense Crawl Errors ?

To fix these adsense crawl errors on your wordpress blog, you will have to edit your robots.txt file of the site. The robots.txt file basically tells the crawler which pages to crawl and which not to.
You will just have to add this extra line in your robots.txt file :

Disallow: /?p=*

So your file will look like this now :

User-agent: * 
Disallow: /wp-admin/ 
Disallow: /wp-includes/
Disallow: /?p=*

This will fix your adsense crawl errors. That’s it. My robots file is located at http://codefap.com/robots.txt

If you are not familiar with editing the robots.txt file then you can use PC Robots WordPress Plugin.


					

5 Comments

  1. Pamela Wilson-Lipscomb

    Thank you, thank you thank you for this fix. I have had crawl errors that would not go away, not matter what I did, (request for removal, redirect). I changed my robots.txt to what you recommended. Your fix removed the crawl errors in my Adsense settings account! I applied your fix yesterday ant today they are gone! Thank you again Omkar! You are amazing!

    Reply
  2. Pamela Wilson-Lipscomb

    Omkar, I am still so excited about your article helping me fix crawl errors, on Adsense account settings! I am walking on a cloud! I have been searching for an answer for a week; all the time my earnings going down and my site moving from the 2nd page to oblivion! I went to ehow tech experts…they couldn’t help me. I went to my hosting company, they couldn’t help me, I went to Just Answer, the didn’t help me. (of course I requested refunds) I hope within a week or so, my site will be back on the 2nd page again! You should offer tech advice for money using PayPal or somethings.
    Thanks my friend!

    Pam

    Reply
    • Omkar Bhagat

      Hello, Thanks for taking your time to comment. I’m glad the post helped you.
      I don’t know about Paypal but i’ll continue to offer free advice on my blog hehe. 🙂 Thanks again.

      Reply

Leave a Reply