Showing results for 
Show  only  | Search instead for 
Did you mean: 

404 Error when Googlebot indexing

I was wondering why rarely or never appears in google searches. I enabled the google webmaster console with the wiki site and it shows googlebot has many 404 errors. Occasionally pages are correctly retrieved but the majority seem to fail, even though they definitely exist. I also tried fetching pages with which works with the default user agent, but fail with 404 if the user agent is googlebot. It appears as if googlebot accessing the wiki is blocked by godaddy.


I first suspected the request rate limits set by godaddy were the problem. For that reason, I reduced the crawl rate to the minimum allowed by google. However, this has not improved the situation.


This problem is strikingly similar to


Thoughts anyone?

Not applicable



There are arguments for, and against what you say.........


But I found no problem finding your site.......... though that's 5 minutes I'll never get back Smiley Happy

I can only see in search results, not Also there are several hundred articles on the site and google reports 15 pages in its index. There does seem to be a problem... if people are serious about looking at this problem, at least try with different user agents.


Is there any information about request rate limits for godaddy?

Not applicable