Dropped From Google Completely

It is every business owners worst nightmare – you wake up one morning and your website has vanished from Google. This was the plight of one frantic website owner we encountered recently. The site owner was convinced that something his SEO company had done caused his website to receive a Google penalty. His site was gone from Google… completely. You could not find the site by searching for the brand name or url. Any pages that were still indexed were not performing for any keyword search, and the cached versions were old. Diving into the crawl stats confirmed that Google not crawling the website – flat-lined.

crawl-statsOur team at RightNow was not overly optimistic that there was much that could be done for the site quickly, but agreed to dig in and map out a plan for the future. The first step was to check the usual suspects – robots.txt files, noindex issues, conflicting files or redirects, IP blacklists, hacking, etc. Nada. The next step was to reverse-engineer the SEO tactics that had been applied. Most Google penalties are algorithmically generated, so you need to discover any likely culprits The most common reason for getting booted from Google is participating in link building that breaks the Webmaster Guidelines.

During our research we discovered two things; First, the previous SEO company had done a pretty good job; Second, there were no glaring violations that should get a site ejected from Google. This came to us just after a Google update, so maybe it was possible that the site had been caught in the update by accident? Not likely, but we sent a researcher down that rabbit hole to investigate.

The other direction we investigated was to find out if there was something at the host level causing Google to not crawl the website. The hosting company flatly denied that there was any reported issues. Then we noticed something strange in Google Webmaster Tools – you could not fetch the site as Googlebot. Back to the hosting company, and another denial that it was their issue. As a last resort, we pulled a reverse IP list of all the sites on the shared IP address and manually checked them. Bingo – other sites had been dropped from Google! Armed with this info, we contacted the host again and they agreed to flush the server firewall as a “courtesy.” The problem was that the Googlebot IP address had been banned by the server firewall. We had the website reindexed 24 hours later, problem solved, end of story. Or is it?

SEO requires more than a keyword list, some links, a few articles, and some magic dust. The entire process has become highly technical, and there are a number of things that can go wrong. Most sites will never disappear from Google, but many suffer from missed opportunities that could be solved with correct website optimization.

Looking for an SEO partner? Give us a call!

About David

David Tucker: Search Engine Optimization, Link Building Strategies, Off-Page SEO, Brand and Reputation Management Campaigns, Structural Analysis, and Analytics Consultant. Fighting the good fight against the search engines since InfoSeek and Alta Vista were the top Internet search portals. David has a strong background in technical, design, and hosting related issues. This provides RightNow clients with a layer of SEO that most organizations can not offer. In addition to SEO work, David has developed the RightNow online client reporting system, public website, email and auto-responder system, and the development + branding of the RightNow social media channels. When not working you can find David enjoying the outdoors in Maui, Hawaii

Comments

  1. Hi David,
    This is a very interesting article, I got in to work this morning to find that our brand name has simply vanish from google SERPs for the exact brand name search, in its place are just business directory listings and social media results. I have checked through your points and there is simply nothing wrong with the website and ZERO issues reported in WMT etc. For the life of me I simply cannot work out whats gone on over night.

    Any thoughts appreciated.

  2. Hi Geoff

    I see that your site is indexed and cached (most recent cache is June 15) and I don’t see any “noindex” issues. I don’t see any DNS or Header issues. Don’t see that your IP has been blacklisted. Google is not reporting security issues. What does the crawl rate look like in GWT? Are there any messages in GWT? Have you checked to make sure your server has not blacklisted any crawlers? Anything suspicious in the .htaccess file? What do you see in your logs?

Speak Your Mind

*

Time limit is exhausted. Please reload CAPTCHA.