OPINION

Google Has Dropped My Page From Their Index

Written by Gautam Dev
Published June 11, 2006

I recently published an article on my website.  It was titled "Digg vs IndianPad," and it was a humorous assessment of the difference between the two websites. Everyone is familiar with Digg, but many people may not be familiar with IndianPad. But don't worry, you are not missing much if you do not know anything about it. It's a Digg clone and is supposed to be for news items relevant to southeast Asia.

Well, after a few days, I Googled "digg vs indianpad" to see if anybody had any similar pieces written. To my surprise, my website appeared at the top of the search result. I was so excited. I thought finally I had a masterpiece written and that I would probably get inundated with traffic and make a ton of money from the ads. Well, neither of these things happened. I consoled myself by saying that it was okay, no big deal. I guess lots of people search on digg and some people search on IndianPad. But how many people will be searching on "digg vs indianpad"? Not many, I thought.

After a few days, I searched again on the same phrase. This time, however, I did not see my webpage at the top. In fact, my webpage was not in the search results at all. I scrolled down, went to the second page, third page, and so on. No, it was nowhere to be found. As I dug deeper, I found that the entire webpage has been dropped from Google's index. It was very surprising. If it had not appeared there in the beginning, I could understand that Google simply hadn't gotten to it yet. But after indexing so quickly, the fact that the page got dropped entirely was very perplexing. 

This got me thinking about what could cause this to happen. If you look at my writings on that page, you will actually find something interesting, in fact ironic. I put up a commentary about Google being too full and lagging behind in indexing a lot of webpages. This is not something I made up. This was an article published at The Register. It was argued in that article that Google's servers are just choking on web spam, leaving many webpages of legitimate content out of reach.

I made of fun of this fact and made satiric comments on how one can use this fact. Here is an excerpt below.

page 1 | 2
Keep reading for information and comments on this article, and add some feedback of your own!
Buy from Amazon.com
The Google Story The Google Story
Mark Malseed
Book,

Google Has Dropped My Page From Their Index
Published: June 11, 2006
Type: Opinion
Section: Sci/Tech
Filed Under: Sci/Tech: Blogging, Sci/Tech: Internet, Sci/Tech: Software
Writer: Gautam Dev
Gautam Dev's BC Writer page
Gautam Dev's personal site
Spread the Word
Like this article?
Email this
Submit to del.icio.us Save to del.icio.us
RSS Feeds
All RSS Feeds (240+)
Comments on this article
BC articles by Gautam Dev
Sci/Tech: Blogging
Sci/Tech: Internet
Sci/Tech: Software
All Sci/Tech Articles
All Opinion articles
All BC articles
All BC Comments

Comments

#1 — June 11, 2006 @ 13:28PM — SteveS [URL]

this happened to me. It does it because it returns the most relevant results, which it determines by number of clicks.

I had written an article on dialidol.com, whenever you did a search for dialidol.com, my article was the first thing that showed up (after the site itself) for about two weeks, then it slipped to number three and now it's way down.

That is because when I appeared at the top, many people were clicking on it, to move me up the list. These same people were still searching for dialidol.com articles two weeks later, but had already read mine, so were clicking on links farther down the list. This caused mine to fall from the number '1' spot. That's my understanding of how it works.

#2 — June 11, 2006 @ 15:28PM — ka [URL]

I just love it.. people who have absolutely no idea how search engines work put themselves on a position of "expert".

hahahha... getting unlisted because you mention spam? google relying mostly on "click rank"? guys... please... before you write another article... get some knowledge..

#3 — June 11, 2006 @ 15:37PM — Amit Agarwal [URL]

I can think of two situations:

You may be a victim of Google BigDaddy update.

Or

Such things are common with new websites on Google. What's the age of your site ?

Maybe wait for a couple of days and I am sure the page with popup again in the Google search results.

#4 — June 11, 2006 @ 16:35PM — Jared [URL]

That doesn't explain why the page was removed from the search completely though. It should just have dropped in relevance and been on the second, third, etc. page.

#5 — June 11, 2006 @ 17:39PM — Gautam [URL]

I agree with ka it doesn't depend on click rank with google. I think yahoo works like that. I am no expert on the search engines though.
I seem to like Amit's suggestion on the 'Google BigDaddy' conecpt. This webpage is brand new. I just started it a month ago.

#6 — June 11, 2006 @ 19:17PM — Nuno [URL]

I think that the problem is related to the fact that there are several servers indexing and serving the pages and they are not in sync. When we do a query is not the same server that gives the answer.

#7 — June 11, 2006 @ 20:56PM — SEOKing

You dropped in the SERPs because of the duplicate content, or as said before, the servers had not finished indexing across the board.

#8 — June 11, 2006 @ 22:02PM — Bob teh first [URL]

Google has more than one server, each of which has slightly different pages index. It takes a while for a page to be added to every single server. It doesn't really mean anything similar.

#9 — June 11, 2006 @ 22:37PM — Search Engines WEB [URL]

On the blog of a well known Google Software Engineer, it was indicated that Google DOES manually remove sites discovered by those in their Search Quality team that they deem to be either Spam or using tactics that violate Webmaster guidelines,

Many of them read blogs and forums regularly to keep abreast of news and strategies.

#10 — June 12, 2006 @ 01:26AM — marahmarie [URL]

I viewed source for the page you lost your Goog listing for and this one and noticed you're missing a robots.txt file on both. The robots.txt file gives Goog info that tells it how to crawl your site and specific pages (no-follow means don't crawl it, follow means crawl it to Googlebot's content). Is this your site? If so, you might want to add robots.txt to the source code--if not, perhaps you may want to contact your site's administrator with this suggestion. Just a thought.

#11 — June 12, 2006 @ 11:35AM — Mr. Real Estate [URL]

If your website was created after 2004, you will have to update it more often to get the Google ranking you desire. It has nothing to do with Google's harddrives being full, but has everything to do with keeping the most relevant (most recently updated) at the top.

#12 — June 12, 2006 @ 16:04PM — vani [URL]

After getting indexed, your site might have triggered their spam control algorithm.

Its also important to get picked by their crawler soon after you publish the website. Its an accomplishment that you got picked up quickly because Yahoo is quicker in picking up new sites.

Anyways, You can no longer cheat saerch engines by spam linking your website.

My professor here recently met ask.com CEO who told him that history and ranking of a site that links you will be important to get good ranking.

So in near future, just like ads on popular TV shows, ads on popular websites will be more expensive.

check alexa for website rankings.

#13 — November 25, 2006 @ 07:13AM — Roy Caswell [URL]

I have two sub sites 'Big Bang or Big Illusion' and 'Is God the Universe? Revelations Revealed'. Both came top in Google and Yahoo just by entering key words from the title. Now they are nowhere to be found in Google although Yahoo still has them near the top. It is puzzling as to what has changed as far as Google is concerned.

#14 — January 19, 2007 @ 17:21PM — Holly Wild [URL]

My site has been affected as well. It still has a high ranking and is still indexed by Google but when i use the search terms it doesnt come up. It does come up under two search phrases in teh number one position. However it used to come up in the right places with the right keywords with all my phrases. Should i worry and make myself sick or will the site just come back soon...

#15 — March 7, 2007 @ 20:34PM — Zoo keeper [URL]

Duplicate content can be a real problem.

I had a 1st position google ranking site on a nice keyword, and by mistake uploaded an identical homepage (index.html) to another one of my websites.

As a result my high ranking website went down to 90th place on the same keyword.

#16 — November 24, 2007 @ 17:24PM — damn [URL]

i don't like google either. i will if i get a btr pr.

#17 — September 3, 2008 @ 12:12PM — Slipper [URL]

Same happen to me, that's why i googling to see any other having the same fate as me. It's quite sad that my bloody work and creativity been vanished by the search engine. Anyway, i do think there's a reason to answer this. Appreciate if anyone can share me the tips.

#18 — September 28, 2008 @ 19:49PM — web [URL]

Can someone please tell me why my website page ranks keeps alternating between pr3 and pr4

Want comments emailed to you? No spam, promise! Address:

Add your comment, speak your mind

(Or ping: http://blogcritics.org/mt/tb/49088)

Personal attacks are not allowed. Please read our comment policy.





Remember Name/URL?

Please preview your comment!

Fresh
Articles
Fresh
Comments