Google Has Dropped My Page From Their Index
Published June 11, 2006
I recently published an article on my website. It was titled "Digg vs IndianPad," and it was a humorous assessment of the difference between the two websites. Everyone is familiar with Digg, but many people may not be familiar with IndianPad. But don't worry, you are not missing much if you do not know anything about it. It's a Digg clone and is supposed to be for news items relevant to southeast Asia.
Well, after a few days, I Googled "digg vs indianpad" to see if anybody had any similar pieces written. To my surprise, my website appeared at the top of the search result. I was so excited. I thought finally I had a masterpiece written and that I would probably get inundated with traffic and make a ton of money from the ads. Well, neither of these things happened. I consoled myself by saying that it was okay, no big deal. I guess lots of people search on digg and some people search on IndianPad. But how many people will be searching on "digg vs indianpad"? Not many, I thought.
After a few days, I searched again on the same phrase. This time, however, I did not see my webpage at the top. In fact, my webpage was not in the search results at all. I scrolled down, went to the second page, third page, and so on. No, it was nowhere to be found. As I dug deeper, I found that the entire webpage has been dropped from Google's index. It was very surprising. If it had not appeared there in the beginning, I could understand that Google simply hadn't gotten to it yet. But after indexing so quickly, the fact that the page got dropped entirely was very perplexing.
This got me thinking about what could cause this to happen. If you look at my writings on that page, you will actually find something interesting, in fact ironic. I put up a commentary about Google being too full and lagging behind in indexing a lot of webpages. This is not something I made up. This was an article published at The Register. It was argued in that article that Google's servers are just choking on web spam, leaving many webpages of legitimate content out of reach.
I made of fun of this fact and made satiric comments on how one can use this fact. Here is an excerpt below.
page 1 | 2
- Google Has Dropped My Page From Their Index
- Published: June 11, 2006
- Type: Opinion
- Section: Sci/Tech
- Filed Under: Sci/Tech: Blogging, Sci/Tech: Internet, Sci/Tech: Software
- Writer: Gautam Dev
- Gautam Dev's BC Writer page
- Gautam Dev's personal site
- Spread the Word
- Like this article?
- Email this
Save to del.icio.us
Comments
I just love it.. people who have absolutely no idea how search engines work put themselves on a position of "expert".
hahahha... getting unlisted because you mention spam? google relying mostly on "click rank"? guys... please... before you write another article... get some knowledge..
I can think of two situations:
You may be a victim of Google BigDaddy update.
Or
Such things are common with new websites on Google. What's the age of your site ?
Maybe wait for a couple of days and I am sure the page with popup again in the Google search results.
That doesn't explain why the page was removed from the search completely though. It should just have dropped in relevance and been on the second, third, etc. page.
I agree with ka it doesn't depend on click rank with google. I think yahoo works like that. I am no expert on the search engines though.
I seem to like Amit's suggestion on the 'Google BigDaddy' conecpt. This webpage is brand new. I just started it a month ago.
I think that the problem is related to the fact that there are several servers indexing and serving the pages and they are not in sync. When we do a query is not the same server that gives the answer.
You dropped in the SERPs because of the duplicate content, or as said before, the servers had not finished indexing across the board.
Google has more than one server, each of which has slightly different pages index. It takes a while for a page to be added to every single server. It doesn't really mean anything similar.
On the blog of a well known Google Software Engineer, it was indicated that Google DOES manually remove sites discovered by those in their Search Quality team that they deem to be either Spam or using tactics that violate Webmaster guidelines,
Many of them read blogs and forums regularly to keep abreast of news and strategies.
I viewed source for the page you lost your Goog listing for and this one and noticed you're missing a robots.txt file on both. The robots.txt file gives Goog info that tells it how to crawl your site and specific pages (no-follow means don't crawl it, follow means crawl it to Googlebot's content). Is this your site? If so, you might want to add robots.txt to the source code--if not, perhaps you may want to contact your site's administrator with this suggestion. Just a thought.
If your website was created after 2004, you will have to update it more often to get the Google ranking you desire. It has nothing to do with Google's harddrives being full, but has everything to do with keeping the most relevant (most recently updated) at the top.
After getting indexed, your site might have triggered their spam control algorithm.
Its also important to get picked by their crawler soon after you publish the website. Its an accomplishment that you got picked up quickly because Yahoo is quicker in picking up new sites.
Anyways, You can no longer cheat saerch engines by spam linking your website.
My professor here recently met ask.com CEO who told him that history and ranking of a site that links you will be important to get good ranking.
So in near future, just like ads on popular TV shows, ads on popular websites will be more expensive.
check alexa for website rankings.
I have two sub sites 'Big Bang or Big Illusion' and 'Is God the Universe? Revelations Revealed'. Both came top in Google and Yahoo just by entering key words from the title. Now they are nowhere to be found in Google although Yahoo still has them near the top. It is puzzling as to what has changed as far as Google is concerned.
My site has been affected as well. It still has a high ranking and is still indexed by Google but when i use the search terms it doesnt come up. It does come up under two search phrases in teh number one position. However it used to come up in the right places with the right keywords with all my phrases. Should i worry and make myself sick or will the site just come back soon...
Duplicate content can be a real problem.
I had a 1st position google ranking site on a nice keyword, and by mistake uploaded an identical homepage (index.html) to another one of my websites.
As a result my high ranking website went down to 90th place on the same keyword.
Same happen to me, that's why i googling to see any other having the same fate as me. It's quite sad that my bloody work and creativity been vanished by the search engine. Anyway, i do think there's a reason to answer this. Appreciate if anyone can share me the tips.
Can someone please tell me why my website page ranks keeps alternating between pr3 and pr4





this happened to me. It does it because it returns the most relevant results, which it determines by number of clicks.
I had written an article on dialidol.com, whenever you did a search for dialidol.com, my article was the first thing that showed up (after the site itself) for about two weeks, then it slipped to number three and now it's way down.
That is because when I appeared at the top, many people were clicking on it, to move me up the list. These same people were still searching for dialidol.com articles two weeks later, but had already read mine, so were clicking on links farther down the list. This caused mine to fall from the number '1' spot. That's my understanding of how it works.