Why Does Google Return Thousands More Results Than Webcrawler with the Words, "Gas Prices"?

How a Simple Search Regarding the Words, Gas Prices, Brought Up an Interesting Question

Sarah Holmes
Tonight as I was browsing the web, I typed in two very innocent words, "gas prices". I typed it into Webcrawler and to my dismay I only received 3 pages of results. I have an article about gas prices and this article was no where to be found within the results. Yet, when I typed in Associated Content to find out if the Webcrawler bot was search Associated Content's website, the website did show up.

I am absolutely amazed and stunned. Up until this moment, Webcrawler has always been my favorite browser. Although in recent months, I have noticed that I need to search Google to find the content results I am want. However, I haven't realized until now why this might be the case. For the simple search term "gas prices", Webcrawler brought up 3 pages and 56 results 3 minutes ago. When I typed it in again (just now), I received 4 pages and 77 results. This is very minor and my article about Gas Prices Worldwide was NOWHERE within the results.

Interestingly enough, the same search phrase when typed into the Google search engine, the words "Gas Prices" bring up 37 million results (37,600,000 to be exact). My thoughts are now wandering to why this might be? Does anyone know why Google brings up so many more pages? What is the differences between the way the Webcrawler spider crawls compared to the way the Google spider crawls? Perhaps there is someone reading this who can reveal why this is currently happening. I would love to know. I know it takes a minute of your time, but a well placed comment on this article explaining why this happened to me would be tremendously appreciated.

Should I switch to Google? My guess is that the all resounding answer will be yes. However, until today I did not realize that I would get a lot more results by visiting Google's search engine compared to doing a simple search using Webcrawler. It is amazing to me that there is such an incredible difference. A popular term like "gas prices" should receive LOTS and LOTS of results. How come Webcrawler only brings up 77 with the current gas price crunch amazes and baffles me. How can I get Webcrawler to notice and spider my article? Do I need to manually submit my article to the Webcrawler bot in order for it to recognize it? What is up with Webcrawler?

Please answer my question if you know the answer. I would greatly appreciate it. As a return favor, I will take a look at some of the article or articles you have written and perhaps even comment on them (if you want comments of course). Thank-you for taking the time to answer my question and relieve my wonderings. (I know wonderings is not a word...but it should be.)

May you have a blessed day or evening, and may you find better results on Webcrawler than I did when I searched, "gas prices"!

Published by Sarah Holmes

Sarah is a weekly columnist for the News-Gazette. She enjoys writing about various topics including SEO, internet marketing, social networking and saving money on groceries.  View profile

2 Comments

Post a Comment
  • Lisa Curcio3/3/2009

    =)

  • theBarefoot2/3/2009

    Not a complete answer but this might help http://www.bruceclay.com/searchenginerelationshipchart.htm. Search engines are a complex incestuous family.

Displaying Comments

To comment, please sign in to your Yahoo! account, or sign up for a new account.