Sunday, September 9, 2007

How to Penetrate and Search the Invisible Web

For most of our online activities, a general search engine like Google does the trick. But when researching obscure or complicated topics, being able to effectively penetrate the invisible web will take you places no automated web crawler ever could.
What is the invisible web?
The invisible web (also known as the "deep" or "hidden" web) is the term ascribed to the vast amount of information stored online that is inaccessible to regular search engines. This is mostly stored in databases and alternative file formats, as opposed to basic, public html websites. It is, by some estimates, 500 times bigger than the "visible" web. In other words, when you search using MSN or Yahoo, you're only drawing from 1/500th of the content out there. This leaves a lot to explor View the rest of this article


No comments: