Starting A New Search Engine From Scratch.

[James Quillian]

Does anyone know the basics of how a search engine is actually put together.
The first thing I need to know is how to make the simplest possible search engine like the ones that were used back in the mid 90s.

What equipment is needed? What other components are necessary?

What I don't need to know is why it is a bad idea and that the others are too big to compete with and on and on....

I know upfront that most ideas are bad and already have mountains input as to why it won't work. That is the nature of business.

[Wiz Feinberg]

I found the following relevant hits for building a search engine (web crawler):

• Bing results page
• A StackOverflow discussion about building a search engine
• The Apache Nutch web crawler project

These results should get you started.