This post originated from an RSS feed registered with Ruby Buzz by Eigen Class. Original Post: Na��ve suffix array search engine vs. Ferret vs. Lucene Feed Title: Eigenclass Feed URL: http://feeds.feedburner.com/eigenclass Feed Description: Ruby stuff --- trying to stay away from triviality. Latest Ruby Buzz Posts Latest Ruby Buzz Posts by Eigen Class Latest Posts From Eigenclass

Motivated by this performance comparison of Montezuma vs. Ferret and Lucene, I tried to see how my toyish full-text search engine based on suffix arrays fares against Ferret:

If the relative performance between Ferret and Lucene shown in the Montezuma benchmark holds, my toy engine is about 2x faster than Lucene when indexing small corpora.

Here are the scripts I used (taken from Ferret's wiki):

• ferret-indexing-benchmark.rb
• indexer-reuters.rb
• reuters-extraction.rb
• Corpus: Reuters 21578

Searching