For sometime I have been playing around with information retrieval tools with the basic requirement that creating my own APIs through extension would be easy. Another requirement is that the existing documentation should be near complete. Take a look at Xapian for those who want the same thing. Here is a sample code of the indexer. Mind you that this is highly simplified. Sometime later would start playing around with Lucene.
Current reading list includes stuff on this.