I'm looking for a search plugin (to replace or augment the default WP search), which is based on crawling my site (as an external user/spider would see the site), rather than just using Post/Page/Comment/etc database records.
The reason is that my site contains dynamically generated pages, with content built from an external DB. This content is not in the WP database itself (and cannot be incorporated into it). The only way to see the content is to browse my site's pages.
The only thing close is Sphider (or maybe Sphinx) search, but neither seem workable. Are those my best options? Can anyone refer me to a better option? (Google search is an option, but I don't want the ads.)