[Plugin: Relevanssi – A Better Search] Indexing timeout

pixelsailor
(@pixelsailor)

11 years, 11 months ago
We’ve got a large database (7000+ posts) and trying to use Relevanssi for obvious reasons. Problem is, indexing them is killing me. Initial index worked well enough. Got about 1600 entries indexed. Next round got about 500. Then it kept dropping from there. Past 3000 it’s become unusable. I’m now at 3400 and importing about 3 each go.

I updated .htaccess with
```
php_value max_execution_time 3600
php_value upload_max_filesize 100M
php_value post_max_size 220M
php_value memory_limit 256M
```
Doesn’t seem to be helping though. Any suggestions. As it is, this simply isn’t working. Does the premium version offer better indexing for large databases?

http://wordpress.org/extend/plugins/relevanssi/

Viewing 7 replies - 1 through 7 (of 7 total)

Plugin Author Mikko Saari
(@msaari)

11 years, 10 months ago

Yes, Premium has somewhat better indexing mechanism that uses a lot less INSERT queries. You might want to try that (and if it doesn’t work out, I’ll of course refund your money). That’s pretty bad problem you’re having – I haven’t noticed that kind of weakening of performance before, usually the indexing doesn’t slow down at all.

seand11
(@seand11)

11 years, 10 months ago

Same issue here… it seems to be the SELECTs and SELECT DISTINCTs rather than the INSERTS which are taking all the time:
http://wordpress.org/support/topic/plugin-relevanssi-a-better-search-index-sql-becomes-unbearable-after-500-posts

Plugin Author Mikko Saari
(@msaari)

11 years, 10 months ago

You might want to make sure there’s an index on the doc column of the wp_relevanssi database. There should be, but I’ve heard reports that the installation procedure does not add it.
seand11
(@seand11)

11 years, 10 months ago
doc did not have an index.
I have added one and will test.

Looking over the code I do not believe it is currently part of the table creation on install:
```
$sql = "CREATE TABLE " . $relevanssi_table . " (id mediumint(9) NOT NULL AUTO_INCREMENT, "
		. "doc bigint(20) NOT NULL, "
		. "term varchar(50) NOT NULL, "
		. "tf mediumint(9) NOT NULL DEFAULT '0', "
		. "title tinyint(1) NOT NULL, "
	    . "UNIQUE KEY id (id)) $charset_collate;";

		dbDelta($sql);

		$sql = "CREATE INDEX terms ON $relevanssi_table (term(20))";
```
Will let you know if any improvements.
Thanks!
seand11
(@seand11)

11 years, 10 months ago

That index (on doc) made all the difference in the world. Near instantaneous on 600+ posts with 15000+ comments. Thanks! 🙂

Plugin Author Mikko Saari
(@msaari)

11 years, 10 months ago

Great, thanks a lot for your help in catching this! Looks like an oversight on my part – I’ve probably simply forgotten to add it on the free version. The joys of maintaining two versions of the same code. I’ll make sure this is fixed in the 2.9.15 version.

seand11
(@seand11)

11 years, 10 months ago

Thanks for all your efforts and the killer plugin msaari. 🙂

Viewing 7 replies - 1 through 7 (of 7 total)

The topic ‘[Plugin: Relevanssi – A Better Search] Indexing timeout’ is closed to new replies.