topic Re: request for solr 6 / search services troubleshooting advice in Alfresco Forum

request for solr 6 / search services troubleshooting advice

dbiggins — Thu, 05 Apr 2018 20:40:03 GMT

What is a good way to troubleshoot the solr 6 database deployed with the Alfresco Search services 1.1.0?I am using Alfresco Community 201707EA version with a Linux / postgres config , and originally was using the solr4 that was deployed by default. My repository has approx 70K PDFs, and had a 7Gb '

Re: request for solr 6 / search services troubleshooting advice

cesarista — Fri, 06 Apr 2018 08:10:04 GMT

Hi:

To force a reindex, the procedure is somehow similar, but in the new directory structure of Alfresco Search Services:

- Performing a full reindex with Solr for Alfresco ECM - zylk

You may monitor the indexation process in OOTB Support Tools page (SOLR page), and also in SOLR 6 logs enabling the corresponding loggers in SOLR 6 Admin interface.

Finally you may need to fix $SOLR_HOME/conf/shared.properties for enabling suggestable properties, and data types that support cross locales, which make you work in a similar config to SOLR4.

Installing and configuring Solr 6 without SSL | Alfresco Documentation (point 3)

Regards.

--C.

Re: request for solr 6 / search services troubleshooting advice

dbiggins — Mon, 09 Apr 2018 13:15:48 GMT

Thanks for the list of directories to clear out! I was able to clear and restart solr, and the results looked much better. Based on the admin report generated by :

http://127.0.0.1:8983/solr/admin/cores?action=REPORT&wt=json

, I can see that

Count of missing transactions from the Index 0
Index transaction count 79931
Index unique transaction count 79931
Index node count 70593
Count of duplicate nodes in the index 0
Index error count 0
Count of duplicate error docs in the index 0
Index unindexed count 10750

The total size of the solr 6 disk usage is 2.6Gb, which is smaller then the 7 Gb Solr 4 disk usage. I was expecting it to be larger with the fingerprint hash, but I will start to take a look closer. For instance, I have duplicate documents that aren't showing up as being the same or similar with the FTS fingerprint query. I suspect that something is not completing, but there are no info/warn/errors being posted in the solr or alfresco logs. Some documents have fingerprint results, but I'll start another thread with some specific Fingerprint-y questions.

Thanks for your help on forcing the solr 6 reset!

Dan

Re: request for solr 6 / search services troubleshooting advice

cesarista — Mon, 09 Apr 2018 13:28:39 GMT

Hi:

You should compare in terms of number of documents indexed.

But when doing it in terms of size, take into consideration that old deleted documents in SOLR 4 cores, may occupy in disk. When deleting a document in Alfresco, the index in SOLR is updated (not deleted). So many deletions or massive deletions, without a complete reindexation, may do increase your indices size.

Regards.

--C.

Re: request for solr 6 / search services troubleshooting advice

dbiggins — Mon, 09 Apr 2018 13:47:42 GMT

The comparison here would be: delete / reindex with solr4 and get a 7 Gb disk space Alfresco core size. Switch the index to solr 6 and similarly reindex the same content and get a 2.5 Gb core size. That strikes me as a little suspicious, but as you say, I am focusing on the wrong metric, and I should be comparing the index node count. Based on what I THINK is inconsistent Fingerprint behavior, I need to get some more specifics to ask better questions.

Thanks again!!