topic CMIS query performance slow - Solr index improvement? in Alfresco Forum

CMIS query performance slow - Solr index improvement?

sepgs2004 — Mon, 17 Sep 2018 15:32:16 GMT

This problem is experienced with Alfresco 6.0 (could be in Alfresco 5.2 as well). I do not know how much the version matters to this issue.I have a custom model defined. This mode has a custom type and it has a custom aspect with a set of properties.We use CMIS API to communicate with the repository

Re: CMIS query performance slow - Solr index improvement?

afaust — Mon, 17 Sep 2018 20:45:39 GMT

What is the page size you are requesting for this CMIS query? Have you already set the logger for the SolrQueryHTTPClient class to debug and checked the logs if the long query duration actually originates from the SOLR query call? Do you use dynamic authorities in any of your customisations/extensions, which can indrectly cause some ACL check optimisations to be disbabled?

The use of IN_TREE is not necessarily "improper". It is a valid selector. Though if you only need to find documents directly in that folder, and not in any sub-folders, then IN_TREE could be replaced by IN_FOLDER, which would allow the query to execute via DB instead of SOLR. But bear in mind that executing a query against the DB is not necessarily faster than when executed against SOLR. Performance depends on a lot of factors like DB index / statistics state, data selectivity etc. For larger data sets, it is very likely that SOLR is faster more often than a DB query, since a DB query has to perform ACL checking as a post-filter step, causing additional DB interactions.

Re: CMIS query performance slow - Solr index improvement?

sepgs2004 — Mon, 17 Sep 2018 21:17:20 GMT

I do not do any page size. Typically, our folders would contains no more than 25 documents. We might have millions of folders, but inside a folder, we will not have more than 25 documents.

I will still do page size, if it is going to make a difference. Please let me know.

I will comment on other things shortly

Re: CMIS query performance slow - Solr index improvement?

gluck113 — Thu, 02 May 2019 07:52:17 GMT

Hi,

First something I would challenge, do you really need to retrieve all the Metadata fields of your documents with

doc.*, slo.*

That can be a lot of fields to gather. Try to tailor the query to your needs.

Second part I would look at is your CMIS Operation Context, do you really need the document relationships, actions (we had a 50% gain when deactivating this particular option), ACL and so on?

Hope this helps some out