topic Re: Lucene query and it's performance results in Alfresco Archive

Lucene query and it's performance results

kdejaeger — Fri, 16 May 2008 09:17:11 GMT

Hello,I don't understand the performance differences of the following queries.First we started of with this query (1) ATH:"/app:company_home/cm:A_Company/cm:A_Space//*" ‍This query (2) includes a custom property check and was equal in performanceATH:"/app:company_home/cm:A_Company/cm:A_Space//*"

Re: Lucene query and it's performance results

nyronian — Mon, 19 May 2008 14:16:28 GMT

I have no answer but that is very interesting. I do alot of custom searches where I use the Path quite a bit so I am very interested in this. Does anyone at Alfresco have the answers to this?

Re: Lucene query and it's performance results

pmonks — Mon, 19 May 2008 15:23:07 GMT

I'm by no means a Lucene expert, but wildcards always give me pause - that would be my guess as to why the queries that include the PATH field are slower.

Cheers,
Peter

Re: Lucene query and it's performance results

nyronian — Mon, 19 May 2008 17:40:40 GMT

Not to highjack the question kdejaeger but I have questions around it as well, hopefully my comments help as well.

I assume kdejaeger, the reason you are indicating a path is to find "invoices" of a particular company, not all invoices in the system.

I have the same issue, I am looking for content under a particular company, so I indicate the path. The * is only to to indicate looking for all children under the path. Otherwise you may have undesirable results and get nodes you do not wish.

Is there a another way to acheive the same results?

Re: Lucene query and it's performance results

kdejaeger — Tue, 20 May 2008 07:37:39 GMT

Yes nyronian, that's exactly why I need the path to be there. I somehow think that the //* is doing a slower xpath expansion. We need some professional advise here from an alfresco engineer to know how this gets treated. :wink:

Re: Lucene query and it's performance results

andy — Mon, 28 Jul 2008 19:52:01 GMT

Hi

If you let me nkow the version of Alfresco the explanation is different for older versions ….

Paths with //* do the structural query in two parts - the directory and then the leaves.
(it is too expensive to reindex a doc each time its parents structiure may change in lucene as you may do for structural queries using an XML database)

So /blah/blah//* finds all directories that match the path and then re-queries to find all children. The requery is ordered and about as good as it can gets, although not grouped which may help. It basically depends on the number of directories found.

Lucene shuffles which predicte is used to scan through the parts of a conjunctions. However, the PATH work is done up front so should not have any effect.
It is done for all of your queries.

So it is most likely you are seeing caching improvements to performance.

Do you queries either all cold or all warm (ignoring the first result and running each at least twice).
Other background processes can also have an efect.

Andy