topic Re: Stemming search in Alfresco Archive

Stemming search

javed_afroz — Thu, 16 Jan 2014 14:54:52 GMT

Hi,I was recently asked by my client to demonstrate stemming search in Alfresco. Does alfresco supports stemming? I was looking into the analyzers available and I found EnglishSnowballAnalyser available from datamodel package of alfresco and I changed analyzer setting for content in dataTypeAnalyzer

Re: Stemming search

abarisone — Thu, 16 Jan 2014 15:09:00 GMT

Hi,
I've found some resources about search stemming:
http://wiki.alfresco.com/wiki/Search
http://wiki.alfresco.com/wiki/Full-Text_Search_Configuration#Data_dictionary_options
https://forums.alfresco.com/forum/developer-discussions/other-apis/lucene-tokenization-09232009-1559

Hope these helps.
Regards,
Andrea

Re: Stemming search

javed_afroz — Fri, 17 Jan 2014 06:15:24 GMT

Hi,

Thanks, for quick reply. I have gone through those links but couldn't find much help. I wish to know if there is any configuration regarding stemming that I am missing here. Is alfresco stemming is disabled by default?

Thanks,

Re: Stemming search

javed_afroz — Tue, 21 Jan 2014 10:49:50 GMT

Knock, knock.. Is there nobody who can help me on this?

Thanks in advance..

Re: Stemming search

javed_afroz — Wed, 29 Jan 2014 14:19:02 GMT

Its been 13 days since I posted the topic, I thought Alfresco forum will be very helpful for this basic configuration issue. Still waiting

Thanks,
Javed

Re: Stemming search

mrogers — Wed, 29 Jan 2014 14:59:00 GMT

Yours is a specialized question and far from a "basic configuration issue".

I see issues like MNT-8502 which are testing stemming so clearly something is working. You shouldn't have to "configure" anything.

Re: Stemming search

javed_afroz — Thu, 30 Jan 2014 10:30:05 GMT

Hi,

I have gone through the issue you posted and it seems the guy was having a problem with multilingual stemming. I am looking for english stemming search. What I have is a default installation of Alfresco 4.0.e community on mysql. At the very first time when alfresco starts up I have added 3 file in company home folder with following texts:

1. Fished
2. Fisher
3. Fishing

Expected behavior is when I search for either of the three texts above, all of the three should show up, but Alfresco shows only 1 document with exact match. I have tried changing the analyzers in the dataTypeAnalyzers.properties to "EnglishSnowballAnalyzer" but of no use. I think Lucene supports stemming (Correct me if I am wrong). Does alfresco not supports stemming search?

Thanks,
Javed

Re: Stemming search

mrogers — Thu, 30 Jan 2014 12:21:26 GMT

It probably depends upon the search query you use. Simple search by name tends to use exact text matching since people don't expect the oddities of tokenisation on names.

Re: Stemming search

javed_afroz — Thu, 30 Jan 2014 15:35:37 GMT

I have tried it from Node Browser (using Lucene) as well with all the possible examples given in Alfreco FTS wiki (http://wiki.alfresco.com/wiki/Full_Text_Search_Query_Syntax) but same results are occurring and that is what made me think that I might missing something in config.

I have used - TEXT:Fished

Can you give some example of the query to evaluate alfresco stemming?

Thanks.