topic Re: Searching with polish stemmer in Alfresco Archive

Searching with polish stemmer

ddr — Tue, 24 Feb 2015 12:39:41 GMT

Hello, I'm trying to make my Alfresco to search in Polish.I'm using Alfresco 5.0c + Solr4. My stemmer is Morfologik. There is no dataTypeAnalyzers__{your locale}.properties in this version of Alfresco.I added filter to schema.xml file and I can use Morfologik in Solr, but Alfresco isn't indexing and

Re: Searching with polish stemmer

gravitonian — Thu, 26 Feb 2015 15:07:56 GMT

Hi,

Can you please show me how you added the polish filters to the schema.xml?

Also, note that it will only work for new content added after you updated the schema and restarted.

Re: Searching with polish stemmer

ddr — Fri, 27 Feb 2015 07:40:30 GMT

Hi,
I uploaded my schema.xml, could you check it?
I added Morfologik filter to oldStandardAnalysis and text___, also try to change dynamicFields to use text___.
I know that this will work only with new content, so I'm adding new file from Share or use Bulk Filesystem Import Tool and then I'm testing.

Re: Searching with polish stemmer

gravitonian — Tue, 17 Mar 2015 09:16:24 GMT

Hi,

Is there the possibility that you have to set dictionary as follows:


<filter class="solr.MorfologikFilterFactory" dictionary="MORFOLOGIK" />
‍‍‍

Re: Searching with polish stemmer

ddr — Wed, 18 Mar 2015 10:13:16 GMT

I have already tried that and it isn't working. I found in solr logs the dictionary is no longer needed. Any ideas?
Adding new filter to schema.xml should be enough for alfresco 5 to use it?

Re: Searching with polish stemmer

gravitonian — Thu, 26 Mar 2015 09:44:37 GMT

Hi,

I think you should use the following field type for your fields.


<fieldType name="alfrescoFieldType" class="org.alfresco.solr.AlfrescoFieldType" />
‍‍‍

It is working dynamically looking up the specific language field type (e.g. text_en, text_ru, text_pl).

Define a new polish field type looking something like this:


<!– Polish –>
      <fieldType name="text_pl" class="solr.TextField" positionIncrementGap="100">
        <analyzer> 
          <tokenizer class="solr.StandardTokenizerFactory"/>
          <filter class="solr.LowerCaseFilterFactory"/>
          <filter class="solr.StopFilterFactory" ignoreCase="true" words="lang/stopwords_pl.txt" />
          <filter class="solr.StempelPolishStemFilterFactory" language="Polish" />    
        </analyzer>
      </fieldType>
‍‍‍‍‍‍‍‍‍‍‍

Don't change anything else, if you change the field type for the fields to something else than AlfrescoFieldType you are effectivley turning off the dynamic language type lookup.