topic Lucene and stop words in Alfresco in Alfresco Archive https://connect.hyland.com/t5/alfresco-archive/lucene-and-stop-words-in-alfresco/m-p/141008#M98777 <HTML><HEAD></HEAD><BODY><SPAN>Dear list,</SPAN><BR /><BR /><SPAN>Suppose I have a text document in Alfresco containing the phrase "time is money". I want users to be able to enter "money is time" and find the document. That is, I want to find all documents that contain all the words the user enters, in any order.</SPAN><BR /><BR /><SPAN>Reading </SPAN><A href="http://wiki.alfresco.com/wiki/Search#Finding_nodes_by_content" rel="nofollow noopener noreferrer">Alfresco's Search documentation</A><SPAN> I could not find a way to formulate a query for this.</SPAN><BR /><BR /><SPAN>Maybe I am missing something?! If so, apologies!</SPAN><BR /><BR /><SPAN>Here comes what I have found out:</SPAN><BR /><BR /><SPAN>The query</SPAN><BR /><PRE class="language-none line-numbers"><CODE>TEXT:"money is time"<SPAN class="line-numbers-rows"><SPAN>‍</SPAN></SPAN></CODE></PRE><SPAN>internally drops the stopword "is" and therefore searches for "money" followed by one or more stop words followed y "time" and will therefore NOT match.</SPAN><BR /><BR /><SPAN>The query</SPAN><BR /><PRE class="language-none line-numbers"><CODE>TEXT:"money" AND TEXT:"is" AND TEXT:"time"<SPAN class="line-numbers-rows"><SPAN>‍</SPAN></SPAN></CODE></PRE><SPAN>searches for all documents containing the three words "money", "is", and "time". As "is" is a stop word, it does not occur in the index and therefore the query returns NO result.</SPAN><BR /><BR /><SPAN>The query</SPAN><BR /><PRE class="language-none line-numbers"><CODE>TEXT:"money" AND TEXT:"time"<SPAN class="line-numbers-rows"><SPAN>‍</SPAN></SPAN></CODE></PRE><SPAN>searches for all documents containing the two words "money" and "time". It finds the document …</SPAN><BR /><BR /><SPAN>… however, I cannot easily generate this query as it requires me to drop all words that Alfresco's analyzer considers stop words.</SPAN><BR /><BR /><SPAN>Is there another way to perform a query for all documents containing a given set of words (possibly including stop words)?</SPAN><BR /><BR /><SPAN>If not, I see two ways out:</SPAN><BR /><BR /><SPAN>* Alfresco exposes the list of stop words (not nice).</SPAN><BR /><SPAN>* Alfresco's query parser recognizes stop words and handles them accordingly. (It would drop the clause 'AND TEXT:"is"' from the query 'TEXT:"money" AND TEXT:"is" AND TEXT:"time"' for example.)</SPAN><BR /><BR /><SPAN>Many thanks,</SPAN><BR /><SPAN>Kaspar</SPAN><BR /><BR /><SPAN>P.S. This question is Lucene related. However, I post it here and not to the Lucene mailing list as it depends on Alfresco's particular Lucene adaption. Not knowing the details, I might be wrong, of course.</SPAN></BODY></HTML> Sun, 30 Dec 2007 14:19:01 GMT hbf 2007-12-30T14:19:01Z Lucene and stop words in Alfresco https://connect.hyland.com/t5/alfresco-archive/lucene-and-stop-words-in-alfresco/m-p/141008#M98777 Dear list,Suppose I have a text document in Alfresco containing the phrase "time is money". I want users to be able to enter "money is time" and find the document. That is, I want to find all documents that contain all the words the user enters, in any order.Reading Alfresco's Search documentation I Sun, 30 Dec 2007 14:19:01 GMT https://connect.hyland.com/t5/alfresco-archive/lucene-and-stop-words-in-alfresco/m-p/141008#M98777 hbf 2007-12-30T14:19:01Z Re: Lucene and stop words in Alfresco https://connect.hyland.com/t5/alfresco-archive/lucene-and-stop-words-in-alfresco/m-p/141009#M98778 <HTML><HEAD></HEAD><BODY><SPAN>(For those who need a temporary fix (like me): the stop-words Alfresco is using seem to be in file AlfrescoStandardAnalyser.java. My code reads them and drops all stop-words from the query. Not nice, but works.)</SPAN></BODY></HTML> Sun, 30 Dec 2007 14:42:39 GMT https://connect.hyland.com/t5/alfresco-archive/lucene-and-stop-words-in-alfresco/m-p/141009#M98778 hbf 2007-12-30T14:42:39Z Re: Lucene and stop words in Alfresco https://connect.hyland.com/t5/alfresco-archive/lucene-and-stop-words-in-alfresco/m-p/141010#M98779 <HTML><HEAD></HEAD><BODY><SPAN>Hi</SPAN><BR /><BR /><SPAN>Alfresco supports the standard lucene query syntax so you can write proximity queries (but not span queries). See </SPAN><A href="http://lucene.apache.org/java/2_1_0/queryparsersyntax.html#Proximity%20Searches" rel="nofollow noopener noreferrer">http://lucene.apache.org/java/2_1_0/queryparsersyntax.html#Proximity%20Searches</A><BR /><BR /><SPAN>Andy</SPAN></BODY></HTML> Mon, 28 Jan 2008 16:31:52 GMT https://connect.hyland.com/t5/alfresco-archive/lucene-and-stop-words-in-alfresco/m-p/141010#M98779 andy 2008-01-28T16:31:52Z Re: Lucene and stop words in Alfresco https://connect.hyland.com/t5/alfresco-archive/lucene-and-stop-words-in-alfresco/m-p/141011#M98780 <HTML><HEAD></HEAD><BODY><SPAN>Hm, thanks for the hint, Andy, it seems to me, however, that this does not solve the problem entirely.</SPAN><BR /><BR /><SPAN>If you want to create a custom "Advanced Search" page for Alfresco where they can enter arbitrary words (see my examples in the previous post), you are forced to know the stop word list (from AlfrescoStandardAnalyser). That creates a dependency which is not nice at all.</SPAN><BR /><BR /><SPAN>I use Alfresco as the backend engine for a CMS, so I find myself exactly in this situation. Assuming I am not the only who will/does do something like this, do you want me to open a JIRA for this?</SPAN><BR /><BR /><SPAN>Regards,</SPAN><BR /><SPAN>Kaspar</SPAN></BODY></HTML> Mon, 28 Jan 2008 16:44:38 GMT https://connect.hyland.com/t5/alfresco-archive/lucene-and-stop-words-in-alfresco/m-p/141011#M98780 hbf 2008-01-28T16:44:38Z Re: Lucene and stop words in Alfresco https://connect.hyland.com/t5/alfresco-archive/lucene-and-stop-words-in-alfresco/m-p/141012#M98781 <HTML><HEAD></HEAD><BODY><SPAN>Hi</SPAN><BR /><BR /><SPAN>You could use a customized version of the analayser and set an empty stop word list. This way there will be no stop words. It is a simple wrapper class and change to the tokenisation config.</SPAN><BR /><BR /><SPAN>Andy</SPAN></BODY></HTML> Thu, 07 Feb 2008 17:04:18 GMT https://connect.hyland.com/t5/alfresco-archive/lucene-and-stop-words-in-alfresco/m-p/141012#M98781 andy 2008-02-07T17:04:18Z