Contrôle de la tokenisation des propriétés dans lucene

[jservajean]

Mon content model est réglé par défaut, à savoir que la propriété cm:name est paramétrée de telle sorte que la tokenization est censée s'effectuer et que l'indexation de la propriété dans son ensemble (chaine de caractères) aussi :

<index enabled="true">
   <atomic>true</atomic>
   <stored>false</stored> 
   <tokenised>both</tokenised>
</index>
‍‍‍‍‍‍‍

Lors de l'ajout d'un fichier avec un nom contenant des espaces, par exemple "PS-200 Total Acces.doc", le fichier n'est trouvable que sur le premier token "PS-200" et non pas "Acces" ou "Acces.doc" :

@cm\:name:"PS-200" // renvoie tous les fichiers commençant par "PS-200", y compris "PS-200 Total Acces.doc"
@cm\:name:"Acces" // ne renvoie rien
@cm\:name:"Acces.doc" // ne renvoie rien
‍‍‍‍‍

J'ai l'impression d'être sur un configuration où seul le premier token est indéxé.

Peut-on contrôler le nombre de tokens pris en compte par lucene lors de l'indexation ?

Merci

[rguinot]

double post ici : http://forums.alfresco.com/fr/forum/d%C3%A9veloppement/webscripts-javascript-surf/la-recherche-lucen....
Pas la peine de double poster.

[shiv_liferay]

Am using  Liferay Version: 6.1 GA1 and added documents above 1700

May 22, 2013 11:23:08:020 ERROR [LuceneHelperImpl:215] org.apache.lucene.search.BooleanQuery$TooManyClauses: maxClauseCount is set to 1024
org.apache.lucene.search.BooleanQuery$TooManyClauses: maxClauseCount is set to 1024
   at org.apache.lucene.search.BooleanQuery.add(BooleanQuery.java:152)
   at org.apache.lucene.search.BooleanQuery.add(BooleanQuery.java:143)
   at com.liferay.portal.search.lucene.LuceneHelperImpl._includeIfUnique(LuceneHelperImpl.java:762)
   at com.liferay.portal.search.lucene.LuceneHelperImpl._includeIfUnique(LuceneHelperImpl.java:770)
   at com.liferay.portal.search.lucene.LuceneHelperImpl.addTerm(LuceneHelperImpl.java:212)
   at com.liferay.portal.search.lucene.LuceneHelperImpl.addTerm(LuceneHelperImpl.java:171)
   at com.liferay.portal.search.lucene.LuceneHelperUtil.addTerm(LuceneHelperUtil.java:268)
   at com.liferay.portal.search.lucene.BooleanQueryImpl.addTerm(BooleanQueryImpl.java:234)
   at com.liferay.portal.kernel.search.BaseIndexer.addSearchTerm(BaseIndexer.java:649)
   at com.liferay.portlet.journal.util.JournalIndexer.postProcessSearchQuery(JournalIndexer.java:134)
   at com.liferay.portal.kernel.search.FacetedSearcher.createFullQuery(FacetedSearcher.java:177)
   at com.liferay.portal.kernel.search.FacetedSearcher.search(FacetedSearcher.java:75)
   at org.apache.jsp.html.portlet.search.search_jsp._jspService(search_jsp.java:1118)
   at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
   at com.liferay.portal.kernel.servlet.DirectRequestDispatcher.include(DirectRequestDispatcher.java:45)
   at com.liferay.taglib.util.IncludeTag.include(IncludeTag.java:323)
   at com.liferay.taglib.util.IncludeTag._doInclude(IncludeTag.java:418)
   at com.liferay.taglib.util.IncludeTag.doEndTag(IncludeTag.java:92)
   at org.apache.jsp.html.common.themes.portlet_jsp._jspService(portlet_jsp.java:4617)
   at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
   at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:432)
   at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:390)
   at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:334)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:72)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:116)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilter.doFilter(InvokerFilter.java:71)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
   at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:684)
   at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:593)
   at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:530)
   at com.liferay.portlet.PortletRequestDispatcherImpl.dispatch(PortletRequestDispatcherImpl.java:316)
   at com.liferay.portlet.PortletRequestDispatcherImpl.include(PortletRequestDispatcherImpl.java:120)
   at com.liferay.portal.struts.PortletRequestProcessor.doInclude(PortletRequestProcessor.java:363)
   at com.liferay.portal.struts.PortletRequestProcessor.doForward(PortletRequestProcessor.java:333)
   at org.apache.struts.tiles.TilesRequestProcessor.processTilesDefinition(TilesRequestProcessor.java:239)
   at org.apache.struts.tiles.TilesRequestProcessor.internalModuleRelativeForward(TilesRequestProcessor.java:341)
   at org.apache.struts.action.RequestProcessor.processForward(RequestProcessor.java:572)
   at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:221)
   at com.liferay.portal.struts.PortletRequestProcessor.process(PortletRequestProcessor.java:230)
   at com.liferay.portlet.StrutsPortlet.include(StrutsPortlet.java:239)
   at com.liferay.portlet.StrutsPortlet.doView(StrutsPortlet.java:152)
   at com.liferay.portal.kernel.portlet.LiferayPortlet.doDispatch(LiferayPortlet.java:211)
   at javax.portlet.GenericPortlet.render(GenericPortlet.java:233)
   at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:100)
   at com.liferay.portal.kernel.portlet.PortletFilterUtil.doFilter(PortletFilterUtil.java:64)
   at com.liferay.portlet.InvokerPortletImpl.invoke(InvokerPortletImpl.java:651)
   at com.liferay.portlet.InvokerPortletImpl.invokeRender(InvokerPortletImpl.java:722)
   at com.liferay.portlet.InvokerPortletImpl.render(InvokerPortletImpl.java:426)
   at org.apache.jsp.html.portal.render_005fportlet_jsp._jspService(render_005fportlet_jsp.java:1204)
   at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
   at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:432)
   at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:390)
   at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:334)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:72)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:116)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilter.doFilter(InvokerFilter.java:71)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
   at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:684)
   at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:593)
   at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:530)
   at com.liferay.portal.util.PortalImpl.renderPortlet(PortalImpl.java:4984)
   at com.liferay.portal.util.PortalUtil.renderPortlet(PortalUtil.java:1508)
   at com.liferay.portlet.layoutconfiguration.util.RuntimePortletImpl.processPortlet(RuntimePortletImpl.java:187)
   at com.liferay.portlet.layoutconfiguration.util.RuntimePortletImpl.processPortlet(RuntimePortletImpl.java:122)
   at com.liferay.portlet.layoutconfiguration.util.RuntimePortletImpl.processTemplate(RuntimePortletImpl.java:309)
   at com.liferay.portlet.layoutconfiguration.util.RuntimePortletImpl.processTemplate(RuntimePortletImpl.java:234)
   at com.liferay.portlet.layoutconfiguration.util.RuntimePortletUtil.processTemplate(RuntimePortletUtil.java:110)
   at org.apache.jsp.html.portal.layout.view.portlet_jsp._jspService(portlet_jsp.java:512)
   at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
   at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:432)
   at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:390)
   at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:334)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:72)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:116)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilter.doFilter(InvokerFilter.java:71)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
   at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:684)
   at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:593)
   at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:530)
   at com.liferay.portal.action.LayoutAction.includeLayoutContent(LayoutAction.java:414)
   at com.liferay.portal.action.LayoutAction.processLayout(LayoutAction.java:682)
   at com.liferay.portal.action.LayoutAction.execute(LayoutAction.java:246)
   at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:431)
   at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:236)
   at com.liferay.portal.struts.PortalRequestProcessor.process(PortalRequestProcessor.java:174)
   at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1196)
   at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:414)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
   at com.liferay.portal.servlet.MainServlet.callParentService(MainServlet.java:538)
   at com.liferay.portal.servlet.MainServlet.service(MainServlet.java:515)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:72)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:116)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:116)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:116)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:116)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:116)
   at com.liferay.portal.kernel.servlet.BaseFilter.processFilter(BaseFilter.java:158)
   at com.liferay.portal.servlet.filters.secure.SecureFilter.processFilter(SecureFilter.java:289)
   at com.liferay.portal.kernel.servlet.BaseFilter.doFilter(BaseFilter.java:55)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.processDoFilter(InvokerFilterChain.java:206)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:108)
   at com.liferay.portal.kernel.servlet.BaseFilter.processFilter(BaseFilter.java:158)
   at com.liferay.portal.servlet.filters.autologin.AutoLoginFilter.processFilter(AutoLoginFilter.java:247)
   at com.liferay.portal.kernel.servlet.BaseFilter.doFilter(BaseFilter.java:55)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.processDoFilter(InvokerFilterChain.java:206)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:108)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilter.doFilter(InvokerFilter.java:71)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
   at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:684)
   at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:471)
   at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:402)
   at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:329)
   at com.liferay.portal.servlet.FriendlyURLServlet.service(FriendlyURLServlet.java:135)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:72)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:116)
   at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:116)
   at com.liferay.portal.kernel.servlet.BaseFilter.processFilter(BaseFilter.java:158)
   at com.liferay.portal.servlet.filters.strip.StripFilter.processFilter(StripFilter.java:304)