lucene configuration

[frandepaula]

Hi,

Im runnig Alfresco 2.0.0 on a Red Hat Enterprise 4 and i think i have a problem whit my lucene configuration. This is the log with the problem

2007-10-18 16:25:07,774 ERROR [org.alfresco.util.transaction.SpringAwareUserTransaction] Transaction didn't commit
org.alfresco.repo.search.IndexerException: Failed to prepare: requires rollback
   at org.alfresco.repo.search.impl.lucene.LuceneIndexerAndSearcherFactory2.prepare(LuceneIndexerAndSearcherFactory2.java:711)
   at org.alfresco.repo.transaction.AlfrescoTransactionSupport$TransactionSynchronizationImpl.beforeCommit(AlfrescoTransactionSupport.java:599)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.triggerBeforeCommit(AbstractPlatformTransactionManager.java:657)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:482)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:469)
   at org.springframework.transaction.interceptor.TransactionAspectSupport.doCommitTransactionAfterReturning(TransactionAspectSupport.java:266)
   at org.alfresco.util.transaction.SpringAwareUserTransaction.commit(SpringAwareUserTransaction.java:405)
   at org.alfresco.web.bean.dialog.BaseDialogBean.finish(BaseDialogBean.java:118)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:585)
   at org.apache.myfaces.el.MethodBindingImpl.invoke(MethodBindingImpl.java:129)
   at org.apache.myfaces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:63)
   at org.apache.struts.faces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:137)
   at javax.faces.component.UICommand.broadcast(UICommand.java:106)
   at javax.faces.component.UIViewRoot._broadcastForPhase(UIViewRoot.java:90)
   at javax.faces.component.UIViewRoot.processApplication(UIViewRoot.java:164)
   at org.apache.myfaces.lifecycle.LifecycleImpl.invokeApplication(LifecycleImpl.java:316)
   at org.apache.myfaces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:86)
   at javax.faces.webapp.FacesServlet.service(FacesServlet.java:105)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
   at org.alfresco.web.app.servlet.AuthenticationFilter.doFilter(AuthenticationFilter.java:81)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
   at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
   at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
   at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
   at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:175)
   at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:74)
   at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
   at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
   at org.jboss.web.tomcat.tc5.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:156)
   at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
   at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
   at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
   at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
   at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
   at org.apache.tomcat.util.net.MasterSlaveWorkerThread.run(MasterSlaveWorkerThread.java:112)
   at java.lang.Thread.run(Thread.java:595)
Caused by: org.alfresco.repo.search.impl.lucene.LuceneIndexException: Index failed to prepare
   at org.alfresco.repo.search.impl.lucene.LuceneIndexerImpl2.prepare(LuceneIndexerImpl2.java:748)
   at org.alfresco.repo.search.impl.lucene.LuceneIndexerAndSearcherFactory2.prepare(LuceneIndexerAndSearcherFactory2.java:706)
   … 42 more
Caused by: org.alfresco.repo.search.impl.lucene.LuceneIndexException: Failed to flush index
   at org.alfresco.repo.search.impl.lucene.LuceneIndexerImpl2.flushPending(LuceneIndexerImpl2.java:967)
   at org.alfresco.repo.search.impl.lucene.LuceneIndexerImpl2.prepare(LuceneIndexerImpl2.java:732)
   … 43 more
Caused by: java.io.IOException: Cannot create directory: /var/alfresco/lucene-indexes/workspace/SpacesStore/ec90fec4-7d85-11dc-91dc-55b86f1cf9a1
   at org.apache.lucene.store.FSDirectory.create(FSDirectory.java:196)
   at org.apache.lucene.store.FSDirectory.init(FSDirectory.java:186)
   at org.apache.lucene.store.FSDirectory.getDirectory(FSDirectory.java:145)
   at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:224)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.makeDeltaIndexWriter(IndexInfo.java:702)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo.getDeltaIndexWriter(IndexInfo.java:743)
   at org.alfresco.repo.search.impl.lucene.LuceneBase2.getDeltaWriter(LuceneBase2.java:218)
   at org.alfresco.repo.search.impl.lucene.LuceneIndexerImpl2.indexImpl(LuceneIndexerImpl2.java:1164)
   at org.alfresco.repo.search.impl.lucene.LuceneIndexerImpl2.indexImpl(LuceneIndexerImpl2.java:1158)
   at org.alfresco.repo.search.impl.lucene.LuceneIndexerImpl2.flushPending(LuceneIndexerImpl2.java:961)
   … 44 more

I have discovered that the folder /var/alfresco/lucene-indexes/workspace/SpacesStore has 32.000 folders inside. This is the limit of my SO to create files into a folder, and i can´t create more folders. Can you tell me how i have to configure lucene to reduce that number of folders please?

Thanks

[andy]

Hi

This is very unusual. Have you got the indexes stored on a local disk - not over NFS or anything like it.

Can you describe how you got into this state? How do you access the repo most of the time? How many docs etc.

You can rebuild the indexes to resolve this.

Does starting and stopping the repo make any difference to the folder count?

Andy