topic Indexing with SolR very long in Alfresco Archive https://connect.hyland.com/t5/alfresco-archive/indexing-with-solr-very-long/m-p/269403#M222533 <HTML><HEAD></HEAD><BODY><SPAN>Hello,</SPAN><BR /><BR /><SPAN>After Alfresco answer in JIRA ticket </SPAN><A href=" https://issues.alfresco.com/jira/browse/ALF-15546 " rel="nofollow noopener noreferrer"> https://issues.alfresco.com/jira/browse/ALF-15546 </A><SPAN>, I've installed SolR. For the moment, Alfresco is still using Lucene and SolR is indexing my store in background (this store is about 600 GB).</SPAN><BR /><BR /><SPAN>I've activated SolR logs and get messages like these:</SPAN><BR /><PRE class="language-none line-numbers"><CODE> 17-Nov-2011 11:22:45 org.alfresco.solr.tracker.CoreTracker trackRepository<BR />INFO: …. from Transaction [id = 374, = 1321528572425 commitTimeMs, updates = 1 deletes = 0]<BR />17-Nov-2011 11:22:45 org.alfresco.solr.tracker.CoreTracker trackRepository<BR />INFO: …. to Transaction [id = 374, = 1321528572425 commitTimeMs, updates = 1 deletes = 0] <SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN></CODE></PRE><BR /><SPAN>Indexing started Thursday night and it is still running.</SPAN><BR /><BR /><SPAN>To monitor indexing progress, I first get the total number of records in the alf_transaction table =&gt; </SPAN><STRONG> 1,351,872 </STRONG><SPAN>.</SPAN><BR /><SPAN>Then I use the "commitTimeMs" provided in the logs.</SPAN><BR /><SPAN>I got the commitTimeMS of a transaction processed Friday night. And I looked how many transactions have a lower timestamp in alf_transaction =&gt; I got </SPAN><STRONG> 621,952 </STRONG><SPAN> transactions.</SPAN><BR /><SPAN>I did the same with a commitTimeMS in a log generated today =&gt; </SPAN><STRONG> 627,189 </STRONG><SPAN> transactions.</SPAN><BR /><BR /><SPAN>So, with these numbers, my conclusion is that indexing is really slow.</SPAN><BR /><BR /><SPAN>Is the way I evaluate progess correct? Otherwise, how should I evaluate indexing progress ?</SPAN><BR /><BR /><SPAN>On the other hand, has anyone ever seen this problem?</SPAN><BR /><SPAN>Making a Tomcat restart can fix it?</SPAN><BR /><BR /><SPAN>In my log, I have also a lot of messages like this:</SPAN><BR /><PRE class="language-none line-numbers"><CODE> October 4, 2012 3:10:29 p.m. org.alfresco.solr.tracker.CoreTracker indexNode<BR />INFO: .. updating<BR />October 4, 2012 3:10:30 p.m. org.alfresco.solr.tracker.CoreTracker UpdateIndex<BR />INFO: … update is already running for alfresco<BR />October 4, 2012 3:10:30 p.m. org.alfresco.solr.tracker.CoreTracker UpdateIndex<BR />INFO: … update for archive is already running<BR />October 4, 2012 3:10:30 p.m. org.alfresco.solr.tracker.CoreTracker indexNode<BR />INFO: .. updating <SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN></CODE></PRE><BR /><SPAN>What does they mean? Can they explain my problem?</SPAN><BR /><BR /><SPAN>Thank you in advance for your help. Do not hesitate if you need more information.</SPAN></BODY></HTML> Mon, 08 Oct 2012 16:24:06 GMT mlagneaux 2012-10-08T16:24:06Z Indexing with SolR very long https://connect.hyland.com/t5/alfresco-archive/indexing-with-solr-very-long/m-p/269403#M222533 Hello,After Alfresco answer in JIRA ticket https://issues.alfresco.com/jira/browse/ALF-15546 , I've installed SolR. For the moment, Alfresco is still using Lucene and SolR is indexing my store in background (this store is about 600 GB).I've activated SolR logs and get messages like these: 17-Nov-20 Mon, 08 Oct 2012 16:24:06 GMT https://connect.hyland.com/t5/alfresco-archive/indexing-with-solr-very-long/m-p/269403#M222533 mlagneaux 2012-10-08T16:24:06Z Re: Indexing with SolR very long https://connect.hyland.com/t5/alfresco-archive/indexing-with-solr-very-long/m-p/269404#M222534 <HTML><HEAD></HEAD><BODY><SPAN>Hi</SPAN><BR /><BR /><SPAN>Where is the load on your system?</SPAN><BR /><SPAN>What DB are you using?</SPAN><BR /><SPAN>Can you post or link to a larger chunk of the log?</SPAN><BR /><BR /><SPAN>Most of the time goes into transformation so I would look here. If it is not here then you are unusual.</SPAN><BR /><SPAN>Have you enabled multi-threaded SOLR tracking so you can transform stuff in parallel? (This should be enabled by default)</SPAN><BR /><BR /><SPAN>You do not need to worry about the debug messages - they are just there to schedule indexing if it is not running - if it is running that is fine - it will carry on running until it is done.</SPAN><BR /><BR /><SPAN>Andy</SPAN></BODY></HTML> Thu, 11 Oct 2012 09:56:28 GMT https://connect.hyland.com/t5/alfresco-archive/indexing-with-solr-very-long/m-p/269404#M222534 andy 2012-10-11T09:56:28Z