Solr indexing seems stuck

[knightrider]

Hi!
I'm currently having a problem, solr of my alfresco isn't indexing anymore. I used the solr/admin/cores?action=SUMMARY&wt=xml to check the indexing, the Approx transactions remaining tag shows 822 (for about 5 hours now) and the index version doesn't change anymore. I tried to restart alfresco with no success, I tried to use the solr/admin/cores?action=FIX url with no success.
What can I do ?

Thanks in advance,

Michael

[knightrider]

I forgot to mention that when I restarted the alfresco service, i got the following error : "In the solr.log fileNode index failed and skipped for 16359937 in Tx 9223372036854775807"

[knightrider]

Hi!
I still haven't fixed that problem but i have more information. We implemented on the server several custom types. During the day, our users can upload several hundreds of documents on a particular datatype (defined in our custom model) using a specific app. For one of those datatype, these upload causes solr to hang. No more node are indexed after. In the localhost_access_log file, I find multiple calls to the following url:

127.0.0.1 - CN=Alfresco Repository Client, OU=Unknown, O=Alfresco Software Ltd., L=Maidenhead, ST=UK, C=GB [13/Oct/2015:17:36:41 +0200] "POST /alfresco/service/api/solr/metadata HTTP/1.1" 200 2120
‍‍‍

The above url is called around 50 times per second.

Here is an extraction of the datatype:

<type name="oda:accesaudroitaj">
            <title>Aide Juridictionnelle</title>
            <parent>cm:content</parent>
            <properties>
               <property name="oda:ajnumdossier">
                  <title>Numéro de Dossier</title>
                  <type>d:int</type>
                  <mandatory>true</mandatory>
               </property>
            <property name="oda:ajcodebaj">
                  <title>Code BAJ</title>
                  <type>d:text</type>
                  <mandatory>true</mandatory>
               </property>
            <property name="oda:ajnumbaj">
                  <title>Numéro BAJ</title>
                  <type>d:text</type>
                  <mandatory>true</mandatory>
               </property>
             <property name="oda:ajdatedecision">
                  <title>Date de décision</title>
                  <type>d:date</type>
               <mandatory>true</mandatory>
             </property>
            <property name="oda:ajcodeprocedure">
                  <title>Code de procédure</title>
                  <type>d:text</type>
               <mandatory>true</mandatory>
               </property>
            <property name="oda:ajdomaine">
                  <title>Domaine</title>
                  <type>d:text</type>
               <mandatory>true</mandatory>
             </property>
            <property name="oda:ajaffaire">
                  <title>Affaire</title>
                  <type>d:text</type>
               <mandatory>true</mandatory>
             </property>
               <property name="oda:ajcnbf">
                  <title>Cnbf</title>
                  <type>d:int</type>
                  <mandatory>false</mandatory>
               </property>
            <property name="oda:ajnomavocat">
                  <title>Avocat - Nom</title>
                  <type>d:text</type>
               <mandatory>false</mandatory>
             </property>
            <property name="oda:ajprenomavocat">
                  <title>Avocat - Prénom</title>
                  <type>d:text</type>
               <mandatory>false</mandatory>
             </property>
            <property name="oda:ajcodebarre">
                  <title>Code barre</title>
                  <type>d:text</type>
               <mandatory>true</mandatory>
             </property>
            <property name="oda:ajdtpreparationscan">
                  <title>Préparation Scan</title>
                  <type>d:text</type>
               <mandatory>true</mandatory>
             </property>
         </properties>
         </type>
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Each time, we restart the alfresco service. Nodes get indexed until it hangs again. Then we restart once again to index more nodes, … until all the nodes are indexed.

Does anyone have some clues to help me find out what's going on ?

[knightrider]

Other informations. After a while, i get transaction cache full warnings :

17:21:17,715 WARN  [org.alfresco.repo.cache.TransactionalCache.org.alfresco.cache.node.nodesTransactionalCache] Transactional update cache 'org.alfresco.cache.node.nodesTransactionalCache' is full (125000).
17:21:23,137 WARN  [org.alfresco.repo.cache.TransactionalCache.org.alfresco.cache.node.aspectsTransactionalCache] Transactional update cache 'org.alfresco.cache.node.aspectsTransactionalCache' is full (65000).
17:22:45,692 WARN  [org.alfresco.repo.cache.TransactionalCache.org.alfresco.cache.node.nodesTransactionalCache] Transactional update cache 'org.alfresco.cache.node.nodesTransactionalCache' is full (125000).
17:22:49,607 WARN  [org.alfresco.repo.cache.TransactionalCache.org.alfresco.cache.node.aspectsTransactionalCache] Transactional update cache 'org.alfresco.cache.node.aspectsTransactionalCache' is full (65000).
17:34:22,691 WARN  [org.alfresco.repo.cache.TransactionalCache.org.alfresco.cache.node.nodesTransactionalCache] Transactional update cache 'org.alfresco.cache.node.nodesTransactionalCache' is full (125000).
17:34:25,592 WARN  [org.alfresco.repo.cache.TransactionalCache.org.alfresco.cache.node.nodesTransactionalCache] Transactional update cache 'org.alfresco.cache.node.nodesTransactionalCache' is full (125000).
17:34:26,963 WARN  [org.alfresco.repo.cache.TransactionalCache.org.alfresco.cache.node.aspectsTransactionalCache] Transactional update cache 'org.alfresco.cache.node.aspectsTransactionalCache' is full (65000).
17:34:30,436 WARN  [org.alfresco.repo.cache.TransactionalCache.org.alfresco.cache.node.aspectsTransactionalCache] Transactional update cache 'org.alfresco.cache.node.aspectsTransactionalCache' is full (65000).
17:45:39,840 WARN  [org.alfresco.repo.cache.TransactionalCache.org.alfresco.cache.node.nodesTransactionalCache] Transactional update cache 'org.alfresco.cache.node.nodesTransactionalCache' is full (125000).
17:45:43,471 WARN  [org.alfresco.repo.cache.TransactionalCache.org.alfresco.cache.node.aspectsTransactionalCache] Transactional update cache 'org.alfresco.cache.node.aspectsTransactionalCache' is full (65000).
‍‍‍‍‍‍‍‍‍‍‍‍