topic Re: Transactions not getting commited on cluster in Alfresco Archive

Transactions not getting commited on cluster

swatnew1 — Thu, 08 Jan 2015 14:41:53 GMT

I have written java backed webscript which will call webservice and webservice response has metadata to be updated for node .This webscript is to update more than 1000 documents with some delay in each document processing .But its observed that on cluser env . If I run it , it does not update all d

Re: Transactions not getting commited on cluster

mrogers — Thu, 08 Jan 2015 15:01:49 GMT

There will be some limit on the number of docs you can update at once, so at some point you will want to split your huge request into smaller batches. However I'd expect 1000 docs to be O.K. Perhaps that's too big for your use case so try splitting into batches of 100.

What do you mean by the following?
If I run it, it does not update all docs in one go .
Either all docs should succeed or fail. Could you explain what you mean by 30% ?

Re: Transactions not getting commited on cluster

openpj — Thu, 08 Jan 2015 15:03:28 GMT

Could you please share with us your implementation of this Java Backed WebScript?

Re: Transactions not getting commited on cluster

swatnew1 — Thu, 08 Jan 2015 15:06:42 GMT

That's what is strange. Eg. if 1000 docs to be updated , and I run webscript , I find it will update 500 docs not all . So as still 500 to be updated , I will run it again and I find its updating 200 docs. That's how its working . Same code works perfectly when I tested for 100 docs on single node without any issue ,but problem with cluster env.

Re: Transactions not getting commited on cluster

swatnew1 — Thu, 08 Jan 2015 15:35:13 GMT

Sorry , its not java backed , but script based webservice

Few methods as below for java class :
   private void updateInteractionStatus(NodeRef node ,String msg , String interactionId)
   {
      log.debug("updateInteractionStatus : :" );
      if(!nodeService.hasAspect(node, ExtContentModel.ASPECT_INTERACTION_INFO))
      {
         log.debug("updateInteractionStatus :   adding aspect :" );
         Map<QName, Serializable> aspectProps = new HashMap<QName, Serializable>();
         aspectProps.put(ExtContentModel.PROP_INTERACTION_STATUS, msg);
         aspectProps.put(ExtContentModel.PROP_INTERACTIONID, interactionId);
         aspectProps.put(ExtContentModel.PROP_INTERACTION_TYPE, CREATE_INTERACTION_TYPE);

         nodeService.addAspect(node, ExtContentModel.ASPECT_INTERACTION_INFO, aspectProps);
      }
      else
      {
         log.debug("updateInteractionStatus : setting aspect   :" );
         //   serviceRegistry.getAuthenticationService().authenticate("admin","admin".toCharArray());

         Map<QName, Serializable> props = nodeService.getProperties(node);

         props.put(ExtContentModel.PROP_INTERACTION_STATUS, msg);
         props.put(ExtContentModel.PROP_INTERACTIONID, interactionId);
         props.put(ExtContentModel.PROP_INTERACTION_TYPE, CREATE_INTERACTION_TYPE);

         nodeService.setProperties(node, props);

      }
   }

   /**
    * Method to process CreateInteraction calls for Exbo documents
    */
   public void processFailedExboDocs()
   {
      try
      {
         System.out.println("DocumentUploadScriptAction processFailedExboDocs>>");
         ResultSet docResultSet =serviceRegistry.getSearchService().
               query(storeRef,
                     SearchService.LANGUAGE_LUCENE,
                     "PATH:\"/app:company_home/st:sites/cm:customersupport/cm:documentLibrary/cm:BASE/cm:INVALID/cm:EXBO//*\" OR PATH:\"/app:company_home/st:sites/cm:customersupport/cm:documentLibrary/cm:BASE/cm:INCOMING/cm:EXBO//*\" OR PATH:\"/app:company_home/st:sites/cm:customersupport/cm:documentLibrary/cm:BASE/cm:TO_BE_ARCHIVED/cm:EXBO//*\""
                     );

         List<NodeRef> nodeRefs = docResultSet.getNodeRefs();
         createInteractionRetrail(nodeRefs );
      }
      catch(Exception e)
      {
         e.printStackTrace();
      }
   }

——————————————————————————–
CreateInteractionWS.get.js
validationProcessor.processFailedExboDocs(); // validationProcessor is subclass of BaseScopableProcessorExtension
——————————————————————————–
CreateInteractionWS.get.desc.xml

<webscript>
<shortname>Archieve</shortname>
<description>Document List Action - Backup document(s)</description>
<url>/CreateNewInteraction</url>
<format default="html">argument</format>
<authentication>user</authentication>
</webscript>
——————————————————————————-
CreateInteractionWS.get.html.ftl
<html>
<body>
     DataCorrection >> Update metadata / movement done successfully.
      <p>Hello ${person.properties.userName}</p>
</body>
</html>

Re: Transactions not getting commited on cluster

swatnew1 — Thu, 08 Jan 2015 15:51:15 GMT

I can not put all code here , Its script based webscript where I am calling custom BaseScopableProcessorExtension object's method from javascript .
This method then does processing ,

Below method where I set properties , does not work as per expectation.

private void updateInteractionStatus(NodeRef node ,String msg , String interactionId)
{
log.debug("updateInteractionStatus : :" );
if(!nodeService.hasAspect(node, ExtContentModel.ASPECT_INTERACTION_INFO))
{
log.debug("updateInteractionStatus : adding aspect :" );
Map aspectProps = new HashMap();
aspectProps.put(ExtContentModel.PROP_INTERACTION_STATUS, msg);
aspectProps.put(ExtContentModel.PROP_INTERACTIONID, interactionId);
aspectProps.put(ExtContentModel.PROP_INTERACTION_TYPE, CREATE_INTERACTION_TYPE);

nodeService.addAspect(node, ExtContentModel.ASPECT_INTERACTION_INFO, aspectProps);
}
else
{
log.debug("updateInteractionStatus : setting aspect :" );
// serviceRegistry.getAuthenticationService().authenticate("admin","admin".toCharArray());

Map props = nodeService.getProperties(node);

props.put(ExtContentModel.PROP_INTERACTION_STATUS, msg);
props.put(ExtContentModel.PROP_INTERACTIONID, interactionId);
props.put(ExtContentModel.PROP_INTERACTION_TYPE, CREATE_INTERACTION_TYPE);

nodeService.setProperties(node, props);

}
}

Re: Transactions not getting commited on cluster

swatnew1 — Thu, 08 Jan 2015 15:52:02 GMT

I hope you are getting my implementation .

Re: Transactions not getting commited on cluster

mrogers — Thu, 08 Jan 2015 16:37:58 GMT

That exception processing is not correct.

You are swallowing exceptions that should result in a retry. Your java script should execute as one transaction. If you want control of your transactions (and you may also need the batching stuff) then rewrite in Java.

Re: Transactions not getting commited on cluster

swatnew1 — Thu, 08 Jan 2015 16:52:00 GMT

I added User Transaction code , but still same problem was there .
Also I added try catch , it was not throwing any exception.