topic Re: Retry failed job and duedate/lockExpirationDate in Alfresco Archive

Retry failed job and duedate/lockExpirationDate

mapor — Mon, 05 May 2014 15:43:24 GMT

Hello,I'm trying to write a class in order to retry failed job with a delay, in my command i use the following lines : public Object execute(CommandContext commandContext) { if(this.jobId==null){ LOGGER.error("no job id given"); throw new IllegalArgumentException(); } Job

Re: Retry failed job and duedate/lockExpirationDate

mapor — Mon, 05 May 2014 15:51:24 GMT

Sorry i forgot the link to the referenced JIRA : https://jira.codehaus.org/browse/ACT-1046

Re: Retry failed job and duedate/lockExpirationDate

trademak — Tue, 06 May 2014 13:53:26 GMT

This issue is fixed in Activiti 5.10. Are you using an older version? I would really recommend to upgrade to a more recent version.

Best regards,

Re: Retry failed job and duedate/lockExpirationDate

mapor — Tue, 06 May 2014 17:11:46 GMT

I'm using the version 5.15.1.

Re: Retry failed job and duedate/lockExpirationDate

trademak — Thu, 08 May 2014 08:18:11 GMT

Hi,

How did you plugin your custom job functionality in the Activiti Engine?

Best regards,

Re: Retry failed job and duedate/lockExpirationDate

mapor — Mon, 12 May 2014 12:37:30 GMT

With psring injection.

The class implements Command<Object> and FailedJobCommandFactory by returning a new instance of himself with the given parameter.

<code>
<property name="failedJobCommandFactory">
<bean class="com.alstom.userportal.workflow.bean.RetryJobExecutor" />
</property>
</code>

<code>
@Override
public Command<Object> getCommand(String arg0, Throwable arg1) {
return new RetryJobExecutor(arg0, arg1);
}
</code>

With a breakpoint i'm sure that i pass in the execute method but still data in database are not fullfilled / resetted (lockOwner) correctly.

Re: Retry failed job and duedate/lockExpirationDate

trademak — Wed, 14 May 2014 19:32:15 GMT

In your implementation I see the following line:

<blockcode>
Context.getCommandContext()
</blockcode>

You already have a command context available, so you should be using that one. Don't know if this solves the issue though. Let me know if the issue is still there and we'll do some testing for it.

Best regards,

Re: Retry failed job and duedate/lockExpirationDate

mapor — Thu, 15 May 2014 08:58:28 GMT

Still doesn't work, the columns due_date and lock_exp_time are still empty even when the following code is executed :

<java>
job.setLockExpirationTime(date);
job.setDuedate(date);
</java>

Job status in the database :
<code>
"525";15;"message";"";"";TRUE;"523";"409";"AppstoreRequest:5:408";0;"528";"Error while evaluating expression: #{appstoreDelegate.createITSM7Request(requestDelegated, computerId, packageId)}";"";"";"async-continuation";"";"''"

</code>

Maybe my change are absolutely not persisted while the exception message have already been set by something else somewhere ?

With breakpoints i'm sure that my RetryJobExecutor is executed and not the DecrementJobRetriesCmd.

Re: Retry failed job and duedate/lockExpirationDate

mapor — Thu, 22 May 2014 12:29:11 GMT

Any news ? Or should i go for a custom cron job that retry job outside the context of activiti ?

Re: Retry failed job and duedate/lockExpirationDate

jbarrez — Tue, 27 May 2014 07:24:40 GMT

No, im quite puzzled. it could indeed be that the exception takes over and removes your changes.

Is there any chance you can put your custom job factory in a small unit test that demonstrates the issue?

Re: Retry failed job and duedate/lockExpirationDate

mapor — Tue, 27 May 2014 08:44:36 GMT

I tried and something interesting showed up : when my job failed i get into my custom failed job executor but a exception is still throw : "job xx failed"

So that means that with my current code the error of my job is rethrowed after my RetryJobExecutor instead of being schedule later. And since a exception means that the transaction will rollback…

Seems like i forgot something that make the exception not being rethrowed by activiti.
For my junit i just use manageService.executeJob and my delegate always throw

If i look in the DecrementJobRetriesCmd i can see that piece of code :
<java>
JobExecutor jobExecutor = Context.getProcessEngineConfiguration().getJobExecutor();
    MessageAddedNotification messageAddedNotification = new MessageAddedNotification(jobExecutor);
    TransactionContext transactionContext = commandContext.getTransactionContext();
    transactionContext.addTransactionListener(TransactionState.COMMITTED, messageAddedNotification);

</java>

From what i understood when i red about that, it was that code that make the job being retry immediately, so i removed it. I tried to put it again but the exception is still rethrowed.

edit : in inspected the code more deeply and in fact i have a NPE at job.setLockOwner(null); in my RetryJobExecutor the variable job is null, but the variable jobId is "26". So that means that i have an ID of a job that is not present anymore in the database. That NPE is not present in the given stacktrace. I have the first exception that have been throw by my delegate.

NB : my jobs are asynchronous service task with delegate expression if it's help.

Re: Retry failed job and duedate/lockExpirationDate

jbarrez — Tue, 27 May 2014 08:52:11 GMT

The code you posted is using a transaction listener - hence the code will be executed just before the transaction actually commits to the database.

> Seems like i forgot something that make the exception not being rethrowed by activiti.

Sounds like it indeed. However, im not sure if thats pluggable actually … would need some investigation.

Re: Retry failed job and duedate/lockExpirationDate

mapor — Tue, 27 May 2014 09:01:12 GMT

as i said in my edit, i got a NPE in my job executor., the variable job is null.

The jobid that activiti gave me is not found. I don't know why because when i ran it from my application the job is found.

I use a hsql db in memory for my junit tests

Re: Retry failed job and duedate/lockExpirationDate

jbarrez — Fri, 30 May 2014 08:33:14 GMT

> I use a hsql db in memory for my junit tests

The db shouldn't make a difference normally. Could you share that unit test that is failing, cause its hard to follow without knowing what all is happening.

Re: Retry failed job and duedate/lockExpirationDate

mapor — Mon, 02 Jun 2014 14:47:22 GMT

here : http://www.fichier-zip.com/2014/06/02/activiti-unit-test-template-master/

I used two BPNM model just in case.

Note the code :

<java>
JobEntity job = Context
          .getCommandContext()
          .getJobEntityManager()
          .findJobById(jobId);
</java>

still throw a NPE if i use the variable commandContenxt.

Re: Retry failed job and duedate/lockExpirationDate

jbarrez — Wed, 04 Jun 2014 20:41:53 GMT

Thanks for the unit test.

It took my quite some puzzling to see whats going on.

First off all, you should disable the jobExecutor in the activiti cfg. It is interfering with your regular executeJobs() method.

Secondly, the real issue here is that the Test case is marked with @Transactional.
The whole test will be executed in one single transaction.
The .findJobById(jobId); will always return null: the data has never ever been committed to the database.
Once I removed the @transactional, the NPE was gone.

Re: Retry failed job and duedate/lockExpirationDate

mapor — Wed, 11 Jun 2014 10:07:53 GMT

Thanks for the NPE fix.

But now i have the main problem that produce in my application (i checked and i didn't have the NPE in the application) : if a put a breakpoint within that code in WorkflowFailTest.java :
<java>
for(Job job : list){
   StringBuilder builder = new StringBuilder();
   builder.append(job.getId()).append("/")
   .append(job.getRetries()).append("/")
   .append(job.getExceptionMessage());
   LOGGER.info(builder.toString());
}
</java>

I can see that the dueDate is null or it shouldn't since i setted one in my RetryJobExecutor and while i'm waiting when the breakpoint is active the job are executing endlessly since i'm not decreasing the ammount of retries.

Re: Retry failed job and duedate/lockExpirationDate

jbarrez — Tue, 17 Jun 2014 10:19:58 GMT

> I can see that the dueDate is null or it shouldn't since i setted one in my RetryJobExecutor and while i'm waiting when the breakpoint is active the job are executing endlessly since i'm not decreasing the ammount of retries.

Im sorry, i tried very hard … but can't understand what you are trying to say. Breakpointing in a multi threaded environment is hard, and will give you different results.

Re: Retry failed job and duedate/lockExpirationDate

mapor — Tue, 17 Jun 2014 15:44:13 GMT

Well since i use the manager in order to execute all job synchronously in the junit test, the whole thing should be only in one thread no ? And so reading the jobs after execute them should give result up to date (and so with a due date set to current time + 10mn.

What i'm trying to say is that the setDueDate() used in my RetryJobExecutpor is not persisted.

Or maybe there is some hidden rules like only timer activity can have dueDate and so can't be used for all kind of jobs to schedule next try ?

In the end i just search how to prevent for immediate retry of a job that has failed and control when it will be executed again.

Re: Retry failed job and duedate/lockExpirationDate

jbarrez — Fri, 27 Jun 2014 12:31:18 GMT

> Or maybe there is some hidden rules like only timer activity can have dueDate and so can't be used for all kind of jobs to schedule next try ?

No, any jobEntity can have it.

The last resort you can try: is the JobEntity part of the DbSQLSession.flush()? Setting the due date should mark the entity as dirty, and make it flush at the end of the transaction.