topic Synchronization issue in parallel multi-instance call activity in Alfresco Archive

Synchronization issue in parallel multi-instance call activity

alexander_tsvet — Wed, 23 Nov 2016 15:07:06 GMT

Hi guys,I am working on a task, where I need to have a multi-instance callActivity, which iterates over a collection and is executed in parallel. However, I may have found an issue in the synchronization of the threads that execute the started sub-processes, because in most of my tests, two threads

Re: Synchronization issue in parallel multi-instance call activity

alexander_tsvet — Sat, 26 Nov 2016 08:44:38 GMT

I forgot to mention, that this leads to some weird behavior. For example, in my test project, the parent process sets a "messages" variable containing 8 strings (the numbers from 1 to 8 represented as strings). Then it starts a sub-process (via a call activity) for each of the strings. These sub-processes then print the string, for which they were started. Normally, this should result in an output similar to the following:
2 1 3 4 5 6 7 8

However, it looks like Activiti is executing some of the sub-processes a second or even a third time, because in each run, it prints three or four more messages (which appear to be chosen at random):
2 1 3 4 5 6 7 8 1 4 4

This is a problem for me, since in my real project, these sub-processes should do network calls, which should not be repeated.

Re: Synchronization issue in parallel multi-instance call activity

warper — Mon, 28 Nov 2016 05:34:24 GMT

Try adding asynchronous exclusive step at the end of subprocess. So work will be done in parallel, results persisted, and then executions will close one by one.

Repeated calls are due to transaction nature of processes engine.

Re: Synchronization issue in parallel multi-instance call activity

alexander_tsvet — Mon, 28 Nov 2016 12:07:56 GMT

Hi Warper and thanks for the response!

I added another asynchronous step in the end of the sub-process. This does workaround the issue and now the task, which prints the message is only executed once. However, I noticed that the new task is once again executed more times than necessary, which increases the time it takes to execute the entire main process. In the test project I attached, it adds 10 seconds for 8 sub-processes. However, in my real scenario there could be 100 sub-processes, which would mean that more tasks will be retried and as a result it will take more time for the job executor to retry them.

Actually, I just tried to spawn 100 sub-processes and the main process never even finished. This may be due to the fact that Activiti retries a failed job 3 times and then gives up (69 tasks were retried this time). So the workaround you suggested works for small number of sub-processes but not for 100 or more. Should I open a bug in Activiti's JIRA?

Also, does "exclusive" have any effect on this issue? As far as I understood from Activiti's User Guide, "exclusive=true" prevents jobs from a single process instance to execute concurrently. In my situation, there are multiple sub-processes (which I assume are separate process instances), which execute in parallel, but all steps in them are executed sequentially.

Re: Synchronization issue in parallel multi-instance call activity

gdharley — Fri, 09 Dec 2016 19:27:40 GMT

Hi Alexander,
I think you may have actually stumbled across an edge case that is not handled properly.
The intended behavior of "exclusive" is (as you already understand) to prevent concurrent execution within a single process instance. It's very useful for parallel joins which can lead to pre-emptive DB lock contention and can also be useful in multi-instance scenarios.

Looking at your model, I see you are already using Exclusive and Async on the Sub Process Call, I doubt this will have any effect since Called Activities (sub Processes) are their own individual process. Async may help a little since the parallel sub processes may not get executed simultaneously, but there is really no guarantee of this.

I agree with your analysis that the retrieval and updating of the nrOfCompletedInstances variable in the leave method of the behavior class should be in a synchronized block. For the majority of scenarios, the sub-process instances will not complete at exactly the same time, so there will be little if any performance impact, however for your scenario, it will resolve the issue.

Can you go ahead and create a Jira and then log the Jira number back into the forum for reference?

Thanks for your patience.

Regads,

Greg

‌

Re: Synchronization issue in parallel multi-instance call activity

alexander_tsvet — Wed, 04 Jan 2017 10:25:47 GMT

Hi Greg,

Thanks for the response! I opened a new issue in Activiti's JIRA. Here's the link:

https://activiti.atlassian.net/browse/ACT-4255

Best regards,

Alexander