topic Re: Batch processing with Activiti in Alfresco Archive

Batch processing with Activiti

kingsheldor — Wed, 04 Sep 2013 14:53:24 GMT

I'm looking to create a custom software product that can model a fairly complex manufacturing process. There would be an incoming list of 100 items that all need to go through the same exact process. We'd like to do this in one batch operation since all items are typically handled at once, however

Re: Batch processing with Activiti

kingsheldor — Wed, 04 Sep 2013 14:57:13 GMT

I think this goes without saying, but thought I should mention: Because of the tracking/positioning requirements, we want to avoid making each step handle 1 item and have our solution create 100 process instances.

Re: Batch processing with Activiti

trademak — Fri, 06 Sep 2013 17:54:03 GMT

1a Don't see a reason why not.
1b If you use an embedded sub process it's the most efficient way. You can make this embedded sub process multi instance and create sub lists of your items with the right quantities that you defined in your post.
2 For an embedded sub processes the logical place would be a service task before the multi-instance sub process
3 Don't think Activiti mandates them being in the same process definition. It's a design choice not an Activiti requirement.

Best regards,

Re: Batch processing with Activiti

pmsevestre — Sat, 07 Sep 2013 17:24:54 GMT

One think that I would do is to make a clear distinction between the manufacturing process of an individual item from the batching processes that take a bunch of items and perform a given production step. With this distinction in mind, you'd end with the following processes:

1. A process for each item, with human tasks representing each production step
2. One batching process for each manufacturing step. This processes consists of just
thtwo steps: collect items ready for production (up to the capacity of the cell), perform the production step (multiinstance human task)

Process instances of (1) become process variables for (2) and vice-versa, so you can track wich isnatnces where produced by a batch and the batch runs that participated in the production of a given instance.

I think that approach would also give you extra flexibility, as you can add new item production flows that share common steps ( eg, product 1 has an extra step 5) without any changes on existing processes.

Re: Batch processing with Activiti

ezg3ta — Tue, 04 Nov 2014 23:34:14 GMT

Hello!

I will borrow this thread, because it perfectly suits my problem. I have to design a bpmn process, which takes care of incoming orders (one process instance = one order), but the orders are processed in batch. The aim is:
1. to know at any moment in which state each order is,
2. to process the orders in batches

Now.. The idea of pmsevstre seems good, except I don't know how to design it - could anyone please make a visual example? I thought I could make it with signals (see picture at the bottom), which would be thrown via the API, but at this time, the "analyse order" or "ship order" step is the same for every order. I would like to do it like pmsevstre suggested - i.e. to implement the "analyse order" as a sub-process in the order process, so that we could have different kind of orders, which demand different kind of analysis.

The association lines (dotted lines) represent the signal throwing and catching between the batch and order process.

And if there would be a way to reuse the "batch process", that would be great (my example contains 2 separate process definitions for analysis and shipment batch)

BPMN example: https://copy.com/thumbs_public/ET1URFyG1yV2qmuc/activiti.png?size=1024

Re: Batch processing with Activiti

jbarrez — Wed, 05 Nov 2014 13:06:06 GMT

I'm not sure Im following your reasoning here. Why would you want to use signals to continue the batch?
Why not simply set a process variable that indicates the state?

Re: Batch processing with Activiti

ezg3ta — Wed, 05 Nov 2014 16:09:03 GMT

The reason is, that I don't want the order process to continue until we have enough orders. And until we don't have enough orders, the task list would be full of tasks like "analyse order" - I don't want these tasks to be visible until we have a full batch (for example 20 orders). And even when we have one batch, it would be preferable to get tasks one at a time, or even better, to complete them all in one step (that could be done with a custom GUI, which lets us complete multiple process instances at once).

With that said, it is cruical that the orders have each its own process instance. Also bear in mind, that this is only a simplification of the real process, which is much more complex, but follows this pattern - multiple checkpoints for orders, which are processed in groups (batches), which may not be always the same (meaning that the group of orders, which were processed together in the "analyse" step, may not be the same as the group of orders in the "shipment" step).

Anyway - it would be of great help, if one could simply make an example (preferably a BPMN) of what pmsevestre meant.

Re: Batch processing with Activiti

jbarrez — Mon, 10 Nov 2014 10:36:08 GMT

Anyone wants that I make examples, i would be doing nothing besides that the whole day if I start doing that 😉

What you need is a global signal. Have a process instance started for each of your orders. Make it go to an intermediate signal event that waits until the global signal is received. That would give you the semantics you described above.