topic Re: How to optimize process bottleneck? in Alfresco Archive

How to optimize process bottleneck?

gromar — Wed, 30 Jan 2013 09:39:28 GMT

Hello.I tried to optimize process from my previous post (How to predict process bottleneck?).The way, how is it done, is described here Optimize the process 1.QuestionsDoes anybody have real case where simulation could be used to optimize process? (I would like to use real case to extend simulation

Re: How to optimize process bottleneck?

jbarrez — Wed, 30 Jan 2013 15:06:54 GMT

Nice!

One way that typically 'solves' these bottlenecks is escalation: put a timer on the slow task, and escalate it to someone else (or a group) when the timer fires.

Does anybody have real case where simulation could be used to optimize process? (I would like to use real case to extend simulation framework)
In fact, is simulation needed to optimize processes?

I think you must separate two different phases of optimization:

- Optimization during design: here simulation is usable. Use the simulation to test-proof the process and see potential bottlenecks. Typically, you'd see group allocation in simulation tool. Ie user task A can be done by group X with 5 people and task B can be done by group Y with only 2 people. Then, you can take a bunch of processes and run them through the simulator. You'd probably see bottlenecks arise once group Y has more and more work to do.
- Optimization during runtime: here simulation is not usable, as this must be done based on the historical data produced by the engine

Re: How to optimize process bottleneck?

gromar — Thu, 31 Jan 2013 07:42:17 GMT

One way that typically 'solves' these bottlenecks is escalation: put a timer on the slow task, and escalate it to someone else (or a group) when the timer fires.

Yes. Escalation 'solves' bottleneck. I would say, it is 'Fireman extinguishes fires' approach, and it works in many cases.

I think you must separate two different phases of optimization:

- Optimization during design

Yes exactly, simulation during design can decrease pressure on the 'fireman'.

- Optimization during runtime: here simulation is not usable, as this must be done based on the historical data produced by the engine

I hope simulation is usable in runtime too. From my point of view, simulation is something like a scrying ball. (another question is how much scrying ball costs and how precise is. ). That's why I used historical data to simulate users activities.
I made small examples ( DueDate Monitor, Are we able to finish all started process instances? )

The first example was done some time ago - it is not based on the simulation process engine. It uses simulation on the process tasks. Migration is simple.

I hope somebody will have real case where simulation (in design/runtime/optimization phase) can be successfully applied.

Re: How to optimize process bottleneck?

jbarrez — Thu, 31 Jan 2013 09:54:54 GMT

Yeah, I think you are right: the simulation engine could be used for runtime optimization too. Or at least there is a big shared piece.

I don't have any 'real' business processes unfortunately. As framework builders, we're the last one to see them …

Re: How to optimize process bottleneck?

gromar — Tue, 12 Feb 2013 13:21:51 GMT

The comment on the margin
I do not have any real example but I tried to generate report about percentage of tasks finished after dueDate. Does not matter whether simulation was used or not.
To read more visit DueDateGenerator page.

Re: How to optimize process bottleneck?

jbarrez — Wed, 13 Feb 2013 15:34:59 GMT

Cool. What are your plans with this? Do yo envision a toolset around Activiti?

Re: How to optimize process bottleneck?

gromar — Thu, 14 Feb 2013 09:11:05 GMT

Yes, I would like to provide tool which can support process life cycle.

The tool (let say scrying ball) should provide:

process bottleneck

dueDate generator

To achieve that I would like to have real example, on which I can prove the concept.
Any ideas are welcome.

Currently I am working on process model extension ( to cover simulation model too).

Re: How to optimize process bottleneck?

gromar — Wed, 06 Mar 2013 08:48:03 GMT

I added new functionality to simulator.

The idea is to use the real load and user behavior to optimize processes. I used following steps:

To read more visit a link or try following test

Help:

Thank you in advance.

Re: How to optimize process bottleneck?

jbarrez — Mon, 11 Mar 2013 10:02:08 GMT

The link you posted isnt working anymore, where can I find it?

Re: How to optimize process bottleneck?

gromar — Mon, 11 Mar 2013 13:18:57 GMT

Sorry - I've renamed the project

Re: How to optimize process bottleneck?

gromar — Tue, 12 Mar 2013 07:11:29 GMT

https://github.com/gro-mar/activiti-crystalball/wiki/Optimize-the-process-2
https://github.com/gro-mar/activiti-crystalball/blob/master/simulator/src/test/java/org/activiti/crystalball/simulator/PlaybackTest.java

Re: How to optimize process bottleneck?

jbarrez — Wed, 13 Mar 2013 09:38:51 GMT

Hmmm I'm not sure about that extra namespaced attributes on those elements…. feels pretty invasive (but I can see the need for it).

Can't you use a BpmnParseHandler (http://activiti.org/userguide/index.html#advanced_parseHandlers) that you configure on the process engine config to add those custom elements dynamically? Would make it prettier, I think.

But overall, again nice progress!

Re: How to optimize process bottleneck?

gromar — Thu, 14 Mar 2013 09:02:23 GMT

BpmnParseHandler

are part of activiti 5.12 - I did not upgrade dependency from 5.11 yet. 😞

add those custom elements dynamically

Could you explain little bit more?
Should I store simulation model data outside of process definition? (it can make sense too - because of different simulation models, and simulation experiments….)

Re: How to optimize process bottleneck?

jbarrez — Fri, 15 Mar 2013 09:09:20 GMT

are part of activiti 5.12 - I did not upgrade dependency from 5.11 yet.

In Activiti you can use a BPMNParseListener. The mechanism is similar and you can upgrade easily once you switch to 5.12

Should I store simulation model data outside of process definition? (it can make sense too - because of different simulation models, and simulation experiments….)

You could do that, and that's certainly a valid thing to think about.
But that was not where I was hinting add. I meant that adding the custom elements with your own namespace might be too cumbersome to do, and you might add them dynamically to your process definition when it is parsed. That way, you can enrich your processes dynamically when they are loaded into memory before execution.

But I don't know if there are general rules to apply those elements. Eg. is it always the same class for a given type? Or does that change? If it changes depending on the author of the process definition, your approach probably is more suitable.

Re: How to optimize process bottleneck?

gromar — Fri, 22 Mar 2013 09:58:13 GMT

But I don't know if there are general rules to apply those elements. Eg. is it always the same class for a given type?

I do not think so. It depends on the simulation experiment. How far in the simulation do we want to go. In that case it is not always the same class for given element type. Simulation experiment has to be driven by modified process model. Simulation process model and "real" process model are tighten together now. But there can be several simulation experiments defined on the one process model. May be good way is to specify multiple simulation experiments in the one process model. I do not want to over complicate process definition for now.

BPMNParseListener

Thanks. I used it in jobs and timers support in simulation engine (details). So currently we are able to support asynchronous events in the simulation.

I started to work on simulation application examples as you propose in the following post. Thank you once again for the good example. When I finish example series I will consider to make the first release of activiti-crystalball
[img]https://raw.github.com/gro-mar/activiti-crystalball/master/examples/src/main/process/org/activiti/crystalball/examples/mortages/MortageDemo-0.png[/img]

Re: How to optimize process bottleneck?

gromar — Wed, 27 Mar 2013 12:57:14 GMT

Continue in reading here
http://forums.activiti.org/en/viewtopic.php?f=6&t=6266