Some more Activiti performance test results...of Activiti 5.16.1

[arnoldschrijve1]

I ran the performance tests that Joram Barrez created some time ago (see: http://www.jorambarrez.be/blog/2012/06/28/the-activiti-performance-showdown/) against an Activiti 5.16.1 release running on an Amazon t2.medium instance, and communicating with a MySQL 5.5 installation running on an Amazon m3.large (see: http://aws.amazon.com/ec2/instance-types/).
And I thought 'let's share the results with you all'. So here they are:

[h1]Legend[/h1]

PROCESS: The name of the process that was executed
NR OF EXECUTIONS: The amount of times this process was ran
TOTAL TIME: the amount of milliseconds it took to run 'NR OF EXECUTIONS' instances from start to end of this process
AVERAGE TIME: the average execution time in milliseconds of this process
THROUGHPUT/SEC: The amount of processes that were finished during 1 second. Especially interesting when using threads, because the average time should remain more or less equal, while the throughput should rise.
THROUGHPUT/HOUR: Same as above, but now for one hour.

[h1]Results[/h1]
Fixed thread pool (1threads), sequential[table][tr][td]PROCESS[/td][td]NR OF EXECUTIONS[/td][td]TOTAL TIME (ms)[/td][td]AVERAGE (ms)[/td][td]THROUGHPUT/SEC[/td][td]THROUGHPUT/HOUR[/td][/tr][tr][td]process-multi-instance-01[/td][td]2500[/td][td]474042[/td][td]184.78[/td][td]5.27[/td][td]18985.66[/td][/tr][tr][td]process-usertask-01[/td][td]2500[/td][td]58341[/td][td]20.91[/td][td]42.85[/td][td]154265.44[/td][/tr][tr][td]process-usertask-02[/td][td]2500[/td][td]237935[/td][td]85.53[/td][td]10.51[/td][td]37825.46[/td][/tr][tr][td]process-usertask-03[/td][td]2500[/td][td]118494[/td][td]44.99[/td][td]21.1[/td][td]75953.21[/td][/tr][tr][td]process01[/td][td]2500[/td][td]23785[/td][td]9.53[/td][td]105.11[/td][td]378389.74[/td][/tr][tr][td]process02[/td][td]2500[/td][td]28843[/td][td]11.54[/td][td]86.68[/td][td]312034.12[/td][/tr][tr][td]process03[/td][td]2500[/td][td]42638[/td][td]17.06[/td][td]58.63[/td][td]211079.32[/td][/tr][tr][td]process04[/td][td]2500[/td][td]88556[/td][td]35.43[/td][td]28.23[/td][td]101630.61[/td][/tr][tr][td]process05[/td][td]2500[/td][td]23347[/td][td]9.34[/td][td]107.08[/td][td]385488.5[/td][/tr][/table]Fixed thread pool (2threads), sequential[table][tr][td]PROCESS[/td][td]NR OF EXECUTIONS[/td][td]TOTAL TIME (ms)[/td][td]AVERAGE (ms)[/td][td]THROUGHPUT/SEC[/td][td]THROUGHPUT/HOUR[/td][/tr][tr][td]process-multi-instance-01[/td][td]2500[/td][td]239038[/td][td]185.86[/td][td]10.46[/td][td]37650.92[/td][/tr][tr][td]process-usertask-01[/td][td]2500[/td][td]32574[/td][td]23.56[/td][td]76.75[/td][td]276293.98[/td][/tr][tr][td]process-usertask-02[/td][td]2500[/td][td]137216[/td][td]99.5[/td][td]18.22[/td][td]65590.02[/td][/tr][tr][td]process-usertask-03[/td][td]2500[/td][td]65455[/td][td]49.85[/td][td]38.19[/td][td]137499.05[/td][/tr][tr][td]process01[/td][td]2500[/td][td]8554[/td][td]6.83[/td][td]292.26[/td][td]1052139.35[/td][/tr][tr][td]process02[/td][td]2500[/td][td]13424[/td][td]10.73[/td][td]186.23[/td][td]670441.0[/td][/tr][tr][td]process03[/td][td]2500[/td][td]21549[/td][td]17.23[/td][td]116.01[/td][td]417652.79[/td][/tr][tr][td]process04[/td][td]2500[/td][td]42802[/td][td]34.24[/td][td]58.41[/td][td]210270.55[/td][/tr][tr][td]process05[/td][td]2500[/td][td]12228[/td][td]9.77[/td][td]204.45[/td][td]736015.7[/td][/tr][/table]Fixed thread pool (3threads), sequential[table][tr][td]PROCESS[/td][td]NR OF EXECUTIONS[/td][td]TOTAL TIME (ms)[/td][td]AVERAGE (ms)[/td][td]THROUGHPUT/SEC[/td][td]THROUGHPUT/HOUR[/td][/tr][tr][td]process-multi-instance-01[/td][td]2500[/td][td]195353[/td][td]228.41[/td][td]12.8[/td][td]46070.45[/td][/tr][tr][td]process-usertask-01[/td][td]2500[/td][td]25636[/td][td]27.93[/td][td]97.52[/td][td]351068.81[/td][/tr][tr][td]process-usertask-02[/td][td]2500[/td][td]134543[/td][td]150.24[/td][td]18.58[/td][td]66893.11[/td][/tr][tr][td]process-usertask-03[/td][td]2500[/td][td]61866[/td][td]71.42[/td][td]40.41[/td][td]145475.71[/td][/tr][tr][td]process01[/td][td]2500[/td][td]6257[/td][td]7.51[/td][td]399.55[/td][td]1438389.0[/td][/tr][tr][td]process02[/td][td]2500[/td][td]9887[/td][td]11.86[/td][td]252.86[/td][td]910286.23[/td][/tr][tr][td]process03[/td][td]2500[/td][td]15897[/td][td]19.07[/td][td]157.26[/td][td]566144.56[/td][/tr][tr][td]process04[/td][td]2500[/td][td]33145[/td][td]39.77[/td][td]75.43[/td][td]271534.17[/td][/tr][tr][td]process05[/td][td]2500[/td][td]10144[/td][td]12.17[/td][td]246.45[/td][td]887223.97[/td][/tr][/table]Fixed thread pool (4threads), sequential[table][tr][td]PROCESS[/td][td]NR OF EXECUTIONS[/td][td]TOTAL TIME (ms)[/td][td]AVERAGE (ms)[/td][td]THROUGHPUT/SEC[/td][td]THROUGHPUT/HOUR[/td][/tr][tr][td]process-multi-instance-01[/td][td]2500[/td][td]166788[/td][td]260.03[/td][td]14.99[/td][td]53960.72[/td][/tr][tr][td]process-usertask-01[/td][td]2500[/td][td]21655[/td][td]31.65[/td][td]115.45[/td][td]415608.4[/td][/tr][tr][td]process-usertask-02[/td][td]2500[/td][td]96178[/td][td]141.18[/td][td]25.99[/td][td]93576.49[/td][/tr][tr][td]process-usertask-03[/td][td]2500[/td][td]46835[/td][td]71.63[/td][td]53.38[/td][td]192163.98[/td][/tr][tr][td]process01[/td][td]2500[/td][td]6470[/td][td]10.35[/td][td]386.4[/td][td]1391035.55[/td][/tr][tr][td]process02[/td][td]2500[/td][td]12168[/td][td]19.44[/td][td]205.46[/td][td]739644.97[/td][/tr][tr][td]process03[/td][td]2500[/td][td]19215[/td][td]30.71[/td][td]130.11[/td][td]468384.07[/td][/tr][tr][td]process04[/td][td]2500[/td][td]37231[/td][td]59.56[/td][td]67.15[/td][td]241734.04[/td][/tr][tr][td]process05[/td][td]2500[/td][td]8342[/td][td]13.34[/td][td]299.69[/td][td]1078877.97[/td][/tr][/table]Fixed thread pool (5threads), sequential[table][tr][td]PROCESS[/td][td]NR OF EXECUTIONS[/td][td]TOTAL TIME (ms)[/td][td]AVERAGE (ms)[/td][td]THROUGHPUT/SEC[/td][td]THROUGHPUT/HOUR[/td][/tr][tr][td]process-multi-instance-01[/td][td]2500[/td][td]154293[/td][td]300.96[/td][td]16.2[/td][td]58330.58[/td][/tr][tr][td]process-usertask-01[/td][td]2500[/td][td]17819[/td][td]32.2[/td][td]140.3[/td][td]505078.85[/td][/tr][tr][td]process-usertask-02[/td][td]2500[/td][td]78910[/td][td]143.47[/td][td]31.68[/td][td]114053.99[/td][/tr][tr][td]process-usertask-03[/td][td]2500[/td][td]39371[/td][td]75.11[/td][td]63.5[/td][td]228594.65[/td][/tr][tr][td]process01[/td][td]2500[/td][td]4296[/td][td]8.59[/td][td]581.94[/td][td]2094972.07[/td][/tr][tr][td]process02[/td][td]2500[/td][td]7781[/td][td]15.55[/td][td]321.3[/td][td]1156663.67[/td][/tr][tr][td]process03[/td][td]2500[/td][td]12418[/td][td]24.82[/td][td]201.32[/td][td]724754.39[/td][/tr][tr][td]process04[/td][td]2500[/td][td]26870[/td][td]53.73[/td][td]93.04[/td][td]334946.04[/td][/tr][tr][td]process05[/td][td]2500[/td][td]6529[/td][td]13.05[/td][td]382.91[/td][td]1378465.31[/td][/tr][/table]Fixed thread pool (6threads), sequential[table][tr][td]PROCESS[/td][td]NR OF EXECUTIONS[/td][td]TOTAL TIME (ms)[/td][td]AVERAGE (ms)[/td][td]THROUGHPUT/SEC[/td][td]THROUGHPUT/HOUR[/td][/tr][tr][td]process-multi-instance-01[/td][td]2500[/td][td]141867[/td][td]332.43[/td][td]17.62[/td][td]63439.7[/td][/tr][tr][td]process-usertask-01[/td][td]2500[/td][td]16917[/td][td]36.69[/td][td]147.78[/td][td]532009.22[/td][/tr][tr][td]process-usertask-02[/td][td]2500[/td][td]73969[/td][td]161.86[/td][td]33.8[/td][td]121672.59[/td][/tr][tr][td]process-usertask-03[/td][td]2500[/td][td]36978[/td][td]84.78[/td][td]67.61[/td][td]243387.96[/td][/tr][tr][td]process01[/td][td]2500[/td][td]4276[/td][td]10.26[/td][td]584.66[/td][td]2104770.81[/td][/tr][tr][td]process02[/td][td]2500[/td][td]7840[/td][td]18.8[/td][td]318.88[/td][td]1147959.18[/td][/tr][tr][td]process03[/td][td]2500[/td][td]11685[/td][td]28.04[/td][td]213.95[/td][td]770218.23[/td][/tr][tr][td]process04[/td][td]2500[/td][td]24579[/td][td]58.96[/td][td]101.71[/td][td]366166.24[/td][/tr][tr][td]process05[/td][td]2500[/td][td]6253[/td][td]15.01[/td][td]399.81[/td][td]1439309.13[/td][/tr][/table]Fixed thread pool (7threads), sequential[table][tr][td]PROCESS[/td][td]NR OF EXECUTIONS[/td][td]TOTAL TIME (ms)[/td][td]AVERAGE (ms)[/td][td]THROUGHPUT/SEC[/td][td]THROUGHPUT/HOUR[/td][/tr][tr][td]process-multi-instance-01[/td][td]2500[/td][td]154157[/td][td]421.39[/td][td]16.22[/td][td]58382.04[/td][/tr][tr][td]process-usertask-01[/td][td]2500[/td][td]16109[/td][td]40.77[/td][td]155.19[/td][td]558693.9[/td][/tr][tr][td]process-usertask-02[/td][td]2500[/td][td]79366[/td][td]204.05[/td][td]31.5[/td][td]113398.68[/td][/tr][tr][td]process-usertask-03[/td][td]2500[/td][td]39501[/td][td]106.15[/td][td]63.29[/td][td]227842.33[/td][/tr][tr][td]process01[/td][td]2500[/td][td]3684[/td][td]10.31[/td][td]678.61[/td][td]2442996.74[/td][/tr][tr][td]process02[/td][td]2500[/td][td]6637[/td][td]18.56[/td][td]376.68[/td][td]1356034.35[/td][/tr][tr][td]process03[/td][td]2500[/td][td]10789[/td][td]30.19[/td][td]231.72[/td][td]834182.96[/td][/tr][tr][td]process04[/td][td]2500[/td][td]23825[/td][td]66.68[/td][td]104.93[/td][td]377754.46[/td][/tr][tr][td]process05[/td][td]2500[/td][td]5665[/td][td]15.85[/td][td]441.31[/td][td]1588702.56[/td][/tr][/table]Fixed thread pool (8threads), sequential[table][tr][td]PROCESS[/td][td]NR OF EXECUTIONS[/td][td]TOTAL TIME (ms)[/td][td]AVERAGE (ms)[/td][td]THROUGHPUT/SEC[/td][td]THROUGHPUT/HOUR[/td][/tr][tr][td]process-multi-instance-01[/td][td]2500[/td][td]128971[/td][td]403.3[/td][td]19.38[/td][td]69783.13[/td][/tr][tr][td]process-usertask-01[/td][td]2500[/td][td]15818[/td][td]46.25[/td][td]158.05[/td][td]568972.06[/td][/tr][tr][td]process-usertask-02[/td][td]2500[/td][td]68854[/td][td]202.07[/td][td]36.31[/td][td]130711.36[/td][/tr][tr][td]process-usertask-03[/td][td]2500[/td][td]34504[/td][td]105.92[/td][td]72.46[/td][td]260839.32[/td][/tr][tr][td]process01[/td][td]2500[/td][td]3638[/td][td]11.62[/td][td]687.19[/td][td]2473886.75[/td][/tr][tr][td]process02[/td][td]2500[/td][td]6953[/td][td]22.23[/td][td]359.56[/td][td]1294405.29[/td][/tr][tr][td]process03[/td][td]2500[/td][td]11101[/td][td]35.5[/td][td]225.2[/td][td]810737.77[/td][/tr][tr][td]process04[/td][td]2500[/td][td]23197[/td][td]74.18[/td][td]107.77[/td][td]387981.2[/td][/tr][tr][td]process05[/td][td]2500[/td][td]5588[/td][td]17.86[/td][td]447.39[/td][td]1610594.13[/td][/tr][/table]

[jbarrez]

Awesome, Arnold. I'll try to redo the test myself (i wanted to do some tweaks to it for a long time) and post back here!