topic Re: Getting more throughput from JobExecutor in Alfresco Archive

Getting more throughput from JobExecutor

jorell — Fri, 19 Sep 2014 00:31:00 GMT

I am currently getting about 2 job completions per second from a clustered environment and multiple job executors running. I am trying to drastically improve this (> 200 jobs per second). From the looks of it it seems I am thread bound. Hardware is not a concern for me and I created my own JobExe

Re: Getting more throughput from JobExecutor

jorell — Fri, 19 Sep 2014 01:04:31 GMT

On further examination it seems that since each server in the cluster only fetches one job at a time, there is no increase in paralellism. The threadPoolExecutor doesnt go beyond one thread. My jobs are lasting about 200-300ms. I see the comment in the code to not increase the acquire jobs count to more than one for a clustered enviroment so not sure what to do at this point.

Re: Getting more throughput from JobExecutor

jorell — Fri, 19 Sep 2014 16:56:01 GMT

Just bouncing ideas while I wait for a response
I was thinking of modifying my custom job executor to have a list of AcquireJobsRunnable threads instead of just one thread. Since each thread will atempt to acquire a single job, we should still be able to avoid the deadlock mentioned in http://jira.codehaus.org/browse/ACT-1879. But having multiple threads fetching job should allow us to increase throughput. Does this sound reasonable?

Re: Getting more throughput from JobExecutor

jorell — Tue, 23 Sep 2014 00:37:49 GMT

I noticed we are fetching jobs twice. The first time AcquireJobsRunnable fetches the job(s). But only stores the ids. This id is then used to fetch the job again in the ExecuteJobsCmd, so we are doing the same query twice. This seems redundant. Why not pass the whole job the the execute command instead of just the id?
By the way, I noticed I haven't gotten a single response so far. Please let me know if I am not posting enough information or there is something else wrong with what I am doing.