It might be because there will be multiple instances of that workflow. Other possible reason is there could be multiple versions deployed for that particular workflow and there are so many pending workflow instances of each version. If this is the case you need to delete all the pending workflow instances first then check the performance.