cancel
Showing results for 
Search instead for 
Did you mean: 

Bulk upload in parallel

franciscoduarte
Champ in-the-making
Champ in-the-making

Hello,

We are having some issues when uploading files in bulk from our ADF.

We have two people uploading 10000 files each from our ADF, at the same time. And sometimes, some files fail to upload (usually 2 or 3 files) and we get the following error:

Logs 

Can you help?

Thank you

1 REPLY 1

abhinavmishra14
World-Class Innovator
World-Class Innovator

The error indicates that it is trying to modify the same node concurrently or may be a deadlock situation is occurring. 

This error also notable : Transactional update cache 'org.alfresco.userToAuthorityTransactionalCache' is full (100).

Increasing the maxItems count can be a quick fix, but does not help, batch processing is the right option.

https://github.com/Alfresco/alfresco-community-repo/blob/master/repository/src/main/resources/alfres...

https://github.com/Alfresco/alfresco-community-repo/blob/master/repository/src/main/resources/alfres...

cache.userToAuthoritySharedCache.tx.maxItems=100

https://github.com/Alfresco/alfresco-community-repo/blob/master/repository/src/main/resources/alfres...

You may need to upload the files in batches or wrap the the upload logic in transaction scope.

~Abhinav
(ACSCE, AWS SAA, Azure Admin)