cancel
Showing results for 
Search instead for 
Did you mean: 

CMIS to do bulk upload?

qrmavani
Champ in-the-making
Champ in-the-making
I was wondering if there is any bulk upload capability using CMIS or public api, similar to the bulk upload tool that can be used In-Process only? The file loader example reads files from the local folder, iterates over each file and still uploads it one by one instead of bulk. I am looking for something similar to the programmatic approach mentioned at link https://wiki.alfresco.com/wiki/Bulk_Importer but using CMIS. Thanks in advance.
4 REPLIES 4

kaynezhang
World-Class Innovator
World-Class Innovator
CMIS or public api don't provide  no out of box bulk upload feature,If you want to do bulk upload using  CMIS or public api you can your own code using multiple threads.
Why not using Bulk Import tool

There are two types of bulk import:

Streaming import: This import streams the files into the repository content store by copying them in during the import.
In-place import: Available in Enterprise Only, these files are assumed to already exist within the repository content store, so no copying is required. This can result in a significant improvement in performance .

You can use Streaming import.

qrmavani
Champ in-the-making
Champ in-the-making
Hi Kaynezhang,
Thanks for the reply. Please correct me if I am wrong, but wiki says in order to work with Streaming import the files to be uploaded need to be on the same disk as the Alfresco Server. For me files are on different disk than Alfresco. More over the code snippet shown on the wiki for programmatically achieving streaming import uses Java Foundation API. In order to use Java Foundation API, the client code needs to be bundled in the same alfreso war file.

Currently we have a external batch application that uses CMIS for uploading the pdf file sequentially to Alfresco.Although it works fine but it takes lot of time. I am trying to make the upload more efficient, would appreciate any suggestions thanks.



kaynezhang
World-Class Innovator
World-Class Innovator
Yes Streaming needs that directory must be locally accessible by Alfresco  server . You can mount remote filesystem to your alfresco server or copy files to alfresco server first.

If you want to use cmis to do batch upload ,you can try to tune alfresco,for example disable in-transaction indexing,increase jvm memory usage..

qrmavani
Champ in-the-making
Champ in-the-making
Thanks a lot Kaynezhang.