cancel
Showing results for 
Search instead for 
Did you mean: 

best way to upload huge volumes of data in Alfresco

iguannago
Champ on-the-rise
Champ on-the-rise
We have stored a lot of documents in a file system of a remote machine, hopefully this machine will be in the same network. A document is composed of files and folders with more files in. So the average size of a document is over 4 GB. We have to move this documents from the remote file system to Alfresco. And here is goes my question: What is the best way to accomplish this task?
I am considering:

1. Bulk file system import. Most people suggest to use this tool for my problem but I think it doesn't fit well in my case because Bulk tool works only with documents in the same filesystem where Alfresco is running or the filesystem should be in the same network and be accessible.

2. Upload servlet. I don't know how to use this option I guess it should be by webscript or webservice and so by http and I think that there is a limit in this situation because of the http protocol and also the JVM memory, I don't know. Does the upload webscript example from alfrescowiki use the upload servlet?

3. Set up the ftp server of Alfresco and move the content using a ftp client in the filesystem remote.

I look forward your suggestions,

Thanks.
1 REPLY 1

mrogers
Star Contributor
Star Contributor
The bulk filesystem import is the best way for huge volumes of data.    It is optimised for content ingestion.   The other interfaces may have "other stuff" going on which may slow down import.

FTP is also a good option, especially if you use a multi-threaded client.

Or one of the other interfaces.
Getting started

Tags


Find what you came for

We want to make your experience in Hyland Connect as valuable as possible, so we put together some helpful links.