topic Unable to import large amounts of files into alfresco. in Alfresco Archive

Unable to import large amounts of files into alfresco.

m_mind — Tue, 07 Jul 2009 15:13:49 GMT

We currently have about 32G of files which we currently have on a windows share. As we want to be able to index and search for files, we want to add these files into Alfresco.However, when we copy the files to the CIFS interface or to the FTP server, after some time errors occur and the connection i

Re: Unable to import large amounts of files into alfresco.

treghy — Mon, 24 Aug 2009 12:19:49 GMT

Hi I've the same problem!

Re: Unable to import large amounts of files into alfresco.

m_mind — Mon, 24 Aug 2009 13:14:03 GMT

Hi Trenghy,
After doing some tests, I ended up with rewireing an import script I used to import files from our php based project environment and modify it to read the directory structure and use a SOAP interface to import each file.
I know that this kind of action should also be possible (and preferably) by using a REST interface, but this was something I already had on the shelf.
Sorry I cannot offer you any answer on how to import it a 'normal' way.

Re: Unable to import large amounts of files into alfresco.

d_montagni — Tue, 25 Aug 2009 10:36:47 GMT

Hi all,

I've same problem on both community 3.0 and 3.2 and mysql.


12:05:47,818  DEBUG [org.alfresco.fileserver]    at org.hibernate.id.insert.AbstractSelectingDelegate.performInsert(AbstractSelectingDelegate.java:33)
12:05:47,818  DEBUG [org.alfresco.fileserver]    … 64 more
12:05:47,818  DEBUG [org.alfresco.fileserver] [T2] ** Active transaction after packet processing, cleaning up **
12:05:47,818  ERROR [org.hibernate.AssertionFailure] an assertion failure occured (this may indicate a bug in Hibernate, but is more likely due to unsafe use of the session)
org.hibernate.AssertionFailure: null id in org.alfresco.repo.avm.PlainDirectoryNodeImpl entry (don't flush the Session after an exception occurs)
‍‍‍‍‍‍‍

Does anyone know if this problem will be fix?

thanks in advance
Daniele

Re: Unable to import large amounts of files into alfresco.

norgan — Tue, 25 Aug 2009 15:21:11 GMT

Did you check issues.alfresco.com ?

Re: Unable to import large amounts of files into alfresco.

wesse — Fri, 04 Sep 2009 10:24:04 GMT

You can zip them and use import from the alfresco UI. It has some issues though with filename encodings (if your windows do not use utf-8)
and then the limits are the session timeout vs. upload speed.

/Micke

Re: Unable to import large amounts of files into alfresco.

jhuie — Sun, 06 Sep 2009 23:11:28 GMT

I have the same problem. I have searched unsuccessfully for a workaround. It appears that none of the methods for bulk loading files into Alfresco work. I have been posting this and looking for alternatives with absolutely no response for several days now. The people I work with are telling me to abandon Alfresco and start looking at Sharepoint.

Re: Unable to import large amounts of files into alfresco.

kevinr — Tue, 08 Sep 2009 13:12:12 GMT

FTP is an effective route. Each file is a separate transaction. Where-as a ZIP import is a single large transaction - so you may need to split the zip files if you hit issues. The WebScript REST APIs also use a separate transaction for each file.

Cheers,

Kev