Best way of importing 20,000 files ? ~20GB

[unknown-user]

Anyone have any idea what the best way to import so much data reliably is? Webdav cant handle it, I've tried, but hopefully somepeople might have a better idea.

I'm using LDAP and from what I understand it doesnt work with CIFS? Mind you for the import only I could do without LDAP.

I was hoping I could just SCP the files to the server in a dir and they would be imported, or running an import script of some kind.

I cant seem to get ftp to allow me in even though the config is set like this :

<alfresco-config area="file-servers">

   <!– To override the default Alfresco filesystem use replace="true", to –>
   <!– add additional filesystems remove the replace="true" attribute     –>
   <config evaluator="string-compare" condition="FTP Server">
        <serverEnable enabled="${ftp.enabled}"/>
        <authenticator type="alfresco"/>
        <rootDirectory>/alfresco</rootDirectory>
        <charSet>UTF8</charSet>
        <bindto>serverName</bindto>
        <port>2121</port>
   </config>

   <config evaluator="string-compare" condition="Filesystems">
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Thanks

[norgan]

SCP will not work, FTP and CIFS should work. But you still may have to chunk it into easier bits.

Norgan

[unknown-user]

Thanks, I seem to have been able to get cifs to connect and am copying the files. However the performance of the CIF share is pretty poor compared to samba cifs.

The data is going to be split onto 5 sites, but one of them is pretty much 15GB on its own, the other ones are very manageable.

I'm very impressed with the amount of connectivity options though.

I can't seem to get the NFS server to start though. It just says could'nt start when I turn the logging on. Any ideas? And FTP chucks me whatever password/user I put in, but does respond because it requests a password/username.