topic Re: data migration alfresco community3.2 in Alfresco Archive

data migration alfresco community3.2

robobot — Tue, 08 Sep 2009 11:22:24 GMT

hi, maybe this problem was already handled somewhere here. sorry, but i couldn't find anything.does anybody have a hint, what will be the best way to migrate a large amount of data from alfresco version 2 to alfresco community 3.2 ?the only idea i have for the moment, is to do this via the webservic

Re: data migration alfresco community3.2

derek — Tue, 08 Sep 2009 12:14:48 GMT

I presume that a simple upgrade of the WAR file and fix-up of any customizations didn't work …

Re: data migration alfresco community3.2

robobot — Tue, 08 Sep 2009 13:25:45 GMT

yes, replacing the war file did not work.

Re: data migration alfresco community3.2

robobot — Wed, 16 Sep 2009 15:19:09 GMT

Problems when trying to get a large amount of data.
i have the following path to fetch all documents in the folder "Invoices".


PATH:"//app:company_home/app:user_homes/cm:myProjects/cm:Invoices//." AND TYPE:\{http\://www.alfresco.org/model/content/1.0\}content
‍‍‍


 Node [] nodes = WebServiceFactory.getRepositoryService().get(new Predicate(null,STORE,query));
‍‍‍

if there are 100 or 200 documents in the Invoicefolder, everything ist working fine. If there are 5500 documents in the folder, the query does not work. i will get just one document. can't find an explanation for this ??

what goes wrong here, and what can i do ?

thanks in advance!

Re: data migration alfresco community3.2

robobot — Thu, 17 Sep 2009 11:40:36 GMT

here is a piece of code i use. problem still isn't solved. if there are many documents in the folder, the webservice seems to have problem with the path query



public List<DMSData> getDocuments(final String queryString) {    
      final List<DMSData> results = new LinkedList<DMSData>();
      final Query query = new Query(Constants.QUERY_LANG_LUCENE, queryString );  
      
      Node [] nodes = null;
      try {
        nodes = WebServiceFactory.getRepositoryService().get(new Predicate(null,STORE,query));
      } catch (RepositoryFault e) {         
          e.printStackTrace();
          return results;
      } catch (RemoteException e) {
         e.printStackTrace();
         return results;
      }      

      //no results found
      if (nodes == null){
        return results;
      }  

      for(final Node row : nodes) {        

        dmsData = new DMSData();      

        for (final NamedValue namedValue : row.getProperties()) {   
           final String name = namedValue.getName(); 
           final String value = namedValue.getValue(); 
           dmsData.setValue(value);
           ….
         }
          results.add(dmsData);    
      }
      return results;
}
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: data migration alfresco community3.2

robobot — Thu, 17 Sep 2009 14:39:17 GMT

..help yourself or nobody helps you.

luckily i have just discovered the export/import functions in the web administration console. hope this is the way to a nice closing time.

Re: data migration alfresco community3.2

ra74 — Thu, 17 Sep 2009 15:32:43 GMT

Hi I've the similar problem

1. Using webservices is not a good idea as there's no guarantee that query returns all the documents. And there's no way to find such case
After all what about old versions if you're using this functionality. And sooner or later errors like socket timeout occured

2. Export/import - officially export/import is not supported between releases. Due to large amount of data I've tried to export the folder direcly to the filesystem but it doesn't work. After all I suppose export of old versions is not supported

3. Upgrade to 3.2 should work. It takes a few days on my computer mainly because new implementation of versioning and versions history has to be migrated
Well at the end it failed due to strange hibernate error but I've no longer time to work on it

Re: data migration alfresco community3.2

robobot — Fri, 18 Sep 2009 08:38:52 GMT

hmpf,
exporting the data (select the folder to export->administration console->export)
did not work..after waiting over 1 h, the process failed with unknown errors..
but hope against hope.

Let's see if we get on with this:
http://wiki.alfresco.com/wiki/Backup_and_Restore

Re: data migration alfresco community3.2

groutal — Mon, 21 Sep 2009 13:06:05 GMT

Maybe using a specialized/specific tool would work.

What you can use is an ETL tool. There are open source tools available for free. Talend Open Studio is an open source ETL tool for data integration and migration experts. It's easy to learn for a non-technical user. What distinguishes Talend, when it comes to business users, is the tMap component. It allows the user to get a graphical and functional view of integration processes.

For more information: http://www.talend.com/