topic Re: Importing files from xml that describes file structure in Alfresco Archive

Importing files from xml that describes file structure

ebogaard — Mon, 25 Feb 2013 09:47:21 GMT

Recently I received a zip with a file file structure and an xml-file that describes these files. This xml is an export from a ms sql-db describing the binaries in the file structure. As this file structure is completely 'random' (comparable to the way Alfresco stores the binaries), the metadata is i

Re: Importing files from xml that describes file structure

mitpatoliya — Mon, 25 Feb 2013 11:55:32 GMT

I do not understand your requirement. Few questions.

1) do you expect that xml will attach the metadata to the imported files I do not think this is possible out of box.

You can create your custom code which will attach the metadata by reading that xml file and move the files to given folder path.

Re: Importing files from xml that describes file structure

ebogaard — Mon, 25 Feb 2013 12:15:00 GMT

The thing I want to accomplish is that the files from the location 'W:\websites\dms\CheckedIn\' are put in a new structure, based on the attributes in the xml file. So in this example, the file 'W:\websites\dms\CheckedIn\00\00\00\51431C7B-AC23-4C9C-AB00-D69738B8077A.doc' should end up in the folder + filename: '/Vergadering 14 maart 2008/Versie II - RenD-uitgaven private sector.doc'.

As the end target is Alfresco, I see two possibilities to get to this end:
1. Create the folder structure under Linux of Windows with a certain tool that can use the attributes in XML to create that structure, then import this folder structure with all the files in Alfresco.
2. Use the xml to directly import the files in Alfresco, and create the right folder structure and filenames 'on the fly'.

In both cases it's a nice to have to be able to set the created and modified dates, but it's not a must.
And in both cases: I'm not sure how to do it.

Re: Importing files from xml that describes file structure

mitpatoliya — Mon, 25 Feb 2013 13:10:02 GMT

So in your XML file one document tag denotes the metadata of one particular document right?
so, now you need to do is need to do some coding to create one webscript which will read your xml file and do the necessary job in the alfresco.
For coding you will require Alfresco SDK

http://wiki.alfresco.com/wiki/Alfresco_SDK

and creating webscript you can refer this.
http://wiki.alfresco.com/wiki/Java-backed_Web_Scripts_Samples

Re: Importing files from xml that describes file structure

ebogaard — Mon, 25 Feb 2013 14:47:26 GMT

Thanks for your suggestion, but this goes a little bit over my head.
I was hoping for a far easier tool or procedure.

Re: Importing files from xml that describes file structure

mitpatoliya — Tue, 26 Feb 2013 12:16:50 GMT

See you Alfresco provide bulk import feature with the help of which you can put all your contents in zip file in particular folder structure it should laying under alfresco as well.
Then if you simply import that file it will upload all the files in the alfresco and create similar structure.

Now in your case you want to import metadata as well which is something will require either manual effort or some coding.

Or else you can go for the addins supported by alfresco.
http://addons.alfresco.com/addons/importexport-acpzip-share

Re: Importing files from xml that describes file structure

ebogaard — Tue, 26 Feb 2013 13:17:48 GMT

The bulk import feature is great, but there's one problem (at least, that's what I think): the xml doesn't describe the folders (parents) or which files are in that folder (children). That information is in an XML-attribute of each document. That's why I was hoping for another tool to either transform the xml, or create a file structure that the bulk importer gets.

Or do you think the bulk importer gets this xml-file anyway? Maybe I'm just going to try it and see what happens.

Re: Importing files from xml that describes file structure

mdutoo — Wed, 09 Oct 2013 11:41:43 GMT

"I was hoping for another tool to either transform the xml"

=> that's an ETL such as Talend, which is incidentally integrated with Alfresco through the Alfresco ETL Connector :

http://knowledge.openwide.fr/Main/AlfrescoETLConnector

With an ETL like Talend, you can visually configure the transformation of your XML (and mashup it with others, or even with existing metadata from Alfresco using the CMIS Connector) in an Alfresco file & folder tree structure. And you can configure the ETL to do it in several passes, ex. create tree structure from XML and 2. fill it with imported documents.

Regards