topic Re: XML metadata extracter in Alfresco Archive

XML metadata extracter

golden_eye — Fri, 03 Jul 2009 17:09:42 GMT

Hello everybodyi am new member here.and i need help. Please give me some advise how to start with metadata extraction for xml file.I have read on wiki about Metadata Extraction but that didnt lead me to the successful implementation.So i turned to the community to ask .How to write metadata extra

Re: XML metadata extracter

golden_eye — Mon, 06 Jul 2009 07:16:08 GMT

Hello
After i wrote java class for xml extracter and inlcude all in bean in extension folder i got error:
Error creating bean with name 'test.xml.XmlMetadataExtracter' defined in file [/opt/Alfresco/Alfresco/tomcat/shared/classes/alfresco/extension/custom-repository-context.xml]: Invocation of init method failed; nested exception is org.alfresco.error.AlfrescoRuntimeException: : Variable 'selectors' has not been settest.xml.XmlMetadataExtracter@d311da.
What that mean?How can i fix it.
Appreciate any help.

Re: XML metadata extracter

golden_eye — Tue, 07 Jul 2009 09:43:05 GMT

After some testing i am still on the same state.not working xml extracter.
When i run my java classes i am getting the below error:I don't know if problem is here,because i can compile classes to jar so i can put jar in lib folder.
I think problem is in extension folder in custom-metadata-extrators-context.xml.
There must be the example how to right modife xml extracter.Or not?
Someone with the same problem?
And maybe with the solution?
I would be very thankful.

java.lang.ExceptionInInitializerError
Caused by: org.springframework.beans.factory.BeanDefinitionStoreException: IOException parsing XML document from class path resource [model.xml]; nested exception is java.io.FileNotFoundException: class path resource [modelPravi.xml] cannot be opened because it does not exist
   at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDefinitions(XmlBeanDefinitionReader.java:347)
   at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDefinitions(XmlBeanDefinitionReader.java:317)
   at org.springframework.beans.factory.support.AbstractBeanDefinitionReader.loadBeanDefinitions(AbstractBeanDefinitionReader.java:125)
   at org.springframework.beans.factory.support.AbstractBeanDefinitionReader.loadBeanDefinitions(AbstractBeanDefinitionReader.java:141)
   at org.springframework.beans.factory.support.AbstractBeanDefinitionReader.loadBeanDefinitions(AbstractBeanDefinitionReader.java:167)
   at org.springframework.context.support.AbstractXmlApplicationContext.loadBeanDefinitions(AbstractXmlApplicationContext.java:113)
   at org.springframework.context.support.AbstractXmlApplicationContext.loadBeanDefinitions(AbstractXmlApplicationContext.java:79)
   at org.springframework.context.support.AbstractRefreshableApplicationContext.refreshBeanFactory(AbstractRefreshableApplicationContext.java:94)
   at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:292)
   at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:92)
   at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:77)
   at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:68)
   at test.xml.XmlMetadataExtracterTest.<clinit>(XmlMetadataExtracterTest.java:76)
   … 13 more
Caused by: java.io.FileNotFoundException: class path resource [model.xml] cannot be opened because it does not exist
   at org.springframework.core.io.ClassPathResource.getInputStream(ClassPathResource.java:135)
   at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDefinitions(XmlBeanDefinitionReader.java:334)
   … 25 more

Re: XML metadata extracter

golden_eye — Wed, 08 Jul 2009 08:43:50 GMT

Hello again i haven't got no response from u guys.
I can belive this is so hard to do, or is it me stupid and just don't understand concept of alfresco.
I get log where i can see my property. set in file custom-metadata-extrators-context.xml + custom-xml-extractor-mappings.properties
10:12:23,492 DEBUG [org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter] Added mapping from firstName to [{model}firstName]
but when i look at default extarcters there is also log where extarcter load mapped properties in this case for OpenOfficeMetadataExtracter,which is missing for my extracter. Could this be wrong?
10:18:58,748 DEBUG [org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter] Loaded mapping properties from resource: org/alfresco/repo/content/metadata/OpenOfficeMetadataExtracter.properties
And when i upload xml file to space nothing happens,metadata extraction won't start.
Default extractors works just fine.
Can please someone confirmed is my approach right.Am i closer to solution or not?
Please people.Some response thoose who already implement xml extracter.Please.
I 've lost a lot of days and my energy study,testing this.

Re: XML metadata extracter

golden_eye — Wed, 15 Jul 2009 07:54:34 GMT

Hi all again,
i have next error.How much i figure it out,problem is he doesn't use my java class to recognize metadata extracter so he could start extracting.

But strange thing here is if i add aspect and fill value handy i can see first name is added with my value {model}firstName=rihanna.
Now all i need to do that this is automatically using java classes?
I try all combination to add my variable in java classes like

private static final String KEY_FirstName = "FirstName";
putRawValue(KEY_FirstName, docInfo.getFirstName(), rawProperties);

nothing seemes to work!

I am going crazy here.Some response.Some advise.

Thanks

09:31:24,182 DEBUG [org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter] Added mapping from firstName to [{http://www.alfresco.org/alfresco/model}firstName]
09:31:24,203 DEBUG [org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter] Added mapping from model:firstName to /model/firstName/text()
09:31:24,402 DEBUG [org.alfresco.repo.content.metadata.MetadataExtracterRegistry] Registering metadata extracter: org.alfresco.repo.content.metadata.xml.XmlMetadataExtracter@473a14

09:39:10,526 DEBUG [org.alfresco.repo.content.selector.XPathContentWorkerSelector]
Chosen content worker for reader:
   Reader:       ContentAccessor[ contentUrl=store://2009/7/15/9/35/c66f1c39-4bcc-44ae-bef9-b8a31c652be3.bin, mimetype=text/xml, size=1108, encoding=UTF-8, locale=en_US]
   XPath:        null
   Worker:    null
09:39:10,526 DEBUG [org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter]
No working metadata extractor could be found:
   Document: ContentAccessor[ contentUrl=store://2009/7/15/9/35/c66f1c39-4bcc-44ae-bef9-b8a31c652be3.bin, mimetype=text/xml, size=1108, encoding=UTF-8, locale=en_US]
09:39:10,526 DEBUG [org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter]
XML metadata extractor redirected:
   Reader:    ContentAccessor[ contentUrl=store://2009/7/15/9/35/c66f1c39-4bcc-44ae-bef9-b8a31c652be3.bin, mimetype=text/xml, size=1108, encoding=UTF-8, locale=en_US]
   Extracter: null
   Metadata: {{http://www.alfresco.org/model/content/1.0}name=6.xml, {model}firstName=rihanna, {http://www.alfresco.org/model/system/1.0}node-dbid=204406784, {http://www.alfresco.org/model/system/1.0}store-identifier=SpacesStore, {http://www.alfresco.org/model/content/1.0}content=contentUrl=store://2009/7/15/9/35/c66f1c39-4bcc-44ae-bef9-b8a31c652be3.bin|mimetype=text/xml|size=1108|encoding=UTF-8|locale=en_US_, {http://www.alfresco.org/model/content/1.0}title=6.xml, {http://www.alfresco.org/model/system/1.0}node-uuid=00836780-daf6-4c3e-a706-d47e5db0c5bb, {http://www.alfresco.org/model/content/1.0}modified=Wed Jul 15 09:38:56 CEST 2009, {http://www.alfresco.org/model/content/1.0}author=, {http://www.alfresco.org/model/application/1.0}editInline=true, {http://www.alfresco.org/model/content/1.0}created=Wed Jul 15 09:35:43 CEST 2009, {http://www.alfresco.org/model/system/1.0}store-protocol=workspace, {http://www.alfresco.org/model/content/1.0}creator=admin, {http://www.alfresco.org/model/content/1.0}description=, {http://www.alfresco.org/model/content/1.0}modifier=admin}

Re: XML metadata extracter

golden_eye — Wed, 29 Jul 2009 06:52:35 GMT

Hi all,
at this point i register my xml metadata extracter,and metadata extraction started,but the problem is the result is empty.
From the log i can see he doesn't found XPath.I try all combination with XPath to write values into aspect. I don't know any more what to do.
my XPath looks:
<property name="xpathMappingProperties">
<bean class="org.springframework.beans.factory.config.PropertiesFactoryBean">
<property name="properties">
<props>
<prop key="namespace.prefix.test">model</prop>
<prop key="firstName">/model/firstName/text()</prop>
</props>
Someone with the similar problem,issue.
Please,i think i am very close to my solution.
Thanks.

08:30:12,393 DEBUG [org.alfresco.repo.content.selector.XPathContentWorkerSelector]
Chosen content worker for reader:
   Reader:       ContentAccessor[ contentUrl=store://2009/7/29/8/18/de5f39da-24d5-4aa7-b7f2-991747c1e609.bin, mimetype=text/xml, size=90, encoding=UTF-8, locale=en_US]
   XPath:        null
   Worker:    org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter@1a3d191
08:30:12,393 DEBUG [org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter]
Found metadata extracter to process XML document:
   Selector: XPathContentWorkerSelector[ workers={/model=org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter@1a3d191}]
   Document: ContentAccessor[ contentUrl=store://2009/7/29/8/18/de5f39da-24d5-4aa7-b7f2-991747c1e609.bin, mimetype=text/xml, size=90, encoding=UTF-8, locale=en_US]
08:30:12,393 DEBUG [org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter] Starting metadata extraction:
   reader: ContentAccessor[ contentUrl=store://2009/7/29/8/18/de5f39da-24d5-4aa7-b7f2-991747c1e609.bin, mimetype=text/xml, size=90, encoding=UTF-8, locale=en_US]
   extracter: org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter@1a3d191
08:30:12,394 DEBUG [org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter]
Extracted XML metadata:
   Reader: ContentAccessor[ contentUrl=store://2009/7/29/8/18/de5f39da-24d5-4aa7-b7f2-991747c1e609.bin, mimetype=text/xml, size=90, encoding=UTF-8, locale=en_US]
   Results: {}
08:30:12,394 DEBUG [org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter] Converted extracted raw values to system values:
   Raw Properties:    {}
   System Properties: {}
08:30:12,394 DEBUG [org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter] Completed metadata extraction:
   reader:    ContentAccessor[ contentUrl=store://2009/7/29/8/18/de5f39da-24d5-4aa7-b7f2-991747c1e609.bin, mimetype=text/xml, size=90, encoding=UTF-8, locale=en_US]
   extracter: org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter@1a3d191
   changed:   {}
08:30:12,394 DEBUG [org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter]
XML metadata extractor redirected:
   Reader:    ContentAccessor[ contentUrl=store://2009/7/29/8/18/de5f39da-24d5-4aa7-b7f2-991747c1e609.bin, mimetype=text/xml, size=90, encoding=UTF-8, locale=en_US]
   Extracter: org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter@1a3d191
   Metadata: {}

Re: XML metadata extracter

golden_eye — Thu, 30 Jul 2009 12:55:42 GMT

Still no response from anyone. I can't believe no one want's to help or at least share opinion with me.
Is it so hard to read one post and response back those who have successfully implemented it?

Re: XML metadata extracter

golden_eye — Fri, 31 Jul 2009 08:55:13 GMT

Hello
can someone please attach me the working example,source,code anything of xml metadata extracter.
After reading almost all posts i still can't get to work it.
Only 3 files are needed,custom model where i define aspect,appropriate xml and custom-metadata-extrators-context.xml.
My custom-metadata-extrators-context.xml looks like this:

<beans>
      <bean id="extracter.XML"
            class="org.alfresco.repo.content.metadata.xml.XmlMetadataExtracter"
            parent="baseMetadataExtracter" >
         <property name="selectors">
            <list>
               <ref bean="extracter.XMLXPathSelector" />
            </list>
         </property>
      </bean>
          <bean id="extracter.XMLXPathSelector" class="org.alfresco.repo.content.selector.XPathContentWorkerSelector"
           init-method="init">
             <property name="workers">
                <map>
                   <entry key="/model">
                      <ref bean="extracter.xml.sample.AlfrescoModelMetadataExtracter" />
                   </entry>
                </map>
             </property>
          </bean>

          <bean id="extracter.xml.sample.AlfrescoModelMetadataExtracter"
           class="org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter"
           parent="baseMetadataExtracter" init-method="init">
                      <props>
                         <prop key="namespace.prefix.test">model</prop>
                         <prop key="firstName">test:firstName</prop>
                       </props>
                   </property>
                </bean>
             </property>

             <property name="xpathMappingProperties">
                <bean class="org.springframework.beans.factory.config.PropertiesFactoryBean">
                   <property name="properties">
                      <props>
                         <prop key="namespace.prefix.test">model</prop>
                         <prop key="firstName">/model/firstName/text()</prop>
                              </props>
                   </property>
                </bean>
             </property>
          </bean>

         <!–
         <bean id="extracter.xml.sample.XMLMetadataExtracter"
               class="org.alfresco.repo.content.metadata.xml.XmlMetadataExtracter"
               parent="baseMetadataExtracter">
            <property name="registry">
               <ref bean="avmMetadataExtracterRegistry" />
            </property>
            <property name="overwritePolicy">
               <value>EAGER</value>
            </property>
            <property name="selectors">
               <list>
                  <ref bean="extracter.xml.sample.selector.XPathSelector" />
               </list>
            </property>
         </bean>
       –>
      </beans>

Re: XML metadata extracter

miguel_gil_mart — Tue, 23 Feb 2010 12:42:50 GMT

You closed </property>, but did not open. Use a xml validator to check you code before deploy.http://validator.w3.org

Re: XML metadata extracter

romschn — Tue, 25 Jan 2011 19:12:46 GMT

I just read this post.

And sharing my knowledge about how to configure the metadata extractor.

Below are the basic steps required to configure the metadata extractor.

1. Create a model file and put an entry for aspect. e.g create a file called testModel.xml.
                <aspects>
      <!– Test Aspect –>
      <aspect name="test:testAspect">
         <title>Test Aspect</title>
         <properties>
            <property name="test:launchdate">
               <title>Launch Date</title>
               <type>d:date</type>
            </property>
            <property name="test:expirationdate">
               <title>Expiration Date</title>
               <type>d:date</type>
            </property>
         </properties>
      </aspect>
      </aspects>
2. Register the Model to the spring context. Create a file called test-model-context.xml and put below entry in it.
        <bean id="extension.dictionaryBootstrap" parent="dictionaryModelBootstrap" depends-on="dictionaryBootstrap">
        <property name="models">
            <list>
                <value>alfresco/extension/testModel.xml</value>
            </list>
        </property>
    </bean>
3. Create a spring context file for metadata extractor. Create a file called test-metadata-extractor-context.xml and put below entry in it.
               <bean id="com.test.NewsEventMetadataExtracter"
      class="org.alfresco.repo.content.metadata.xml.XPathMetadataExtracter"
      parent="baseMetadataExtracter" init-method="init">
      <property name="supportedDateFormats">
         <list>
            <value>yyyy-MM-dd</value>
         </list>
      </property>
      <property name="mappingProperties">
         <bean
            class="org.springframework.beans.factory.config.PropertiesFactoryBean">
            <property name="properties">
               <props>
                  <prop key="namespace.prefix.test">http://www.test.com/model/content/1.0</prop>
                  <prop key="newsevent_launch">test:launchdate</prop>
                  <prop key="newsevent_expiration">test:expirationdate</prop>
               </props>
            </property>
         </bean>
      </property>
      <property name="xpathMappingProperties">
         <bean
            class="org.springframework.beans.factory.config.PropertiesFactoryBean">
            <property name="properties">
               <props>
                  <prop key="namespace.prefix.test">http://www.test.com/model/content/1.0</prop>
                  <prop key="newsevent_launch">/news_events/launch_date/text()</prop>
                  <prop key="newsevent_expiration">/news_events/expiration_date/text()</prop>
               </props>
            </property>
         </bean>
      </property>
   </bean>
   <bean id="extracter.xml.sample.selector.XPathSelector"
      class="org.alfresco.repo.content.selector.XPathContentWorkerSelector"
      init-method="init">
      <property name="workers">
         <map>
            <entry key="/news_events">
               <ref bean="com.test.NewsEventMetadataExtracter" />
            </entry>
         </map>
      </property>
   </bean>

Above files need to placed into tomcat/shared/classes/alfresco/extension folder. Re-start the server.

Above code snippet configurations will have metadata extractor in place for you and all the contents created for news-events.xsd will have the aspect applied on it.

I hope it helps.

Thanks,