topic Re: Content Transformations not available in Alfresco Archive

Content Transformations not available

enigma969 — Wed, 14 Dec 2016 12:45:32 GMT

Hi, I have alfresco-5.0.a installed on a Ubuntu VPS. Now I want to transform various documents (e.g. docx, .xlsx) to PDF, but I get errors likeTransformer for 'application/vnd.openxmlformats-officedocument.spreadsheetml.sheet' source mime type and 'application/pdf' target mime type was not found. Op

Re: Content Transformations not available

michael_s1 — Wed, 14 Dec 2016 22:52:13 GMT

It is not recommended that you have both OOO and jodconverter enabled. Please try by disabling OOO.

Refer Configuring LibreOffice | Alfresco Documentation

Good luck.

Michael

Re: Content Transformations not available

jpotts — Wed, 14 Dec 2016 23:09:11 GMT

Also, just a quick side-note: It looks like you are running 5.0.a. That is not a stable release. If you are just testing things out, okay, otherwise, you should upgrade. If you want/need to stay on 5.0.x, upgrade to 5.0.d.

Re: Content Transformations not available

briant — Thu, 15 Dec 2016 07:42:48 GMT

I wanted to send this in private but it appears there is no option of doing that, so I have trimmed some information from this post (think script kiddies).

If you are only using this server for proof of concept development and testing, then you can probably stop reading and ignore the rest of this post.

But if there is *any* chance of this machine becoming a live production system in future (or being used as the basis for one), then I would strongly recommend some security work and post edits are performed sooner rather than later (in my experience, later never happens, because security costs money).

1) Suggest remove your public IP address from your post - that information is 'need to know' generally.

2) Having 8080 on the end infers direct tomcat access since that is the default for alfresco (not to mention what you see if you go to the bare hostnameort - the default tomcat page). However, Tomcat is not a robust web server - not like apache or nginx - suggest you proxy through either of those as soon as possible. You can solve this and #3 and #4 below with a proxy web server config. [No flame wars, thanks - tomcat is fine as the app server but it definitely is not a robust web server in the security sense]

3) It appears that solr is enabled on that public interface (it prompted me to login and gave me access to your solr instance with the default client certificate...). Solr should be limited to localhost connections (tunnelling over ssh works fine, I do it often). Unless you have a cluster, I am not aware of any reason for solr to accept connections from anywhere but the local machine itself.

4) 'Plain text' (not SSL encrypted) port 8080 logins will expose the userid and password to every device between you and that server - suggest switch to forced https to limit who can see the logon details. In some countries the ISP may store this information indefinitely. In some (possible the same) countries, the ISP's are required by Law to store it *and* provide it to government upon request (and yes Australia is one of them, and yes, they share it).

5) Hopefully a firewall (at worst, ufw) is protecting the 'other tomcat ports', and/or you have changed the shutdown command to something new. If your alfresco instance stops 'randomly', this may explain why - it is trivial to do.

6) Maybe copy the service mimetype information here rather than provide a link directly to your alfresco server. I see there is Basic Auth logon in front of it so we are not able to see what is there anyway.

Re: Content Transformations not available

enigma969 — Thu, 15 Dec 2016 09:56:35 GMT

It's a development server and just for testing, but you are right. I removed the IP address.

Re: Content Transformations not available

enigma969 — Thu, 15 Dec 2016 09:56:49 GMT

Thanks for this information.

Re: Content Transformations not available

enigma969 — Thu, 15 Dec 2016 10:19:03 GMT

For ooo.enabled=false / jodconverter.enabled=true I get following transformations at alfresco/service/mimetypes

Transformable From:
application/vnd.apple.keynote = org.alfresco.repo.content.transform.AppleIWorksContentTransformer
application/vnd.apple.numbers = org.alfresco.repo.content.transform.AppleIWorksContentTransformer
application/vnd.apple.pages = org.alfresco.repo.content.transform.AppleIWorksContentTransformer
image/tiff = Proxy via: com.sun.proxy.$Proxy18 (Version: ImageMagick 6.8.6-6 2014-01-08 Q16 http://www.imagemagick.org Copyright: Copyright (C) 1999-2013 ImageMagick Studio LLC Features: DPC Modules Delegates: freetype jng jpeg png ps tiff wmf zlib)
text/csv = org.alfresco.repo.content.transform.TextToPdfContentTransformer
text/xml = org.alfresco.repo.content.transform.TextToPdfContentTransformer

For ooo.enabled=true / jodconverter.enabled=false I achieve following transformations.

Transformable From:
application/msword = Using a Direct Open Office Connection
application/rtf = Using a Direct Open Office Connection
application/vnd.apple.keynote = org.alfresco.repo.content.transform.AppleIWorksContentTransformer
application/vnd.apple.numbers = org.alfresco.repo.content.transform.AppleIWorksContentTransformer
application/vnd.apple.pages = org.alfresco.repo.content.transform.AppleIWorksContentTransformer
application/vnd.ms-excel = Using a Direct Open Office Connection
application/vnd.ms-excel.sheet.binary.macroenabled.12 = Using a Direct Open Office Connection
application/vnd.ms-excel.sheet.macroenabled.12 = Using a Direct Open Office Connection
application/vnd.ms-excel.template.macroenabled.12 = Using a Direct Open Office Connection
application/vnd.ms-outlook = Complex via: text/plain
application/vnd.ms-powerpoint = Using a Direct Open Office Connection
application/vnd.ms-powerpoint.addin.macroenabled.12 = Using a Direct Open Office Connection
application/vnd.ms-powerpoint.presentation.macroenabled.12 = Using a Direct Open Office Connection
application/vnd.ms-powerpoint.slide.macroenabled.12 = Using a Direct Open Office Connection
application/vnd.ms-powerpoint.template.macroenabled.12 = Using a Direct Open Office Connection
application/vnd.ms-word.document.macroenabled.12 = Using a Direct Open Office Connection
application/vnd.ms-word.template.macroenabled.12 = Using a Direct Open Office Connection
application/vnd.oasis.opendocument.graphics = Using a Direct Open Office Connection
application/vnd.oasis.opendocument.presentation = Using a Direct Open Office Connection
application/vnd.oasis.opendocument.presentation-template = Using a Direct Open Office Connection
application/vnd.oasis.opendocument.spreadsheet = Using a Direct Open Office Connection
application/vnd.oasis.opendocument.spreadsheet-template = Using a Direct Open Office Connection
application/vnd.oasis.opendocument.text = Using a Direct Open Office Connection
application/vnd.oasis.opendocument.text-template = Using a Direct Open Office Connection
application/vnd.openxmlformats-officedocument.presentationml.presentation = Using a Direct Open Office Connection
application/vnd.openxmlformats-officedocument.presentationml.slide = Using a Direct Open Office Connection
application/vnd.openxmlformats-officedocument.presentationml.template = Using a Direct Open Office Connection
application/vnd.openxmlformats-officedocument.spreadsheetml.sheet = Using a Direct Open Office Connection
application/vnd.openxmlformats-officedocument.spreadsheetml.template = Using a Direct Open Office Connection
application/vnd.openxmlformats-officedocument.wordprocessingml.document = Using a Direct Open Office Connection
application/vnd.openxmlformats-officedocument.wordprocessingml.template = Using a Direct Open Office Connection
application/vnd.sun.xml.calc = Using a Direct Open Office Connection
application/vnd.sun.xml.calc.template = Using a Direct Open Office Connection
application/vnd.sun.xml.impress = Using a Direct Open Office Connection
application/vnd.sun.xml.impress.template = Using a Direct Open Office Connection
application/vnd.sun.xml.writer = Using a Direct Open Office Connection
application/vnd.sun.xml.writer.template = Using a Direct Open Office Connection
application/vnd.visio = Using a Direct Open Office Connection
application/wordperfect = Using a Direct Open Office Connection
image/tiff = Proxy via: com.sun.proxy.$Proxy18 (Version: ImageMagick 6.8.6-6 2014-01-08 Q16 http://www.imagemagick.org Copyright: Copyright (C) 1999-2013 ImageMagick Studio LLC Features: DPC Modules Delegates: freetype jng jpeg png ps tiff wmf zlib)
text/csv = org.alfresco.repo.content.transform.TextToPdfContentTransformer
text/html = Complex via: application/vnd.oasis.opendocument.text
text/plain = Using a Direct Open Office Connection
text/xml = org.alfresco.repo.content.transform.TextToPdfContentTransformer

Looks much better and most documents can be converted. But I still have troubles converting a "application/vnd.openxmlformats-officedocument.wordprocessingml.document" document to PDF:

11:15:47,866 ERROR [org.alfresco.web.ui.common.Utils] [http-apr-8080-exec-4] Failed to create content due to error: 11150094 Transformer for 'application/vnd.openxmlformats-officedocument.wordprocessingml.document' source mime type and 'application/pdf' target mime type was not found. Operation can't be performed
org.alfresco.service.cmr.rule.RuleServiceException: 11150094 Transformer for 'application/vnd.openxmlformats-officedocument.wordprocessingml.document' source mime type and 'application/pdf' target mime type was not found. Operation can't be performed
at org.alfresco.repo.action.executer.TransformActionExecuter.executeImpl(TransformActionExecuter.java:186)
at org.alfresco.repo.action.executer.ActionExecuterAbstractBase.execute(ActionExecuterAbstractBase.java:265)
at org.alfresco.repo.action.ActionServiceImpl.directActionExecution(ActionServiceImpl.java:839)
at org.alfresco.repo.action.executer.CompositeActionExecuter.executeImpl(CompositeActionExecuter.java:66)
at org.alfresco.repo.action.executer.ActionExecuterAbstractBase.execute(ActionExecuterAbstractBase.java:265)
at org.alfresco.repo.action.ActionServiceImpl.directActionExecution(ActionServiceImpl.java:839)
at org.alfresco.repo.action.ActionServiceImpl.executeActionImpl(ActionServiceImpl.java:739)
at org.alfresco.repo.action.ActionServiceImpl.executeAction(ActionServiceImpl.java:573)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.alfresco.repo.security.permissions.impl.AlwaysProceedMethodInterceptor.invoke(AlwaysProceedMethodInterceptor.java:34)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.alfresco.repo.security.permissions.impl.ExceptionTranslatorMethodInterceptor.invoke(ExceptionTranslatorMethodInterceptor.java:46)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.alfresco.repo.audit.AuditMethodInterceptor.invoke(AuditMethodInterceptor.java:158)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:110)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
at com.sun.proxy.$Proxy45.executeAction(Unknown Source)
at org.alfresco.repo.rule.RuleServiceImpl.executeAction(RuleServiceImpl.java:1250)
at org.alfresco.repo.rule.RuleServiceImpl.executeRule(RuleServiceImpl.java:1244)
at org.alfresco.repo.rule.RuleServiceImpl.executePendingRule(RuleServiceImpl.java:1190)
at org.alfresco.repo.rule.RuleServiceImpl.executePendingRulesImpl(RuleServiceImpl.java:1119)
at org.alfresco.repo.rule.RuleServiceImpl.executePendingRules(RuleServiceImpl.java:1092)
at org.alfresco.repo.rule.RuleTransactionListener.beforeCommit(RuleTransactionListener.java:57)
at org.alfresco.repo.transaction.AlfrescoTransactionSupport$TransactionSynchronizationImpl.doBeforeCommit(AlfrescoTransactionSupport.java:737)
at org.alfresco.repo.transaction.AlfrescoTransactionSupport$TransactionSynchronizationImpl.doBeforeCommit(AlfrescoTransactionSupport.java:717)
at org.alfresco.repo.transaction.AlfrescoTransactionSupport$TransactionSynchronizationImpl.beforeCommit(AlfrescoTransactionSupport.java:683)
at org.springframework.transaction.support.TransactionSynchronizationUtils.triggerBeforeCommit(TransactionSynchronizationUtils.java:95)
at org.springframework.transaction.support.AbstractPlatformTransactionManager.triggerBeforeCommit(AbstractPlatformTransactionManager.java:927)
at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:737)
at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:723)
at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:393)
at org.alfresco.util.transaction.SpringAwareUserTransaction.commit(SpringAwareUserTransaction.java:481)
at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:476)
at org.alfresco.web.bean.dialog.BaseDialogBean.finish(BaseDialogBean.java:129)
at org.alfresco.web.bean.dialog.DialogManager.finish(DialogManager.java:528)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.myfaces.el.MethodBindingImpl.invoke(MethodBindingImpl.java:132)
at org.apache.myfaces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:61)
at javax.faces.component.UICommand.broadcast(UICommand.java:151)
at javax.faces.component.UIViewRoot._broadcastForPhase(UIViewRoot.java:115)
at javax.faces.component.UIViewRoot.processApplication(UIViewRoot.java:191)
at org.apache.myfaces.lifecycle.InvokeApplicationExecutor.execute(InvokeApplicationExecutor.java:32)
at org.apache.myfaces.lifecycle.LifecycleImpl.executePhase(LifecycleImpl.java:105)
at org.apache.myfaces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:80)
at javax.faces.webapp.FacesServlet.service(FacesServlet.java:143)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.alfresco.repo.web.filter.beans.SessionSynchronizedFilter.doFilter(SessionSynchronizedFilter.java:67)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.alfresco.web.app.servlet.AuthenticationFilter.doFilter(AuthenticationFilter.java:105)
at sun.reflect.GeneratedMethodAccessor535.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.alfresco.repo.management.subsystems.ChainingSubsystemProxyFactory$1.invoke(ChainingSubsystemProxyFactory.java:125)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
at com.sun.proxy.$Proxy300.doFilter(Unknown Source)
at org.alfresco.repo.web.filter.beans.BeanProxyFilter.doFilter(BeanProxyFilter.java:82)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.alfresco.repo.web.filter.beans.NullFilter.doFilter(NullFilter.java:68)
at sun.reflect.GeneratedMethodAccessor535.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.alfresco.repo.management.subsystems.ChainingSubsystemProxyFactory$1.invoke(ChainingSubsystemProxyFactory.java:125)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
at com.sun.proxy.$Proxy300.doFilter(Unknown Source)
at org.alfresco.repo.web.filter.beans.BeanProxyFilter.doFilter(BeanProxyFilter.java:82)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.alfresco.web.app.servlet.GlobalLocalizationFilter.doFilter(GlobalLocalizationFilter.java:61)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:501)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1040)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)
at org.apache.tomcat.util.net.AprEndpoint$SocketWithOptionsProcessor.run(AprEndpoint.java:2378)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

Unfortunately, I cannot upload this document due to NDA. It has 163 pages, contains text and images and is 6mb in size.

Re: Content Transformations not available

briant — Thu, 15 Dec 2016 16:11:18 GMT

A complex document for a dev machine. Using sysinternals process explorer, how much memory does Word use when it has that same document open, as I would expect LO will need that much in addition to what alfresco needs, before swap becomes an issue.

Do you have a LibreOffice desktop machine to try opening the document and then see what memory it is using - or whether it can open such a complex document.

Or since it is a VPS maybe just double the memory and test again. And again if it still fails, complex docs take a mountain of ram.

I too have (funnily enough) a 160+ page complex engineering report (also NDA sorry everyone) that required me to up the conversion timeout (and file size limit) on my lowly atom server, but giving it more RAM helped.

Details here: https://community.alfresco.com/docs/DOC-6111-content-transformation-limits#w_transformerlimits

That said, it doesn't sound like you are getting a timeout - the log doesn't indicate that. And if memory was truly an issue then I would expect it to swap, leading to a timeout...

Have you altered the java commandline opts for Mx, Ms, etc? I would expect you will need to for such docs.

Does LO sit at 100% cpu for a while when this is happening? Are you able to time it or monitor it's memory use during that time? Especially any swap use of the machine at all.

One last thing: if you tail the logfile, how long after the document is uploaded before the log message is generated?

If instantaneous then it (maybe) infers an issue with alfresco, but if after a big delay with LO at 100% cpu then other factors are likely at play.

I'd start with doubling your RAM, or for your extremely complex documents, perhaps double it again, at least for testing. That, and ensuring the jvm can use it by checking the commandline Xmx values to start with.

Some info on that here JVM settings | Alfresco Documentation

Edit: typos, corrected link to the right JVM tuning guide for the OP alfresco version.

Re: Content Transformations not available

kgastaldo — Thu, 15 Dec 2016 19:06:13 GMT

Hey Brian - You should be able to send private messages to anyone who you follow (and follows you back). Just make that connection, and then you'll see the option.

Re: Content Transformations not available

michael_s1 — Thu, 15 Dec 2016 20:26:59 GMT

I was of the impression that there was a 1MB limit on conversion. I could be wrong.

Michael

Re: Content Transformations not available

enigma969 — Fri, 16 Dec 2016 07:39:48 GMT

No, if I save the document as application/msword it has 8mb and it gets converted without problems.

Re: Content Transformations not available

enigma969 — Fri, 16 Dec 2016 07:45:52 GMT

Memory can't be an issue, the VPS has 32GB and more than enough is free while converting. My LO at my desktop machine converts the document without problems.

When I save the document as application/msword it also gets converted without problems on the VPS.

The document is not that problematic, I am allowed to publish it: AAFALL 20161212 iD Research NEDERMAN.docx - Google Drive

Edit: Is there a LibreOffice specific log anywhere?

Re: Content Transformations not available

briant — Fri, 16 Dec 2016 12:40:17 GMT

I'm unaware of a log file specific to LO by default. There is a config for transformations. I haven't used it.

In my environment /opt/alfresco/tomcat/shared/classes/alfresco/extension/custom-log4j.properties.sample contains:

#log4j.logger.org.alfresco.repo.content.transform.TransformerDebug=debug

Are you able to post the jvm commandline for us to see the mx/ms/etc settings (ala "ps ax | grep java"). The default jvm settings may not be optimal in this instance and it canot use more than those settings allow, irrespective of the memory available to the OS.

and more than enough is free

This could actually be the problem if mx, etc too small - iirc the default is Xmx4096 ? which is quite limited for that document - it needs more.

Re: Content Transformations not available

enigma969 — Fri, 16 Dec 2016 16:46:05 GMT

Enabling log4j.logger.org.alfresco.repo.content.transform.TransformerDebug=debug hasn't resulted in more outputs.

Alfresco Process:

/opt/Alfresco/java/bin/java -Djava.util.logging.config.file=/opt/Alfresco/tomcat/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -XX:MaxPermSize=512m -Xms128m -Xmx2G -XX:+DisableExplicitGC -Djava.awt.headless=true -Dalfresco.home=/opt/Alfresco -Dcom.sun.management.jmxremote -Dsun.security.ssl.allowUnsafeRenegotiation=true -XX:ReservedCodeCacheSize=128m [...]

Any idea how to start it with more memory?

Re: Content Transformations not available

briant — Fri, 16 Dec 2016 23:44:03 GMT

I did some testing just now and on 5.1 I needed 2 extra lines in that file to make it work (mentioned here for v5.0 Troubleshooting OpenOffice subsystems | Alfresco Documentation 😞

log4j.logger.org.alfresco.enterprise.repo.content=DEBUG
log4j.logger.org.artofsolving.jodconverter=DEBUG

You will need to bounce tomcat afterwards I believe. Then you'll get info like so in catalina.out/alfresco.log:

2016-12-17 15:27:32,722 DEBUG [content.transform.TransformerDebug] [pool-13-thread-1] 2 ods pdf MyWhois-v7.2.ods 678.7 KB -- pdf -- ContentService.transform(...)
2016-12-17 15:27:32,724 DEBUG [content.transform.TransformerDebug] [pool-13-thread-1] 2 workspace://SpacesStore/92d8f49a-ae9d-4007-ad4c-7cc68412fa50
2016-12-17 15:27:32,724 DEBUG [content.transform.TransformerDebug] [pool-13-thread-1] 2 **a) [110] OpenOffice<<Proxy>> 0 ms
2016-12-17 15:27:32,725 DEBUG [content.transform.TransformerDebug] [pool-13-thread-1] 2.1 ods pdf MyWhois-v7.2.ods 678.7 KB OpenOffice<<Proxy>>
2016-12-17 15:28:05,043 DEBUG [content.transform.TransformerDebug] [pool-13-thread-1] 2 Finished in 32,323 ms

For your memory shortage I would start with changing Xmx2G => Xmx8G (or 4, but it seems there is "plenty" of free memory on this system), You can change it in /opt/alfresco/tomcat/bin/setenv.sh in the JAVA_OPTS line on my system. Yours may start using different scripts and could be located elsewhere.

Actually, can you confirm it is running a 64-bit jvm (otherwise going over 4G is nonsensical):

alfresco:/opt/alfresco/tomcat/shared/classes # java -version
...
OpenJDK 64-Bit Server VM (build ******, mixed mode)

It should be the 64-bit one if you installed from the Linux binary installer I believe, but I may be incorrect on that point.

Per the tuning guide I linked above:

For most cases, tuning the JVM is done in three steps:
Throw as much RAM as possible at the JVM (-Xmx32G),
Set the perm gen to 256M (-XX:MaxPermSize:256m), NB: ignored with java > 8
Don't add any other configuration settings.

Xmx32G would exceed your instance's capability leaving nothing for the OS, LO, etc => huge swapping, which is to be avoided at all costs. (Timeouts during complex conversions are much more likely [almost a given] when swap is being thrashed).

I am unaware if the PermGen needs changing - I have done so in the past on earlier alfresco versions (3.x, 4.x) but they were 32-bit java not 64 like I have now. Suggest monitor for those OutOfPermGen space messages, but I seem to recall that some work was done in this area recently - not certain though.

Edit: At startup I see this so I guess not: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=256M; support was removed in 8.0

Personally, I would jump straight to mx8G, monitor the system while it processes that document (and any others that fail), and if there is still plenty of free memory *and* conversions are still failing, up it again to 12, then 16. Provided the machine is not swapping, keep giving it more.

Lastly, the memory requirement for LO (at least 1G) and the OS must be taken into consideration and remember to leave some memory for the database also - I see your config indicates a local postgres instance.

Edits: fix message re permgen and java 8, add debug info and location of JAVA_OPTS

Re: Content Transformations not available

enigma969 — Mon, 19 Dec 2016 13:51:13 GMT

I found this errors in alfresco.log before the other main exception I posted above:

14:23:14,964 ERROR [org.alfresco.repo.content.transform.TransformerConfigDynamicTransformers] [http-apr-8080-exec-1] Cannot create dynamic transformer transformer.complex.JodConverter.Image as sub transformers could not be found or created ("JodConverter.2Pdf|pdf|complex.PDF.Image").
14:23:14,964 ERROR [org.alfresco.repo.content.transform.TransformerConfigDynamicTransformers] [http-apr-8080-exec-1] Cannot create dynamic transformer transformer.complex.JodConverter.Pdf2swf as sub transformers could not be found or created ("JodConverter.2Pdf|pdf|Pdf2swf").
14:23:14,964 ERROR [org.alfresco.repo.content.transform.TransformerConfigDynamicTransformers] [http-apr-8080-exec-1] Cannot create dynamic transformer transformer.JodConverter.Html2Pdf as sub transformers could not be found or created ("JodConverter|odt|JodConverter").
14:23:14,964 ERROR [org.alfresco.repo.content.transform.TransformerConfigDynamicTransformers] [http-apr-8080-exec-1] Cannot create dynamic transformer transformer.JodConverter.2Pdf as sub transformers could not be found or created ("JodConverter|JodConverter.Html2Pdf").
14:23:14,964 ERROR [org.alfresco.repo.content.transform.TransformerConfigDynamicTransformers] [http-apr-8080-exec-1] Cannot create dynamic transformer transformer.complex.JodConverter.PdfBox as sub transformers could not be found or created ("JodConverter.2Pdf|pdf|PdfBox").
14:23:15,118 INFO [org.alfresco.repo.management.subsystems.ChildApplicationContextFactory] [http-apr-8080-exec-1] Startup of 'Transformers' subsystem, ID: [Transformers, default] complete

Adding the two lines in the log4j file resulted in no error output at all.

Setting max. Memory to 8 / 16GB lead to an "OutOfMemoryError: PermGen space" Exception and Tomcat didn't start at all.

setenv.conf

JAVA_HOME=/opt/Alfresco/java
JRE_HOME=/opt/Alfresco/java
JAVA_OPTS="-Xmx16G"
export JAVA_HOME
export JRE_HOME
export JAVA_OPTS

Java version

java version "1.8.0_72"
Java(TM) SE Runtime Environment (build 1.8.0_72-b15)
Java HotSpot(TM) 64-Bit Server VM (build 25.72-b15, mixed mode)

Are you able to convert my document to a PDF with Alfresco? Maybe I just have to upgrade my Version?

Why is JODConverter not working with my setup?

Re: Content Transformations not available

briant — Tue, 20 Dec 2016 02:23:00 GMT

Why is JODConverter not working with my setup?

We don't have enough information yet to answer that question.

Did you install Java manually in /opt/Alfresco and Alfresco itself in /opt/alfresco-5.0.a ? Better question: How was this system installed - using the Linux All-In-One installer, or manually?

I ask because you specified a non-default java location:

JAVA_HOME=/opt/Alfresco/java
JRE_HOME=/opt/Alfresco/java

..and yet in the global properties file the default installer locations are specified:

dir.root=/opt/alfresco-5.0.a/alf_data
...
jodconverter.officeHome=/opt/alfresco-5.0.a/libreoffice

It is perfectly OK to have java installed elsewhere (on my FreeBSD systems it lives under /usr...) - I am just trying to understand your setup and eliminate gotchas like incorrect paths and typos, running the default alfresco JVM instead of the system installed one, etc

Setting max. Memory to 8 / 16GB lead to an "OutOfMemoryError: PermGen space" Exception and Tomcat didn't start at all.
..
JAVA_OPTS="-Xmx16G"

EDIT: If it complained about PermGen space at startup then it possibly (probably?) is using the JDK that would have been installed by the all-in-one installer under /opt/alfresco-5.0.a/java/ - which (given that it produces that error) is most likely a Java 7 JDK - in which case the -XX:MaxPermSize=256M (or 512M since you have plenty of memory and complex docs) is a required entry in JAVA_OPTS or it exhibits exactly the behaviour you describe - failure at startup with an OutOfMemory: PermGen space exception.

With that in mind, can you confirm the JAVA_HOME location from a script that is used to start alfresco? It can be overridden in several locations so you may need to check them all, depending how this system was installed... It was my bad before to suggest you run java -version at the command line - that will find and run the one on your path, which is not necessarily the same one used by alfresco.

End EDIT.

Our JAVA_OPTS variable has much more than just the Xmx entry, and I believe you will have problems without an Xms###M or -Dalfresco.home entries, etc etc. It is no surprise to me that it failed to start with just an Xmx entry - or did you do something else in addition to the Xmx line and did not include that info? Remember we cannot see what you did unless you tell us

In our config (from our 5.0.c backup on the old Atom server), /opt/alfresco/tomcat/bin/setenv.sh contains a JAVA_OPTS entry as below:

JAVA_OPTS="-XX:+DisableExplicitGC -Djava.awt.headless=true -Dalfresco.home=/opt/alfresco -Dcom.sun.management.jmxremote -XX:ReservedCodeCacheSize=128m -Xms512M -Xmx2048M -XX:MaxPermSize=256M $JAVA_OPTS"

(It was upgraded from Java7 -> 8, hence the MaxPermSize entry is still there. Memory constrained Atom -> Xmx2048M)

On another Ubuntu running 5.0.d, we have upstart script /etc/init/alfresco.conf which contains the JAVA_HOME and JAVA_OPTS definition.

Adding the two lines in the log4j file resulted in no error output at all.

Please can you post your /opt/alfresco-5.0.a/tomcat/shared/classes/alfresco/extension/custom-log4j.properties here. Mine configured as below works perfectly (*AND* noisily - you will not want to leave it on once this issue is solved, otherwise very many log entries will be written). The 2 RunTime entries are optional - it worked both with and without them.

log4j.logger.org.alfresco.repo.content.transform.TransformerDebug=debug
log4j.logger.org.alfresco.enterprise.repo.content=DEBUG
#log4j.logger.org.artofsolving.jodconverter=DEBUG We use OODirect so this entry is not needed for us
log4j.logger.org.alfresco.util.exec.RuntimeExecBootstrapBean=debug
log4j.logger.org.alfresco.util.exec.RuntimeExec=debug

Remember to always restart tomcat after making any changes to this file or the startup scripts.

Alterntively, why not spin up another VPS instance and install 5.0.d or 5.1 GA - as it is only for dev and test? I feel that may be quicker, solves any bugs you will find running a "3 versions behind" 5.0.a system, and ensures the installer puts everything where it should be, including all startup scripts. Personally I would go directly to 5.1 GA.

Edits: Many

Re: Content Transformations not available

enigma969 — Tue, 20 Dec 2016 09:06:27 GMT

Did you install Java manually in /opt/Alfresco and Alfresco itself in /opt/alfresco-5.0.a ? Better question: How was this system installed - using the Linux All-In-One installer, or manually?

I ask because you specified a non-default java location:
JAVA_HOME=/opt/Alfresco/java
JRE_HOME=/opt/Alfresco/java
..and yet in the global properties file the default installer locations are specified:
dir.root=/opt/alfresco-5.0.a/alf_data
...
jodconverter.officeHome=/opt/alfresco-5.0.a/libreoffice

It is perfectly OK to have java installed elsewhere (on my FreeBSD systems it lives under /usr...) - I am just trying to understand your setup and eliminate gotchas like incorrect paths and typos, running the default alfresco JVM instead of the system installed one, etc

Sorry for the confusion, it is /opt/Alfresco of course, the file here is from another machine I tried using exactly the same configuration, except this alfresco path. Same alfresco version, same errors. This path shouldn't be the cause. I updated the config file.

Our JAVA_OPTS variable has much more than just the Xmx entry, and I believe you will have problems without an Xms###M or -Dalfresco.home entries, etc etc. It is no surprise to me that it failed to start with just an Xmx entry - or did you do something else in addition to the Xmx line and did not include that info? Remember we cannot see what you did unless you tell us

In our config (from our 5.0.c backup on the old Atom server), /opt/alfresco/tomcat/bin/setenv.sh contains a JAVA_OPTS entry as below:
JAVA_OPTS="-XX:+DisableExplicitGC -Djava.awt.headless=true -Dalfresco.home=/opt/alfresco -Dcom.sun.management.jmxremote -XX:ReservedCodeCacheSize=128m -Xms512M -Xmx2048M -XX:MaxPermSize=256M $JAVA_OPTS"
(It was upgraded from Java7 -> 8, hence the MaxPermSize entry is still there. Memory constrained Atom -> Xmx2048M)

Originally, I just had "JAVA_OPTS="$JAVA_OPTS " in setenv.sh. Now I set JAVA_OPTS as in your file just with more memory:

JAVA_HOME=/opt/Alfresco/java
JRE_HOME=/opt/Alfresco/java
JAVA_OPTS="-XX:+DisableExplicitGC -Djava.awt.headless=true -Dalfresco.home=/opt/Alfresco -Dcom.sun.management.jmxremote -XX:ReservedCodeCacheSize=128m -Xms2048M -Xmx16G -XX:MaxPermSize=2048M $JAVA_OPTS"
export JAVA_HOME
export JRE_HOME
export JAVA_OPTS

and now Alfresco starts without problems. But the error for this document still appears.

Please can you post your /opt/alfresco-5.0.a/tomcat/shared/classes/alfresco/extension/custom-log4j.properties here. Mine configured as below works perfectly (*AND* noisily - you will not want to leave it on once this issue is solved, otherwise very many log entries will be written). The 2 RunTime entries are optional - it worked both with and without them.

The file looks exactly the same as yours. No additional error logs as I already posted.

Alterntively, why not spin up another VPS instance and install 5.0.d or 5.1 GA - as it is only for dev and test? I feel that may be quicker, solves any bugs you will find running a "3 versions behind" 5.0.a system, and ensures the installer puts everything where it should be, including all startup scripts. Personally I would go directly to 5.1 GA.

I set up a 5.0.d instance and got exactly the same errors.

Have you tried converting this document on one of your machines? Maybe it is just a document that can't be converted with Alfresco/LO at all?

Thanks for your support.

Re: Content Transformations not available

briant — Tue, 20 Dec 2016 15:40:45 GMT

Is the custom-log4j.properties file readable by the user (usually alfresco) running tomcat? That's the only reason I can think of unless logs have been redirected elsewhere or logging disabled somehow.

I added the debug lines to our 5.0.d and it produced debug entries in /var/log/upstart/alfresco.log when adding content. I am at a loss as to why it doesn't work on your systems.

Have you tried converting this document on one of your machines?

I don't have a dev machine to test it on unfortunately.

Wish I could help more but I am out of ideas now. 5.1 install perhaps? Up the memory and try again?

Re: Content Transformations not available

mrks_js1 — Wed, 22 Mar 2017 13:28:37 GMT

these are the defaults (taken from https://svn.alfresco.com/repos/alfresco-open-mirror/alfresco/HEAD/root/projects/repository/config/alfresco/subsystems/Tr… 😞

content.transformer.OpenOffice.extensions.docx.pdf.maxSourceSizeKBytes=768
content.transformer.OpenOffice.extensions.doc.pdf.maxSourceSizeKBytes=10240‍‍‍‍

application/msword = .doc

application/vnd.openxmlformats-officedocument.wordprocessingml.document = .docx

try adding

content.transformer.OpenOffice.extensions.docx.pdf.maxSourceSizeKBytes=10240‍‍‍‍‍