Hyland Community
Help
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Question about upload Issue in Alfresco 6.2 Content Services

Go to answer
ujkim
Confirmed Champ
Confirmed Champ

‎10-27-2020 11:00 PM

We installed the Alfresco 6.2.0-ga version(by acs-deployment docker service).

Currently, our system is operating community service with

alfresco 12G, share 12G, Tika 4G, solr 4G, proxy 128MB system.

We're having an issue with uploads.

When uploading data of 200MB or more, 504 Gateway Timeout occurs.

The above issue occurs, but the data is uploaded.

Why am I getting the above error? Should I check the proxy level?

The proxy currently uses the alfresco/acs-community-nginx:1.0.0 docker image.

The related logs are as follows.

imageUpload Issue Invoked Screen

alfresco_1               | 2020-10-28T02:45:11.806311828Z 2020-10-28 02:45:11,805  WARN  [content.metadata.AbstractMappingMetadataExtracter] [http-nio-8080-exec-26] Metadata extraction failed (turn on DEBUG for full error):    Extracter: org.alfresco.repo.content.metadata.PoiMetadataExtracter@6dca4305   Content:   ContentAccessor[ contentUrl=store://2020/10/28/2/44/8d00f12b-53c1-4bbe-831e-8127039d9abf.bin, mimetype=application/vnd.openxmlformats-officedocument.wordprocessingml.document, size=301445085, encoding=UTF-8, locale=ko_KR]   Failure:   nullnull

Can I get any advice on this?

(For reference, a comment on a similar issue was found in JIRA. Could this be reflected in the latest version? 504 Gateway Timeout Error )

I would like to remind users that alfresco is a good service.

Thanks

Labels:
0 Kudos
1 ACCEPTED ANSWER

Go to answer
abhinavmishra14
World-Class Innovator
World-Class Innovator
In response to ujkim

‎10-29-2020 04:33 PM 


2020-10-29 02:54:21,152 DEBUG [org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter] [http-nio-8080-exec-9] Starting metadata extraction:    reader: ContentAccessor[ contentUrl=store://2020/10/29/2/53/5b2f49f9-7b8c-42f0-8fb9-9ca6adee161b.bin, mimetype=application/vnd.openxmlformats-officedocument.wordprocessingml.document, size=301445085, encoding=UTF-8, locale=ko_KR]   extracter: org.alfresco.repo.content.metadata.PoiMetadataExtracter@25a51c06
2020-10-29 02:54:21,154 DEBUG [org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter] [http-nio-8080-exec-9] Concurrent extractions : 0
2020-10-29 02:54:21,155 DEBUG [org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter] [http-nio-8080-exec-9] New extraction accepted. Concurrent extractions : 1
2020-10-29 02:54:41,207 DEBUG [org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter] [http-nio-8080-exec-9] Extraction finalized. Remaining concurrent extraction : 0
2020-10-29 02:54:41,950 DEBUG [org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter] [http-nio-8080-exec-9] Metadata extraction failed:    Extracter: org.alfresco.repo.content.metadata.PoiMetadataExtracter@25a51c06   Content:   ContentAccessor[ contentUrl=store://2020/10/29/2/53/5b2f49f9-7b8c-42f0-8fb9-9ca6adee161b.bin, mimetype=application/vnd.openxmlformats-officedocument.wordprocessingml.document, size=301445085, encoding=UTF-8, locale=ko_KR]null
java.util.concurrent.TimeoutException
        at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:204)
        at org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter.extractRaw(AbstractMappingMetadataExtracter.java:2093)
        at org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter.extract(AbstractMappingMetadataExtracter.java:1185)
        at org.alfresco.repo.content.metadata.AbstractMappingMetadataExtracter.extract(AbstractMappingMetadataExtracter.java:1135)
        at org.alfresco.repo.action.executer.ContentMetadataExtracter.executeImpl(ContentMetadataExtracter.java:374)
       .......

Seems like it is timing out while doing metadata extraction. The default limit for metadata extractor in general is '20000 ms'. As the error log suggets, the operation is getting timedout in repository.

See here:

https://github.com/Alfresco/alfresco-community-repo/blob/master/repository/src/main/resources/alfres...

# The default timeout for metadata mapping extracters
content.metadataExtracter.default.timeoutMs=20000

There are limits on timeout and size too: 

See here, the size limit check: https://github.com/Alfresco/alfresco-community-repo/blob/master/repository/src/main/java/org/alfresc...

Timeout check limit setting: https://github.com/Alfresco/alfresco-community-repo/blob/master/repository/src/main/java/org/alfresc...

Timeout check and error : https://github.com/Alfresco/alfresco-community-repo/blob/master/repository/src/main/java/org/alfresc...

Try increasing the value and retry upload op and see if it works for you.

Also, do you really need metadata extraction for these type of docs considering the heavy size? If you don't need to have metadata extracted, simply disable them.

#Disable metadata extraction
extracter.Poi.enabled=false
extracter.TikaAuto.enabled=false
extracter.PDFBox.enabled=false
extracter.Office.doc.enabled=false
extracter.Office.xls.enabled=false 
extracter.Office.ppt.enabled=false

~Abhinav
(ACSCE, AWS SAA, Azure Admin)

View answer in original post

12 REPLIES 12

Go to answer
abhinavmishra14
World-Class Innovator
World-Class Innovator
In response to ujkim

‎10-29-2020 04:36 PM

I used the acs docker compose image to change the nginx proxy settings you recommended.

In case of nginx, can I get any advice on how to change it?

I'm using it now. (https://github.com/Alfresco/acs-community-deployment/blob/3.0.1/docker-compose/docker-compose.yml)

I think timeout issue is not rulled out from repo side, so first try increasing the timeout or disabling it. 

If you have to increase the timeout on ngnix side, you would have to take help of DockerFile and build the ngnix image with custom config. 

Have a look at this DockerFile for ref: https://github.com/abhinavmishra14/change-acs-share-port-demo/blob/master/configs-to-override/proxy/...

And build instructions in docker-compose : https://github.com/abhinavmishra14/change-acs-share-port-demo/blob/master/docker-compose-v3.yml#L172

~Abhinav
(ACSCE, AWS SAA, Azure Admin)

Go to answer
ujkim
Confirmed Champ
Confirmed Champ
In response to abhinavmishra14

‎10-28-2020 11:50 PM

additional question, what is the Tika's Encrypted Error? When does it occurs? Can I get some information about issue too?

tika_1                   | 2020-10-29T03:01:00.058949295Z 2020-10-29 03:01:00.058 ERROR 1 --- [io-8090-exec-35] o.a.transformer.TransformController      : Unable to process: document is encrypted
tika_1                   | 2020-10-29T03:01:00.058962516Z
tika_1                   | 2020-10-29T03:01:00.058965117Z org.alfresco.transform.exceptions.TransformException: Unable to process: document is encrypted
tika_1                   | 2020-10-29T03:01:00.058966837Z       at org.alfresco.transformer.executors.TikaJavaExecutor.call(TikaJavaExecutor.java:74) ~[classes!/:2.1.0]
tika_1                   | 2020-10-29T03:01:00.058968783Z       at org.alfresco.transformer.TikaController.transform(TikaController.java:153) ~[classes!/:2.1.0]
tika_1                   | 2020-10-29T03:01:00.058970336Z       at jdk.internal.reflect.GeneratedMethodAccessor85.invoke(Unknown Source) ~[na:na]
tika_1                   | 2020-10-29T03:01:00.058971827Z       at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:na]
tika_1                   | 2020-10-29T03:01:00.058973349Z       at java.base/java.lang.reflect.Method.invoke(Method.java:566) ~[na:na]
tika_1                   | 2020-10-29T03:01:00.058974830Z       at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:190) ~[spring-web-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.058976458Z       at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:138) ~[spring-web-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.058978093Z       at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104) ~[spring-webmvc-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.058979719Z       at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:892) ~[spring-webmvc-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.058981357Z       at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:797) ~[spring-webmvc-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.058982977Z       at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) ~[spring-webmvc-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059009515Z       at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1039) ~[spring-webmvc-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059011654Z       at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:942) ~[spring-webmvc-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059013330Z       at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1005) ~[spring-webmvc-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059014965Z       at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:908) ~[spring-webmvc-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059024326Z       at javax.servlet.http.HttpServlet.service(HttpServlet.java:660) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059026317Z       at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:882) ~[spring-webmvc-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059027961Z       at javax.servlet.http.HttpServlet.service(HttpServlet.java:741) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059029616Z       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059031223Z       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059050807Z       at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) ~[tomcat-embed-websocket-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059052419Z       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059053966Z       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059055582Z       at org.springframework.boot.actuate.web.trace.servlet.HttpTraceFilter.doFilterInternal(HttpTraceFilter.java:88) ~[spring-boot-actuator-2.1.8.RELEASE.jar!/:2.1.8.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059057191Z       at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:118) ~[spring-web-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059058734Z       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059060281Z       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059061957Z       at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:99) ~[spring-web-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059063538Z       at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:118) ~[spring-web-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059065109Z       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059066664Z       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059068205Z       at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:92) ~[spring-web-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059069747Z       at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:118) ~[spring-web-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059071344Z       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059073952Z       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059075623Z       at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:93) ~[spring-web-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059077235Z       at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:118) ~[spring-web-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059078861Z       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059080768Z       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059082346Z       at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java:114) ~[spring-boot-actuator-2.1.8.RELEASE.jar!/:2.1.8.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059084015Z       at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:104) ~[spring-boot-actuator-2.1.8.RELEASE.jar!/:2.1.8.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059085840Z       at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:118) ~[spring-web-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059087486Z       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059089079Z       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059090621Z       at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:200) ~[spring-web-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059092226Z       at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:118) ~[spring-web-5.1.9.RELEASE.jar!/:5.1.9.RELEASE]
tika_1                   | 2020-10-29T03:01:00.059093788Z       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059095338Z       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059096956Z       at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059098508Z       at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059100066Z       at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:526) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059101608Z       at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059104062Z       at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059105654Z       at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059107187Z       at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059108698Z       at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059110439Z       at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059112162Z       at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:860) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059113735Z       at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1587) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059115276Z       at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059137465Z       at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[na:na]
tika_1                   | 2020-10-29T03:01:00.059139044Z       at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[na:na]
tika_1                   | 2020-10-29T03:01:00.059140598Z       at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) ~[tomcat-embed-core-9.0.24.jar!/:9.0.24]
tika_1                   | 2020-10-29T03:01:00.059142206Z       at java.base/java.lang.Thread.run(Thread.java:834) ~[na:na]
tika_1                   | 2020-10-29T03:01:00.059143723Z

Thank you for your favor!

0 Kudos

Go to answer
abhinavmishra14
World-Class Innovator
World-Class Innovator
In response to ujkim

‎10-29-2020 04:38 PM 

tika_1                   | 2020-10-29T03:01:00.058949295Z 2020-10-29 03:01:00.058 ERROR 1 --- [io-8090-exec-35] o.a.transformer.TransformController      : Unable to process: document is encrypted
tika_1                   | 2020-10-29T03:01:00.058962516Z
tika_1                   | 2020-10-29T03:01:00.058965117Z org.alfresco.transform.exceptions.TransformException: Unable to process: document is encrypted
tika_1                   | 2020-10-29T03:01:00.058966837Z       at org.alfresco.transformer.executors.TikaJavaExecutor.call(TikaJavaExecutor.java:74) ~[classes!/:2.1.0]
tika_1                   | 2020-10-29T03:01:00.058968783Z       at org.alfresco.transformer.TikaController.transform(TikaController.java:153) ~[classes!/:2.1.0]

As the error states 'tika_1 | 2020-10-29T03:01:00.058965117Z org.alfresco.transform.exceptions.TransformException: Unable to process: document is encrypted ',

it looks like document has some sort of encryption involved. Try a plain file and see of you get this error.

~Abhinav
(ACSCE, AWS SAA, Azure Admin)
Getting started

Explore our Alfresco products with the links below. Use labels to filter content by product module.

Copyright © 2024 Khoros, LLC