Error executing transfer

[pondermuse]

Hi,

We are currently running a few tests to see how well the Alfresco replication transfer service works in a poor network environment and we are experiencing transfer failures when introducing long packet delays into a low bandwidth network.

Under normal network conditions all transfers complete successfully but, when we introduce packet delivery delays into a lower bandwidth network (e.g. 500ms packet transmit delay, 500ms packet receive delay in a 256Kb/s pipe) we get the following transfer failed error when transferring data loads of over a certain size (roughly +1 MB data size in our tests so far):

11:00:21,339 User:admin ERROR [repo.transfer.HttpClientTransmitterImpl] Received "unsuccessful" response code from target server: 500
11:00:30,587  ERROR [repo.action.AsynchronousActionExecutionQueueImpl] Failed to execute asynchronous action: Action[ id=e95972f2-eda9-4b5f-916c-6f7cb9e74506, node=workspace://SpacesStore/e95972f2-eda9-4b5f-916c-6f7cb9e74506 ]
org.alfresco.service.cmr.replication.ReplicationServiceException: 00110010 Error executing transfer - 00110008 Transfer lock timed out transferId: {0}
   at org.alfresco.repo.replication.ReplicationActionExecutor.executeImpl(ReplicationActionExecutor.java:315)
   at org.alfresco.repo.action.executer.ActionExecuterAbstractBase.execute(ActionExecuterAbstractBase.java:133)
   at org.alfresco.repo.action.ActionServiceImpl.directActionExecution(ActionServiceImpl.java:749)
   at org.alfresco.repo.action.ActionServiceImpl.executeActionImpl(ActionServiceImpl.java:675)
   at org.alfresco.repo.action.AsynchronousActionExecutionQueueImpl$ActionExecutionWrapper$1$1.execute(AsynchronousActionExecutionQueueImpl.java:443)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:377)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:251)
   at org.alfresco.repo.action.AsynchronousActionExecutionQueueImpl$ActionExecutionWrapper$1.doWork(AsynchronousActionExecutionQueueImpl.java:452)
   at org.alfresco.repo.security.authentication.AuthenticationUtil.runAs(AuthenticationUtil.java:508)
   at org.alfresco.repo.action.AsynchronousActionExecutionQueueImpl$ActionExecutionWrapper.run(AsynchronousActionExecutionQueueImpl.java:455)
   at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
   at java.lang.Thread.run(Thread.java:619)
Caused by: org.alfresco.service.cmr.transfer.TransferException: 00110008 Transfer lock timed out transferId: {0}
   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
   at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
   at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
   at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
   at org.alfresco.util.json.ExceptionJsonSerializer.deserialize(ExceptionJsonSerializer.java:98)
   at org.alfresco.util.json.ExceptionJsonSerializer.deserialize(ExceptionJsonSerializer.java:40)
   at org.alfresco.repo.transfer.HttpClientTransmitterImpl.rehydrateError(HttpClientTransmitterImpl.java:687)
   at org.alfresco.repo.transfer.HttpClientTransmitterImpl.getStatus(HttpClientTransmitterImpl.java:561)
   at org.alfresco.repo.transfer.TransferServiceImpl2.transferImpl(TransferServiceImpl2.java:651)
   at org.alfresco.repo.transfer.TransferServiceImpl2.transfer(TransferServiceImpl2.java:527)
   at org.alfresco.repo.transfer.TransferServiceImpl2.transfer(TransferServiceImpl2.java:502)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:307)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
   at org.alfresco.repo.security.permissions.impl.AlwaysProceedMethodInterceptor.invoke(AlwaysProceedMethodInterceptor.java:34)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.alfresco.repo.security.permissions.impl.ExceptionTranslatorMethodInterceptor.invoke(ExceptionTranslatorMethodInterceptor.java:44)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.alfresco.repo.audit.AuditMethodInterceptor.proceed(AuditMethodInterceptor.java:178)
   at org.alfresco.repo.audit.AuditMethodInterceptor.invoke(AuditMethodInterceptor.java:137)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:107)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
   at $Proxy114.transfer(Unknown Source)
   at org.alfresco.repo.replication.ReplicationActionExecutor.executeImpl(ReplicationActionExecutor.java:283)
   … 12 more

Has anyone else tried the transfer service under poor network conditions before?

Thanks in advance for any help on this matter.

Regards,
PM

[mrogers]

You probably just need to increase the lock timeout.   What version are you using?

[kbonnet]

Hi Mark,

<blockquote>You probably just need to increase the lock timeout. </blockquote>

Where can the lock timeout be increased?

Thanks,

Koen

[pondermuse]

Hi mrogers,

Increasing the lock timeout is certainly worth trying. Where in Alfresco can this be configured? We are running the latest Alfresco 3.4b CE on Linux x64 hosts.

Cheers,
PM.

[pondermuse]

Hi,

Does anybody know whether the replication Transfer Service can be configured to better cope with transferring data over poor quality network paths? Or is the post's problem due to the way the Transfer Service's TCP socket configuration was setup at compile-time?

We are testing replication using various software systems and Alfresco is the only one which is struggling to transfer 1+ MB data files over our test network environment.

Any insightful answers on this matter would be much appreciated.

Regards,
PM.

[sameer1sharma]

Hi,
    Please find error stack. Prequisite: Alfresco 3.4.d, Linux 5, MySQL, 5.1.42

12:21:27,914 ERROR [org.alfresco.repo.transfer.HttpClientTransmitterImpl] Received "unsuccessful" response code from target server: 500
12:21:35,524 ERROR [org.alfresco.repo.action.AsynchronousActionExecutionQueueImpl] Failed to execute asynchronous action: Action[ id=2fbdacbc-7589-4801-b2a8-b56e8dceda02, node=workspace://SpacesStore/2fbdacbc-7589-4801-b2a8-b56e8dceda02 ]
org.alfresco.service.cmr.replication.ReplicationServiceException: 05140027 Error executing transfer - 05140025 Transfer lock timed out transferId: {0}
   at org.alfresco.repo.replication.ReplicationActionExecutor.executeImpl(ReplicationActionExecutor.java:315)
   at org.alfresco.repo.action.executer.ActionExecuterAbstractBase.execute(ActionExecuterAbstractBase.java:133)
   at org.alfresco.repo.action.ActionServiceImpl.directActionExecution(ActionServiceImpl.java:749)
   at org.alfresco.repo.action.ActionServiceImpl.executeActionImpl(ActionServiceImpl.java:675)
   at org.alfresco.repo.action.AsynchronousActionExecutionQueueImpl$ActionExecutionWrapper$1$1.execute(AsynchronousActionExecutionQueueImpl.java:443)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:381)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:253)
   at org.alfresco.repo.action.AsynchronousActionExecutionQueueImpl$ActionExecutionWrapper$1.doWork(AsynchronousActionExecutionQueueImpl.java:452)
   at org.alfresco.repo.security.authentication.AuthenticationUtil.runAs(AuthenticationUtil.java:508)
   at org.alfresco.repo.action.AsynchronousActionExecutionQueueImpl$ActionExecutionWrapper.run(AsynchronousActionExecutionQueueImpl.java:455)
   at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
   at java.lang.Thread.run(Thread.java:619)
Caused by: org.alfresco.service.cmr.transfer.TransferException: 05140025 Transfer lock timed out transferId: {0}
   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
   at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
   at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
   at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
   at org.alfresco.util.json.ExceptionJsonSerializer.deserialize(ExceptionJsonSerializer.java:92)
   at org.alfresco.util.json.ExceptionJsonSerializer.deserialize(ExceptionJsonSerializer.java:34)
   at org.alfresco.repo.transfer.HttpClientTransmitterImpl.rehydrateError(HttpClientTransmitterImpl.java:687)
   at org.alfresco.repo.transfer.HttpClientTransmitterImpl.getStatus(HttpClientTransmitterImpl.java:561)
   at org.alfresco.repo.transfer.TransferServiceImpl2.transferImpl(TransferServiceImpl2.java:654)
   at org.alfresco.repo.transfer.TransferServiceImpl2.transfer(TransferServiceImpl2.java:530)
   at org.alfresco.repo.transfer.TransferServiceImpl2.transfer(TransferServiceImpl2.java:505)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:307)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
   at org.alfresco.repo.security.permissions.impl.AlwaysProceedMethodInterceptor.invoke(AlwaysProceedMethodInterceptor.java:34)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.alfresco.repo.security.permissions.impl.ExceptionTranslatorMethodInterceptor.invoke(ExceptionTranslatorMethodInterceptor.java:44)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.alfresco.repo.audit.AuditMethodInterceptor.proceed(AuditMethodInterceptor.java:178)
   at org.alfresco.repo.audit.AuditMethodInterceptor.invoke(AuditMethodInterceptor.java:137)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:107)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
   at $Proxy105.transfer(Unknown Source)
   at org.alfresco.repo.replication.ReplicationActionExecutor.executeImpl(ReplicationActionExecutor.java:283)

I am facing the same error. Please help me.

:-Sameer Sharma

[sharifu]

I am getting this in 4.2.c

01063219 Error executing transfer - 01063216 Transfer lock timed out transferId: workspace://SpacesStore/8cb56c1a-08ad-4681-803d-d4c66c7f3842


How do i resolve this issue. It works from the opposite direction fine.

[kbonnet]

Hi posters,

Did anyone get any further with this? Is there a way to increase the lock timeout?

Koen