topic Repository lockup when loading workflow definition in Alfresco Forum https://connect.hyland.com/t5/alfresco-forum/repository-lockup-when-loading-workflow-definition/m-p/39091#M16448 <HTML><HEAD></HEAD><BODY><P>I'm in the process of upgrading from 4.2 to 5.1. The database, repository, share and Solr are all on separate machines.</P><P>The problem I'm having is that the repository does not complete starting up if a certain workflow is configured. The last few lines of the log file are:</P><PRE>2017-03-06 17:11:30,041 INFO [org.springframework.extensions.webscripts.DeclarativeRegistry] [asynchronouslyRefreshedCacheThreadPool1] Registered 0 Schema Description Documents (+0 failed)<BR />2017-03-06 17:11:32,300 INFO [org.springframework.extensions.webscripts.DeclarativeRegistry] [localhost-startStop-1] Registered 428 Web Scripts (+0 failed), 578 URLs<BR />2017-03-06 17:11:32,301 INFO [org.springframework.extensions.webscripts.DeclarativeRegistry] [localhost-startStop-1] Registered 1 Package Description Documents (+0 failed)<BR />2017-03-06 17:11:32,301 INFO [org.springframework.extensions.webscripts.DeclarativeRegistry] [localhost-startStop-1] Registered 0 Schema Description Documents (+0 failed)<BR />2017-03-06 17:11:32,304 INFO [org.springframework.extensions.webscripts.AbstractRuntimeContainer] [localhost-startStop-1] Initialised Repository Web Script Container (in 6844.422ms)<BR />2017-03-06 17:11:32,343 INFO [org.springframework.extensions.webscripts.TemplateProcessorRegistry] [localhost-startStop-1] Registered template processor freemarker for extension ftl<BR />2017-03-06 17:11:32,345 INFO [org.springframework.extensions.webscripts.ScriptProcessorRegistry] [localhost-startStop-1] Registered script processor javascript for extension js<BR />2017-03-06 17:11:32,352 DEBUG [org.alfresco.repo.workflow] [localhost-startStop-1] Workflow deployer: Definition 'alfresco/extension/workflow/dna.bpmn' already deployed</PRE><P>There are no errors in the log.</P><P></P><P>On a fresh install of 5.1 the workflow is deployed and the repository starts up fully.</P><P></P><P>On the upgraded system, if the workflow is deployed without its model, as below, then the system starts up fully.</P><PRE>&lt;?xml version="1.0" encoding="UTF-8" standalone="yes"?&gt;<BR />&lt;beans xmlns="http://www.springframework.org/schema/beans" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-2.0.xsd"&gt;<BR /> &lt;bean parent="workflowDeployer" id="dna.workflowBootstrap"&gt;<BR />&lt;!--<BR /> &lt;property name="models"&gt;<BR /> &lt;list&gt;<BR /> &lt;value&gt;alfresco/extension/workflow/dna-model.xml&lt;/value&gt;<BR /> &lt;/list&gt;<BR /> &lt;/property&gt;<BR />--&gt;<BR /> &lt;property name="workflowDefinitions"&gt;<BR /> &lt;props&gt;<BR /> &lt;prop key="engineId"&gt;activiti&lt;/prop&gt;<BR /> &lt;prop key="mimeType"&gt;text/xml&lt;/prop&gt;<BR /> &lt;prop key="location"&gt;alfresco/extension/workflow/dna.bpmn&lt;/prop&gt;<BR /> &lt;prop key="redeploy"&gt;false&lt;/prop&gt;<BR /> &lt;/props&gt;<BR /> &lt;/property&gt;<BR /> &lt;/bean&gt;<BR />&lt;/beans&gt;</PRE><P>If I start with the complete workflow, use a remote debugger with a breakpoint set in WorkflowDeployer.java, function public void init() and just press continue when the breakpoint is reached the system the repository starts up fully. There seems to be some sort of race hazard.</P><P></P><P>Any ideas on how to debug further or, better still, fix the issue?</P><P></P><P>Regards,</P><P></P><P>Ian</P><P></P><P>Edit, further information:</P><P></P><P>Whilst in the locked state the following thread states exist:</P><P></P><PRE>Daemon Thread [Catalina-startStop-1] (Suspended) <BR /> owns: StandardHost (id=157) <BR /> Unsafe.park(boolean, long) line: not available [native method] <BR /> LockSupport.park(Object) line: 175 <BR /> FutureTask&lt;V&gt;.awaitDone(boolean, long) line: 429 <BR /> FutureTask&lt;V&gt;.get() line: 191 <BR /> HostConfig.deployWARs(File, String[]) line: 832 <BR /> HostConfig.deployApps() line: 495 <BR /> HostConfig.start() line: 1713 <BR /> HostConfig.lifecycleEvent(LifecycleEvent) line: 337 <BR /> LifecycleSupport.fireLifecycleEvent(String, Object) line: 117 <BR /> StandardHost(LifecycleBase).fireLifecycleEvent(String, Object) line: 90 <BR /> StandardHost(LifecycleBase).setStateInternal(LifecycleState, Object, boolean) line: 394 <BR /> StandardHost(LifecycleBase).setState(LifecycleState) line: 339 <BR /> StandardHost(ContainerBase).startInternal() line: 1137 <BR /> StandardHost.startInternal() line: 819 <BR /> StandardHost(LifecycleBase).start() line: 147 <BR /> ContainerBase$StartChild.call() line: 1572 <BR /> ContainerBase$StartChild.call() line: 1562 <BR /> FutureTask&lt;V&gt;.run() line: 266 <BR /> ThreadPoolExecutor.runWorker(ThreadPoolExecutor$Worker) line: 1142 <BR /> ThreadPoolExecutor$Worker.run() line: 617 <BR /> Thread.run() line: 745 </PRE><P></P><PRE>Daemon Thread [localhost-startStop-1] (Suspended) <BR /> owns: Object (id=124) <BR /> owns: StandardContext (id=125) <BR /> waiting for: AbstractAsynchronouslyRefreshedCache$Refresh (id=123) <BR /> Object.wait(long) line: not available [native method] <BR /> CompiledModelsCache(AbstractAsynchronouslyRefreshedCache&lt;T&gt;).waitForBuild(AbstractAsynchronouslyRefreshedCache$Refresh) line: 214 <BR /> CompiledModelsCache(AbstractAsynchronouslyRefreshedCache&lt;T&gt;).get(String) line: 174 <BR /> DictionaryDAOImpl.getDictionaryRegistry(String) line: 705 <BR /> CMISStrictDictionaryService(CMISAbstractDictionaryService).getRegistry(String) line: 154 <BR /> CMISStrictDictionaryService(CMISAbstractDictionaryService).getRegistry() line: 146 <BR /> CMISDictionaryReload.reload() line: 53 <BR /> CMISDictionaryReload.onBootstrap(ApplicationEvent) line: 62 <BR /> CMISDictionaryReload(AbstractLifecycleBean).onApplicationEvent(ApplicationEvent) line: 56 <BR /> SafeApplicationEventMulticaster.multicastEventInternal(ApplicationEvent) line: 207 <BR /> SafeApplicationEventMulticaster.multicastEvent(ApplicationEvent) line: 178 <BR /> XmlWebApplicationContext(AbstractApplicationContext).publishEvent(ApplicationEvent) line: 334 <BR /> XmlWebApplicationContext(AbstractApplicationContext).finishRefresh() line: 950 <BR /> XmlWebApplicationContext(AbstractApplicationContext).refresh() line: 482 <BR /> ContextLoaderListener(ContextLoader).configureAndRefreshWebApplicationContext(ConfigurableWebApplicationContext, ServletContext) line: 410 <BR /> ContextLoaderListener(ContextLoader).initWebApplicationContext(ServletContext) line: 306 <BR /> ContextLoaderListener(ContextLoaderListener).contextInitialized(ServletContextEvent) line: 112 <BR /> ContextLoaderListener.contextInitialized(ServletContextEvent) line: 63 <BR /> StandardContext.listenerStart() line: 5068 <BR /> StandardContext.startInternal() line: 5584 <BR /> StandardContext(LifecycleBase).start() line: 147 <BR /> StandardHost(ContainerBase).addChildInternal(Container) line: 899 <BR /> StandardHost(ContainerBase).addChild(Container) line: 875 <BR /> StandardHost.addChild(Container) line: 652 <BR /> HostConfig.deployWAR(ContextName, File) line: 1092 <BR /> HostConfig$DeployWar.run() line: 1984 <BR /> Executors$RunnableAdapter&lt;T&gt;.call() line: 511 <BR /> FutureTask&lt;V&gt;.run() line: 266 <BR /> ThreadPoolExecutor.runWorker(ThreadPoolExecutor$Worker) line: 1142 <BR /> ThreadPoolExecutor$Worker.run() line: 617 <BR /> Thread.run() line: 745 </PRE><P></P><PRE>Daemon Thread [asynchronouslyRefreshedCacheThreadPool1] (Suspended) <BR />&nbsp;&nbsp;&nbsp; waiting for: AbstractAsynchronouslyRefreshedCache$Refresh&nbsp; (id=123) <BR />&nbsp;&nbsp;&nbsp; Object.wait(long) line: not available [native method]&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; CompiledModelsCache(AbstractAsynchronouslyRefreshedCache&lt;T&gt;).waitForBuild(AbstractAsynchronouslyRefreshedCache$Refresh) line: 214&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; CompiledModelsCache(AbstractAsynchronouslyRefreshedCache&lt;T&gt;).get(String) line: 174 &nbsp;<BR />&nbsp;&nbsp;&nbsp; DictionaryDAOImpl.getDictionaryRegistry(String) line: 705&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; DictionaryDAOImpl.getTenantDictionaryRegistry() line: 305&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; DictionaryDAOImpl.getProperty(QName) line: 488 &nbsp;<BR />&nbsp;&nbsp;&nbsp; DictionaryComponent.getProperty(QName) line: 376&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; NodeRefPropertyMethodInterceptor.getValue(QName, Serializable) line: 289&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; NodeRefPropertyMethodInterceptor.invoke(MethodInvocation) line: 199 <BR />&nbsp;&nbsp;&nbsp; ReflectiveMethodInvocation.proceed() line: 172 &nbsp;<BR />&nbsp;&nbsp;&nbsp; JdkDynamicAopProxy.invoke(Object, Method, Object[]) line: 204&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; $Proxy20.getProperty(NodeRef, QName) line: not available&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; GeneratedMethodAccessor151.invoke(Object, Object[]) line: not available <BR />&nbsp;&nbsp;&nbsp; DelegatingMethodAccessorImpl.invoke(Object, Object[]) line: 43 &nbsp;<BR />&nbsp;&nbsp;&nbsp; Method.invoke(Object, Object...) line: 498 &nbsp;<BR />&nbsp;&nbsp;&nbsp; AopUtils.invokeJoinpointUsingReflection(Object, Method, Object[]) line: 317 <BR />&nbsp;&nbsp;&nbsp; JdkDynamicAopProxy.invoke(Object, Method, Object[]) line: 198&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; $Proxy20.getProperty(NodeRef, QName) line: not available&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; Path.toDisplayPath(NodeService, PermissionService) line: 211&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RepoStore.getPath(NodeRef) line: 301&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RepoStore$2.doWork() line: 264 &nbsp;<BR />&nbsp;&nbsp;&nbsp; RepoStore$2.doWork() line: 261 &nbsp;<BR />&nbsp;&nbsp;&nbsp; AuthenticationUtil.runAs(RunAsWork&lt;R&gt;, String) line: 548&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RepoStore.getBaseDir() line: 260&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RepoStore.access$100(RepoStore) line: 71&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RepoStore$4$1.execute() line: 438&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RepoStore$4$1.execute() line: 435&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RetryingTransactionHelper.doInTransaction(RetryingTransactionCallback&lt;R&gt;, boolean, boolean) line: 457&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RepoStore$4.doWork() line: 434 &nbsp;<BR />&nbsp;&nbsp;&nbsp; RepoStore$4.doWork() line: 431 &nbsp;<BR />&nbsp;&nbsp;&nbsp; AuthenticationUtil.runAs(RunAsWork&lt;R&gt;, String) line: 548&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RepoStore.getDocumentPaths(String, boolean, String) line: 430&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; DeclarativeRegistry.initWebScripts() line: 296 &nbsp;<BR />&nbsp;&nbsp;&nbsp; DeclarativeRegistry.reset() line: 183&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RegistryAsynchronouslyRefreshedCache.doBuildCache(String) line: 83 &nbsp;<BR />&nbsp;&nbsp;&nbsp; RegistryAsynchronouslyRefreshedCache.access$000(RegistryAsynchronouslyRefreshedCache, String) line: 41 &nbsp;<BR />&nbsp;&nbsp;&nbsp; RegistryAsynchronouslyRefreshedCache$1.execute() line: 72&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RegistryAsynchronouslyRefreshedCache$1.execute() line: 68&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RetryingTransactionHelper.doInTransaction(RetryingTransactionCallback&lt;R&gt;, boolean, boolean) line: 457&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RegistryAsynchronouslyRefreshedCache.buildCache(String) line: 67&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RegistryAsynchronouslyRefreshedCache.buildCache(String) line: 41&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RegistryAsynchronouslyRefreshedCache(AbstractAsynchronouslyRefreshedCache&lt;T&gt;).doRefresh(AbstractAsynchronouslyRefreshedCache$Refresh) line: 470 <BR />&nbsp;&nbsp;&nbsp; RegistryAsynchronouslyRefreshedCache(AbstractAsynchronouslyRefreshedCache&lt;T&gt;).doCall() line: 455&nbsp;&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; RegistryAsynchronouslyRefreshedCache(AbstractAsynchronouslyRefreshedCache&lt;T&gt;).call() line: 420 &nbsp;<BR />&nbsp;&nbsp;&nbsp; RegistryAsynchronouslyRefreshedCache(AbstractAsynchronouslyRefreshedCache&lt;T&gt;).call() line: 47&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; FutureTask&lt;V&gt;.run() line: 266&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; DynamicallySizedThreadPoolExecutor(ThreadPoolExecutor).runWorker(ThreadPoolExecutor$Worker) line: 1142 &nbsp;<BR />&nbsp;&nbsp;&nbsp; ThreadPoolExecutor$Worker.run() line: 617&nbsp; &nbsp;<BR />&nbsp;&nbsp;&nbsp; Thread.run() line: 745 </PRE><PRE></PRE><P>If started using the breakpoint described above then these two threads</P><PRE>Daemon Thread [Catalina-startStop-1] (Suspended)&nbsp;&nbsp; &nbsp;<BR />Daemon Thread [localhost-startStop-1] (Suspended)&nbsp;&nbsp; </PRE><P>have completed and don't exists anymore and the third</P><P></P><PRE>Daemon Thread [asynchronouslyRefreshedCacheThreadPool1] (Suspended) <BR /> Unsafe.park(boolean, long) line: not available [native method] <BR /> LockSupport.park(Object) line: 175 <BR /> AbstractQueuedSynchronizer$ConditionObject.await() line: 2039 <BR /> LinkedBlockingQueue&lt;E&gt;.take() line: 442 <BR /> DynamicallySizedThreadPoolExecutor(ThreadPoolExecutor).getTask() line: 1067 <BR /> DynamicallySizedThreadPoolExecutor(ThreadPoolExecutor).runWorker(ThreadPoolExecutor$Worker) line: 1127 <BR /> ThreadPoolExecutor$Worker.run() line: 617 <BR /> Thread.run() line: 745 </PRE><P><BR /> <BR /> </P></BODY></HTML> Mon, 06 Mar 2017 17:35:47 GMT ianw 2017-03-06T17:35:47Z Repository lockup when loading workflow definition https://connect.hyland.com/t5/alfresco-forum/repository-lockup-when-loading-workflow-definition/m-p/39091#M16448 I'm in the process of upgrading from 4.2 to 5.1. The database, repository, share and Solr are all on separate machines.The problem I'm having is that the repository does not complete starting up if a certain workflow is configured. The last few lines of the log file are:2017-03-06 17:11:30,041 INFO Mon, 06 Mar 2017 17:35:47 GMT https://connect.hyland.com/t5/alfresco-forum/repository-lockup-when-loading-workflow-definition/m-p/39091#M16448 ianw 2017-03-06T17:35:47Z Re: Repository lockup when loading workflow definition https://connect.hyland.com/t5/alfresco-forum/repository-lockup-when-loading-workflow-definition/m-p/39092#M16449 <HTML><HEAD></HEAD><BODY><P>Have you tried to comment your workflow deployer on Spring and restart?</P><P>I'm not sure that your problem depends by the workflow.</P></BODY></HTML> Wed, 08 Mar 2017 11:41:52 GMT https://connect.hyland.com/t5/alfresco-forum/repository-lockup-when-loading-workflow-definition/m-p/39092#M16449 ruudg 2017-03-08T11:41:52Z Re: Repository lockup when loading workflow definition https://connect.hyland.com/t5/alfresco-forum/repository-lockup-when-loading-workflow-definition/m-p/39093#M16450 <HTML><HEAD></HEAD><BODY><P>Yes, and then the repository starts without problem.</P></BODY></HTML> Thu, 09 Mar 2017 16:19:32 GMT https://connect.hyland.com/t5/alfresco-forum/repository-lockup-when-loading-workflow-definition/m-p/39093#M16450 ianw 2017-03-09T16:19:32Z Re: Repository lockup when loading workflow definition https://connect.hyland.com/t5/alfresco-forum/repository-lockup-when-loading-workflow-definition/m-p/39094#M16451 <HTML><HEAD></HEAD><BODY><DIV class=""><P>Currently the workflow is configured in tomcat/shared/classes/alfresco/extension/...</P><P>Not a fix, but a workaround; If the workflow is packaged in an amp file then the repository starts without any problems, go figure!</P><P></P><P>Reported as a bug. <A href="https://issues.alfresco.com/jira/browse/ALF-21876" rel="nofollow noopener noreferrer">https://issues.alfresco.com/jira/browse/ALF-21876</A></P></DIV></BODY></HTML> Fri, 10 Mar 2017 16:00:08 GMT https://connect.hyland.com/t5/alfresco-forum/repository-lockup-when-loading-workflow-definition/m-p/39094#M16451 ianw 2017-03-10T16:00:08Z