topic Alfresco is frequently getting hung due to Java-level deadlock in Alfresco Forum https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36690#M15479 <HTML><HEAD></HEAD><BODY><P>Hi All,</P><P></P><P>I am using <STRONG>Alfresco 4.1</STRONG> and it is getting hung frequently .It is production environment and have two legs</P><P>and <STRONG>load balancer</STRONG>&nbsp;is configured using <STRONG>round robbin</STRONG> mechanism.</P><P>I have analysed logs and found deadlock errors.</P><P>Please guide me how to investigate for the cause these errors.</P><P>Below are the errors getting in catalina.out</P><P></P><P>"SolrTrackerScheduler_QuartzSchedulerThread" daemon prio=10 tid=0x00002b76187c4000 nid=0x3dd8 in Object.wait() [0x00002b76152a6000]<BR /> java.lang.Thread.State: TIMED_WAITING (on object monitor)<BR /> at java.lang.Object.wait(Native Method)<BR /> at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:296)<BR /> - locked &lt;0x0000000740b08480&gt; (a java.lang.Object)</P><P>"SolrTrackerScheduler_Worker-3" daemon prio=10 tid=0x00002b761858b800 nid=0x3dd7 runnable [0x00002b76151a5000]<BR /> java.lang.Thread.State: RUNNABLE<BR /> at java.net.SocketInputStream.socketRead0(Native Method)<BR /> at java.net.SocketInputStream.read(SocketInputStream.java:129)<BR /> at com.sun.net.ssl.internal.ssl.InputRecord.readFully(InputRecord.java:293)<BR /> at com.sun.net.ssl.internal.ssl.InputRecord.read(InputRecord.java:331)<BR /> at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:830)<BR /> - locked &lt;0x00000007f3966978&gt; (a java.lang.Object)<BR /> at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:787)<BR /> at com.sun.net.ssl.internal.ssl.AppInputStream.read(AppInputStream.java:75)<BR /> - locked &lt;0x00000007f3967258&gt; (a com.sun.net.ssl.internal.ssl.AppInputStream)<BR /> at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)<BR /> at java.io.BufferedInputStream.read(BufferedInputStream.java:237)<BR /> - locked &lt;0x00000007f3967270&gt; (a java.io.BufferedInputStream)<BR /> at org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)<BR /> at org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)<BR /> at org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)<BR /> at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.readLine(MultiThreadedHttpConnectionManager.java:1413)<BR /> at org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)<BR /> at org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)<BR /> at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)<BR /> at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)<BR /> at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)<BR /> at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)<BR /> at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)<BR /> at org.alfresco.httpclient.AbstractHttpClient.executeMethod(AbstractHttpClient.java:130)<BR /> at org.alfresco.httpclient.AbstractHttpClient.sendRemoteRequest(AbstractHttpClient.java:106)<BR /> at org.alfresco.httpclient.HttpClientFactory$HttpsClient.sendRequest(HttpClientFactory.java:356)<BR /> at org.alfresco.solr.client.SOLRAPIClient.getModelsDiff(SOLRAPIClient.java:1035)<BR /> at org.alfresco.solr.tracker.CoreTracker.trackModels(CoreTracker.java:1851)<BR /> at org.alfresco.solr.tracker.CoreTracker.trackRepository(CoreTracker.java:1137)<BR /> at org.alfresco.solr.tracker.CoreTracker.updateIndex(CoreTracker.java:483)<BR /> at org.alfresco.solr.tracker.CoreTrackerJob.execute(CoreTrackerJob.java:45)<BR /> at org.quartz.core.JobRunShell.run(JobRunShell.java:216)<BR /> at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:563)</P><P>"SolrTrackerScheduler_Worker-2" daemon prio=10 tid=0x00002b76185b5000 nid=0x3dd6 in Object.wait() [0x00002b76150a4000]<BR /> java.lang.Thread.State: TIMED_WAITING (on object monitor)<BR /> at java.lang.Object.wait(Native Method)<BR /> at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)<BR /> - locked &lt;0x0000000740afd8e0&gt; (a org.quartz.simpl.SimpleThreadPool$WorkerThread)</P><P>"SolrTrackerScheduler_Worker-1" daemon prio=10 tid=0x00002b76187f3800 nid=0x3dd5 runnable [0x00002b7614fa2000]<BR /> java.lang.Thread.State: RUNNABLE<BR /> at java.net.SocketInputStream.socketRead0(Native Method)<BR /> at java.net.SocketInputStream.read(SocketInputStream.java:129)<BR /> at com.sun.net.ssl.internal.ssl.InputRecord.readFully(InputRecord.java:293)<BR /> at com.sun.net.ssl.internal.ssl.InputRecord.read(InputRecord.java:331)<BR /> at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:830)<BR /> - locked &lt;0x00000007f280a328&gt; (a java.lang.Object)<BR /> at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:787)<BR /> at com.sun.net.ssl.internal.ssl.AppInputStream.read(AppInputStream.java:75)<BR /> - locked &lt;0x00000007f280b210&gt; (a com.sun.net.ssl.internal.ssl.AppInputStream)<BR /> at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)<BR /> at java.io.BufferedInputStream.read(BufferedInputStream.java:237)<BR /> - locked &lt;0x00000007f280f750&gt; (a java.io.BufferedInputStream)<BR /> at org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)<BR /> at org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)<BR /> at org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)<BR /> at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.readLine(MultiThreadedHttpConnectionManager.java:1413)<BR /> at org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)<BR /> at org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)<BR /> at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)<BR /> at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)<BR /> at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)<BR /> at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)<BR /> at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)<BR /> at org.alfresco.httpclient.AbstractHttpClient.executeMethod(AbstractHttpClient.java:130)<BR /> at org.alfresco.httpclient.AbstractHttpClient.sendRemoteRequest(AbstractHttpClient.java:106)<BR /> at org.alfresco.httpclient.HttpClientFactory$HttpsClient.sendRequest(HttpClientFactory.java:356)<BR /> at org.alfresco.solr.client.SOLRAPIClient.getModelsDiff(SOLRAPIClient.java:1035)<BR /> at org.alfresco.solr.tracker.CoreTracker.trackModels(CoreTracker.java:1851)<BR /> at org.alfresco.solr.tracker.CoreTracker.trackRepository(CoreTracker.java:1137)<BR /> at org.alfresco.solr.tracker.CoreTracker.updateIndex(CoreTracker.java:483)<BR /> at org.alfresco.solr.tracker.CoreTrackerJob.execute(CoreTrackerJob.java:45)<BR /> at org.quartz.core.JobRunShell.run(JobRunShell.java:216)<BR /> at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:563)</P><P>"RMI TCP Accept-0" daemon prio=10 tid=0x00000000544f9000 nid=0x3d6a runnable [0x00002b7614488000]<BR /> java.lang.Thread.State: RUNNABLE<BR /> at java.net.PlainSocketImpl.socketAccept(Native Method)<BR /> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)<BR /> - locked &lt;0x0000000740b10c10&gt; (a java.net.SocksSocketImpl)<BR /> at java.net.ServerSocket.implAccept(ServerSocket.java:462)<BR /> at java.net.ServerSocket.accept(ServerSocket.java:430)<BR /> at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:34)<BR /> at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)<BR /> at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)<BR /> at java.lang.Thread.run(Thread.java:662)</P><P>"Low Memory Detector" daemon prio=10 tid=0x000000005435f000 nid=0x3d69 runnable [0x0000000000000000]<BR /> java.lang.Thread.State: RUNNABLE</P><P>"C2 CompilerThread1" daemon prio=10 tid=0x000000005435c800 nid=0x3d68 waiting on condition [0x0000000000000000]<BR /> java.lang.Thread.State: RUNNABLE</P><P>"C2 CompilerThread0" daemon prio=10 tid=0x0000000054357000 nid=0x3d67 waiting on condition [0x0000000000000000]<BR /> java.lang.Thread.State: RUNNABLE</P><P>"Signal Dispatcher" daemon prio=10 tid=0x0000000054355000 nid=0x3d66 waiting on condition [0x0000000000000000]<BR /> java.lang.Thread.State: RUNNABLE</P><P>"Finalizer" daemon prio=10 tid=0x0000000054333800 nid=0x3d65 in Object.wait() [0x00002b76106f1000]<BR /> java.lang.Thread.State: WAITING (on object monitor)<BR /> at java.lang.Object.wait(Native Method)<BR /> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)<BR /> - locked &lt;0x0000000740aeec98&gt; (a java.lang.ref.ReferenceQueue$Lock)<BR /> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)<BR /> at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)</P><P>"Reference Handler" daemon prio=10 tid=0x0000000054331800 nid=0x3d64 in Object.wait() [0x00002b76105f0000]<BR /> java.lang.Thread.State: WAITING (on object monitor)<BR /> at java.lang.Object.wait(Native Method)<BR /> at java.lang.Object.wait(Object.java:485)<BR /> at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)<BR /> - locked &lt;0x0000000740508c08&gt; (a java.lang.ref.Reference$Lock)</P><P>"main" prio=10 tid=0x00000000542ca800 nid=0x3d60 runnable [0x00002b760bc7c000]<BR /> java.lang.Thread.State: RUNNABLE<BR /> at java.net.PlainSocketImpl.socketAccept(Native Method)<BR /> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)<BR /> - locked &lt;0x0000000750dd3dc0&gt; (a java.net.SocksSocketImpl)<BR /> at java.net.ServerSocket.implAccept(ServerSocket.java:462)<BR /> at java.net.ServerSocket.accept(ServerSocket.java:430)<BR /> at org.apache.catalina.core.StandardServer.await(StandardServer.java:431)<BR /> at org.apache.catalina.startup.Catalina.await(Catalina.java:676)<BR /> at org.apache.catalina.startup.Catalina.start(Catalina.java:628)<BR /> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)<BR /> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)<BR /> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)<BR /> at java.lang.reflect.Method.invoke(Method.java:597)<BR /> at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)<BR /> at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)</P><P>"VM Thread" prio=10 tid=0x000000005432a800 nid=0x3d63 runnable</P><P>"GC task thread#0 (ParallelGC)" prio=10 tid=0x00000000542dd800 nid=0x3d61 runnable</P><P>"GC task thread#1 (ParallelGC)" prio=10 tid=0x00000000542df800 nid=0x3d62 runnable</P><P>"VM Periodic Task Thread" prio=10 tid=0x00000000543ed000 nid=0x3d6b waiting on condition</P><P>JNI global references: 1641</P><P><BR />Found one Java-level deadlock:<BR />=============================<BR />"http-8080-200":<BR /> waiting for ownable synchronizer 0x0000000747965898, (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync),<BR /> which is held by "http-8443-14"<BR />"http-8443-14":<BR /> waiting for ownable synchronizer 0x0000000747350d08, (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync),<BR /> which is held by "http-8080-12"<BR />"http-8080-12":<BR /> waiting for ownable synchronizer 0x0000000747705928, (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync),<BR /> which is held by "http-8080-7"<BR />"http-8080-7":<BR /> waiting for ownable synchronizer 0x0000000747350d08, (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync),<BR /> which is held by "http-8080-12"</P><P>Java stack information for the threads listed above:<BR />===================================================<BR />"http-8080-200":<BR /> at sun.misc.Unsafe.park(Native Method)<BR /> - parking to wait for &lt;0x0000000747965898&gt; (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)<BR /> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)<BR /> at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)<BR /> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:941)<BR /> at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1261)<BR /> at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:594)<BR /> at org.alfresco.repo.web.scripts.RepositoryContainer.getRegistry(RepositoryContainer.java:541)<BR /> at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:164)<BR /> at org.springframework.extensions.webscripts.servlet.WebScriptServlet.service(WebScriptServlet.java:118)<BR /> at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)<BR /> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)<BR /> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)<BR /> at org.alfresco.web.app.servlet.GlobalLocalizationFilter.doFilter(GlobalLocalizationFilter.java:61)<BR /> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)<BR /> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)<BR /> at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)<BR /> at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)<BR /> at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)<BR /> at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)<BR /> at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)<BR /> at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)<BR /> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)<BR /> at org.apache.coyote.http11.Http11AprProcessor.process(Http11AprProcessor.java:877)<BR /> at org.apache.coyote.http11.Http11AprProtocol$Http11ConnectionHandler.process(Http11AprProtocol.java:594)<BR /> at org.apache.tomcat.util.net.AprEndpoint$Worker.run(AprEndpoint.java:1675)<BR /> at java.lang.Thread.run(Thread.java:662)<BR />"http-8443-14":<BR /> at sun.misc.Unsafe.park(Native Method)<BR /> - parking to wait for &lt;0x0000000747350d08&gt; (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)<BR /> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)<BR /> at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)<BR /> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:941)<BR /> at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1261)<BR /> at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:594)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.getDictionaryRegistry(DictionaryDAOImpl.java:1040)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.getDictionaryRegistry(DictionaryDAOImpl.java:1022)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.getUriToModels(DictionaryDAOImpl.java:1206)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.getModelsForUri(DictionaryDAOImpl.java:462)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.getProperty(DictionaryDAOImpl.java:737)<BR /> at org.alfresco.repo.dictionary.DictionaryComponent.getProperty(DictionaryComponent.java:357)<BR /> at org.alfresco.repo.node.NodeRefPropertyMethodInterceptor.getValue(NodeRefPropertyMethodInterceptor.java:289)<BR /> at org.alfresco.repo.node.NodeRefPropertyMethodInterceptor.invoke(NodeRefPropertyMethodInterceptor.java:199)<BR /> at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)<BR /> at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)<BR /> at $Proxy14.getProperty(Unknown Source)<BR /> at sun.reflect.GeneratedMethodAccessor315.invoke(Unknown Source)<BR /> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)<BR /> at java.lang.reflect.Method.invoke(Method.java:597)<BR /> at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309)<BR /> at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:196)<BR /> at $Proxy14.getProperty(Unknown Source)<BR /> at org.alfresco.service.cmr.repository.Path.toDisplayPath(Path.java:209)<BR /> at org.alfresco.repo.web.scripts.RepoStore.getPath(RepoStore.java:297)<BR /> at org.alfresco.repo.web.scripts.RepoStore.getBaseDir(RepoStore.java:262)<BR /> at org.alfresco.repo.web.scripts.RepoStore.access$000(RepoStore.java:73)<BR /> at org.alfresco.repo.web.scripts.RepoStore$3$1.execute(RepoStore.java:434)<BR /> at org.alfresco.repo.web.scripts.RepoStore$3$1.execute(RepoStore.java:431)<BR /> at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:388)<BR /> at org.alfresco.repo.web.scripts.RepoStore$3.doWork(RepoStore.java:430)<BR /> at org.alfresco.repo.web.scripts.RepoStore$3.doWork(RepoStore.java:427)<BR /> at org.alfresco.repo.security.authentication.AuthenticationUtil.runAs(AuthenticationUtil.java:529)<BR /> at org.alfresco.repo.web.scripts.RepoStore.getDocumentPaths(RepoStore.java:426)<BR /> at org.springframework.extensions.webscripts.DeclarativeRegistry.initWebScripts(DeclarativeRegistry.java:223)<BR /> at org.springframework.extensions.webscripts.DeclarativeRegistry.reset(DeclarativeRegistry.java:178)<BR /> at org.alfresco.repo.web.scripts.RepositoryContainer.getRegistry(RepositoryContainer.java:565)<BR /> at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:164)<BR /> at org.springframework.extensions.webscripts.servlet.WebScriptServlet.service(WebScriptServlet.java:118)<BR /> at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)<BR /> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)<BR /> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)<BR /> at org.alfresco.web.app.servlet.GlobalLocalizationFilter.doFilter(GlobalLocalizationFilter.java:61)<BR /> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)<BR /> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)<BR /> at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)<BR /> at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)<BR /> at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)<BR /> at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)<BR /> at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)<BR /> at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)<BR /> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)<BR /> at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)<BR /> at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)<BR /> at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)<BR /> at java.lang.Thread.run(Thread.java:662)<BR />"http-8080-12":<BR /> at sun.misc.Unsafe.park(Native Method)<BR /> - parking to wait for &lt;0x0000000747705928&gt; (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)<BR /> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)<BR /> at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)<BR /> at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:842)<BR /> at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1178)<BR /> at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:807)<BR /> at org.alfresco.cmis.dictionary.CMISAbstractDictionaryService.init(CMISAbstractDictionaryService.java:409)<BR /> at org.alfresco.cmis.dictionary.CMISAbstractDictionaryService.afterDictionaryInit(CMISAbstractDictionaryService.java:512)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.initDictionaryRegistry(DictionaryDAOImpl.java:274)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.access$000(DictionaryDAOImpl.java:58)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl$1.doWork(DictionaryDAOImpl.java:214)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl$1.doWork(DictionaryDAOImpl.java:209)<BR /> at org.alfresco.repo.security.authentication.AuthenticationUtil.runAs(AuthenticationUtil.java:529)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.initDictionary(DictionaryDAOImpl.java:208)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.getDictionaryRegistry(DictionaryDAOImpl.java:1080)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.init(DictionaryDAOImpl.java:148)<BR /> at org.alfresco.repo.dictionary.NamespaceDAOImpl.getNamespaceRegistry(NamespaceDAOImpl.java:397)<BR /> at org.alfresco.repo.dictionary.NamespaceDAOImpl.getPrefixesCtx(NamespaceDAOImpl.java:560)<BR /> at org.alfresco.repo.dictionary.NamespaceDAOImpl.getPrefixesCtx(NamespaceDAOImpl.java:547)<BR /> at org.alfresco.repo.dictionary.NamespaceDAOImpl.getNamespaceURI(NamespaceDAOImpl.java:297)<BR /> at org.alfresco.repo.dictionary.DictionaryNamespaceComponent.getNamespaceURI(DictionaryNamespaceComponent.java:73)<BR /> at org.alfresco.service.namespace.QName.createQName(QName.java:96)<BR /> at org.alfresco.service.namespace.QName.createQName(QName.java:121)<BR /> at org.alfresco.repo.descriptor.RepositoryDescriptorDAOImpl$RepositoryDescriptor.getDescriptor(RepositoryDescriptorDAOImpl.java:522)<BR /> at org.alfresco.repo.descriptor.RepositoryDescriptorDAOImpl$RepositoryDescriptor.getName(RepositoryDescriptorDAOImpl.java:474)<BR /> at org.alfresco.repo.web.scripts.RepositoryServerModel.getName(RepositoryServerModel.java:67)<BR /> at sun.reflect.GeneratedMethodAccessor2171.invoke(Unknown Source)<BR /> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)<BR /> at java.lang.reflect.Method.invoke(Method.java:597)<BR /> at freemarker.ext.beans.BeansWrapper.invokeMethod(BeansWrapper.java:870)<BR /> at freemarker.ext.beans.BeanModel.invokeThroughDescriptor(BeanModel.java:277)<BR /> at freemarker.ext.beans.BeanModel.get(BeanModel.java:184)<BR /> at freemarker.core.Dot._getAsTemplateModel(Dot.java:76)<BR /> at freemarker.core.Expression.getAsTemplateModel(Expression.java:89)<BR /> at freemarker.core.Expression.getStringValue(Expression.java:93)<BR /> at freemarker.core.StringBuiltins$StringBuiltIn._getAsTemplateModel(StringBuiltins.java:71)<BR /> at freemarker.core.Expression.getAsTemplateModel(Expression.java:89)<BR /> at freemarker.core.Expression.getStringValue(Expression.java:93)<BR /> at freemarker.core.DollarVariable.accept(DollarVariable.java:76)<BR /> at freemarker.core.Environment.visit(Environment.java:221)<BR /> at freemarker.core.MixedContent.accept(MixedContent.java:92)<BR /> at freemarker.core.Environment.visit(Environment.java:221)<BR /> at freemarker.core.Environment.process(Environment.java:199)<BR /> at org.alfresco.repo.template.FreeMarkerProcessor.process(FreeMarkerProcessor.java:202)<BR /> at org.springframework.extensions.webscripts.AbstractWebScript.renderTemplate(AbstractWebScript.java:879)<BR /> at org.springframework.extensions.webscripts.DeclarativeWebScript.renderFormatTemplate(DeclarativeWebScript.java:267)<BR /> at org.springframework.extensions.webscripts.DeclarativeWebScript.execute(DeclarativeWebScript.java:147)<BR /> at org.alfresco.repo.web.scripts.RepositoryContainer$2.execute(RepositoryContainer.java:417)<BR /> at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:388)<BR /> at org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecute(RepositoryContainer.java:479)<BR /> at org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecuteAs(RepositoryContainer.java:517)<BR /> at org.alfresco.repo.web.scripts.RepositoryContainer.executeScript(RepositoryContainer.java:333)<BR /> at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:377)<BR /> at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:209)<BR /> at org.springframework.extensions.webscripts.servlet.WebScriptServlet.service(WebScriptServlet.java:118)<BR /> at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)<BR /> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)<BR /> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)<BR /> at org.alfresco.web.app.servlet.GlobalLocalizationFilter.doFilter(GlobalLocalizationFilter.java:61)<BR /> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)<BR /> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)<BR /> at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)<BR /> at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)<BR /> at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)<BR /> at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)<BR /> at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)<BR /> at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)<BR /> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)<BR /> at org.apache.coyote.http11.Http11AprProcessor.process(Http11AprProcessor.java:877)<BR /> at org.apache.coyote.http11.Http11AprProtocol$Http11ConnectionHandler.process(Http11AprProtocol.java:594)<BR /> at org.apache.tomcat.util.net.AprEndpoint$Worker.run(AprEndpoint.java:1675)<BR /> at java.lang.Thread.run(Thread.java:662)<BR />"http-8080-7":<BR /> at sun.misc.Unsafe.park(Native Method)<BR /> - parking to wait for &lt;0x0000000747350d08&gt; (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)<BR /> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)<BR /> at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)<BR /> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:941)<BR /> at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1261)<BR /> at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:594)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.getDictionaryRegistry(DictionaryDAOImpl.java:1040)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.getDictionaryRegistry(DictionaryDAOImpl.java:1022)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.getCompiledModels(DictionaryDAOImpl.java:1182)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.getCompiledModels(DictionaryDAOImpl.java:869)<BR /> at org.alfresco.repo.dictionary.DictionaryDAOImpl.getModels(DictionaryDAOImpl.java:798)<BR /> at org.alfresco.repo.dictionary.DictionaryComponent.getAllModels(DictionaryComponent.java:67)<BR /> at org.alfresco.repo.dictionary.DictionaryComponent.getAllTypes(DictionaryComponent.java:111)<BR /> at org.alfresco.cmis.dictionary.CMISStrictDictionaryService.createDefinitions(CMISStrictDictionaryService.java:48)<BR /> at org.alfresco.cmis.dictionary.CMISAbstractDictionaryService.init(CMISAbstractDictionaryService.java:418)<BR /> at org.alfresco.cmis.dictionary.CMISAbstractDictionaryService.getRegistry(CMISAbstractDictionaryService.java:233)<BR /> at org.alfresco.cmis.dictionary.CMISAbstractDictionaryService.findProperty(CMISAbstractDictionaryService.java:361)<BR /> at org.alfresco.cmis.mapping.CMISServicesImpl.getProperty(CMISServicesImpl.java:901)<BR /> at org.alfresco.repo.cmis.rest.CMISPropertyValueMethod.exec(CMISPropertyValueMethod.java:118)<BR /> at freemarker.core.MethodCall._getAsTemplateModel(MethodCall.java:93)<BR /> at freemarker.core.Expression.getAsTemplateModel(Expression.java:89)<BR /> at freemarker.core.Assignment.accept(Assignment.java:90)<BR /> at freemarker.core.Environment.visit(Environment.java:221)<BR /> at freemarker.core.MixedContent.accept(MixedContent.java:92)<BR /> at freemarker.core.Environment.visit(Environment.java:221)<BR /> at freemarker.core.Macro$Context.runMacro(Macro.java:172)<BR /> at freemarker.core.Environment.visit(Environment.java:614)<BR /> at freemarker.core.UnifiedCall.accept(UnifiedCall.java:106)<BR /> at freemarker.core.Environment.visit(Environment.java:221)<BR /> at freemarker.core.MixedContent.accept(MixedContent.java:92)<BR /> at freemarker.core.Environment.visit(Environment.java:221)<BR /> at freemarker.core.Environment.process(Environment.java:199)<BR /> at org.alfresco.repo.template.FreeMarkerProcessor.process(FreeMarkerProcessor.java:202)<BR /> at org.springframework.extensions.webscripts.AbstractWebScript.renderTemplate(AbstractWebScript.java:879)<BR /> at org.springframework.extensions.webscripts.DeclarativeWebScript.renderFormatTemplate(DeclarativeWebScript.java:267)<BR /> at org.springframework.extensions.webscripts.DeclarativeWebScript.execute(DeclarativeWebScript.java:147)<BR /> at org.alfresco.repo.web.scripts.RepositoryContainer$2.execute(RepositoryContainer.java:417)<BR /> at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:388)<BR /> at org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecute(RepositoryContainer.java:479)<BR /> at org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecuteAs(RepositoryContainer.java:517)<BR /> at org.alfresco.repo.web.scripts.RepositoryContainer.executeScript(RepositoryContainer.java:333)<BR /> at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:377)<BR /> at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:209)<BR /> at org.springframework.extensions.webscripts.servlet.WebScriptServlet.service(WebScriptServlet.java:118)<BR /> at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)<BR /> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)<BR /> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)<BR /> at org.alfresco.web.app.servlet.GlobalLocalizationFilter.doFilter(GlobalLocalizationFilter.java:61)<BR /> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)<BR /> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)<BR /> at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)<BR /> at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)<BR /> at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)<BR /> at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)<BR /> at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)<BR /> at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)<BR /> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)<BR /> at org.apache.coyote.http11.Http11AprProcessor.process(Http11AprProcessor.java:877)<BR /> at org.apache.coyote.http11.Http11AprProtocol$Http11ConnectionHandler.process(Http11AprProtocol.java:594)<BR /> at org.apache.tomcat.util.net.AprEndpoint$Worker.run(AprEndpoint.java:1675)<BR /> at java.lang.Thread.run(Thread.java:662)</P><P>Found 1 deadlock.</P><P>Heap<BR /> PSYoungGen total 846784K, used 465884K [0x00000007c0000000, 0x00000007fb170000, 0x0000000800000000)<BR /> eden space 810432K, 53% used [0x00000007c0000000,0x00000007da37b8d0,0x00000007f1770000)<BR /> from space 36352K, 99% used [0x00000007f1770000,0x00000007f3aeb890,0x00000007f3af0000)<BR /> to space 78656K, 0% used [0x00000007f64a0000,0x00000007f64a0000,0x00000007fb170000)<BR /> PSOldGen total 2097152K, used 2054806K [0x0000000740000000, 0x00000007c0000000, 0x00000007c0000000)<BR /> object space 2097152K, 97% used [0x0000000740000000,0x00000007bd6a58b0,0x00000007c0000000)<BR /> PSPermGen total 240320K, used 240197K [0x0000000720000000, 0x000000072eab0000, 0x0000000740000000)<BR /> object space 240320K, 99% used [0x0000000720000000,0x000000072ea914a8,0x000000072eab0000)</P></BODY></HTML> Wed, 29 Nov 2017 11:14:36 GMT fouada 2017-11-29T11:14:36Z Alfresco is frequently getting hung due to Java-level deadlock https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36690#M15479 Hi All,I am using Alfresco 4.1 and it is getting hung frequently .It is production environment and have two legsand load balancer&nbsp;is configured using round robbin mechanism.I have analysed logs and found deadlock errors.Please guide me how to investigate for the cause these errors.Below are the erro Wed, 29 Nov 2017 11:14:36 GMT https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36690#M15479 fouada 2017-11-29T11:14:36Z Re: Alfresco is frequently getting hung due to Java-level deadlock https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36691#M15480 <HTML><HEAD></HEAD><BODY><P>Hi </P><P></P><P>This looks like an issue from the dim and distant past. What is the exact version you are using?<BR />I suspect you can get this fixed by moving to a supported version or a more recent supported/community version.</P><P></P><P>Andy</P></BODY></HTML> Wed, 29 Nov 2017 12:10:08 GMT https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36691#M15480 andy1 2017-11-29T12:10:08Z Re: Alfresco is frequently getting hung due to Java-level deadlock https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36692#M15481 <HTML><HEAD></HEAD><BODY><P>Hi Andy,</P><P></P><P>Thanks for your suggestion. I am using&nbsp;<STRONG>alfresco-enterprise-4.1.4.&nbsp;</STRONG></P><P>So it is a bug of Alfresco. How can I confirm it is failing due to Alfresco and not by our custom code.</P><P></P><P>Thanks,</P><P>Fouad</P></BODY></HTML> Thu, 30 Nov 2017 06:03:17 GMT https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36692#M15481 fouada 2017-11-30T06:03:17Z Re: Alfresco is frequently getting hung due to Java-level deadlock https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36693#M15482 <HTML><HEAD></HEAD><BODY><P>HI All,</P><P></P><P>Same error came again. Is there any way other than migrating to new version.</P><P></P><P>Thanks,</P><P>Fouad</P></BODY></HTML> Wed, 06 Dec 2017 09:20:11 GMT https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36693#M15482 fouada 2017-12-06T09:20:11Z Re: Alfresco is frequently getting hung due to Java-level deadlock https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36694#M15483 <HTML><HEAD></HEAD><BODY><P>Hi</P><P></P><P>It looks like <A class="link-titled" href="https://issues.alfresco.com/jira/browse/MNT-11098" title="https://issues.alfresco.com/jira/browse/MNT-11098" rel="nofollow noopener noreferrer">[MNT-11098] 'Failed to get lock java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock' error occurs during the star…</A>&nbsp; or similar<BR />The fix is to get the fix....</P><P></P><P>Are you adding models?</P><P></P><P>Andy</P></BODY></HTML> Wed, 06 Dec 2017 15:04:11 GMT https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36694#M15483 andy1 2017-12-06T15:04:11Z Re: Alfresco is frequently getting hung due to Java-level deadlock https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36695#M15484 <HTML><HEAD></HEAD><BODY><P>Hi Andy,</P><P>Yes, We have added Custom content model.</P><P>Fouad</P></BODY></HTML> Mon, 11 Dec 2017 06:13:15 GMT https://connect.hyland.com/t5/alfresco-forum/alfresco-is-frequently-getting-hung-due-to-java-level-deadlock/m-p/36695#M15484 fouada 2017-12-11T06:13:15Z