cancel
Showing results for 
Search instead for 
Did you mean: 

Cannot shutdown with 4.0.d (Linux 64)

michaelk
Champ in-the-making
Champ in-the-making
I am not able to shutdown using 4.0.d (no problem with previous versions 4.0.c/b/a).
The shutdown script tries to first stop Tomcat but hangs (and never gets to shutting down postgrsql and openoffice).
It looks like that Tomcat is generating "severe" errors when shutdown is initiated. catalina.out shows lots of errors (see below)
This makes routine maintenance impossible. Does anyone know what could be the problem ?

Michael

……….
Feb 9, 2012 3:46:25 AM org.apache.catalina.core.StandardService stop
INFO: Stopping service Catalina
Feb 9, 2012 3:46:26 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [/share] created a ThreadLocal with key of type [null] (value [null]) and a value of type [freemarker.template.DefaultObjectWrapper] (value [freemarker.template.DefaultObjectWrapper@5bb1ffad]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Feb 9, 2012 3:46:26 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [/share] created a ThreadLocal with key of type [null] (value [org.springframework.extensions.webscripts.processor.FTLTemplateProcessor$NonBlockingObjectWrapper$1@308e5e3]) and a value of type [freemarker.template.DefaultObjectWrapper] (value [freemarker.template.DefaultObjectWrapper@3d2c9ba3]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Feb 9, 2012 3:46:26 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [/share] created a ThreadLocal with key of type [null] (value [org.springframework.extensions.webscripts.processor.FTLTemplateProcessor$NonBlockingObjectWrapper$1@3b9e09b5]) and a value of type [freemarker.template.DefaultObjectWrapper] (value [freemarker.template.DefaultObjectWrapper@48f68a7]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Feb 9, 2012 3:46:26 AM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap

….  lots more like this

SEVERE: The web application [/alfresco] created a ThreadLocal with key of type [null] (value [org.alfresco.repo.tagging.TagScopePropertyMethodInterceptor$1@5fe170c5]) and a value of type [java.lang.Boolean] (value [true]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
log4j:ERROR LogMananger.repositorySelector was null likely due to error in class reloading, using NOPLoggerRepository.
Feb 9, 2012 3:46:43 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [/solr] appears to have started a thread named [MultiThreadedHttpConnectionManager cleanup] but has failed to stop it. This is very likely to create a memory leak.
Feb 9, 2012 3:46:43 AM org.apache.coyote.http11.Http11Protocol destroy
INFO: Stopping Coyote HTTP/1.1 on http-8080
Feb 9, 2012 3:46:43 AM org.apache.coyote.http11.Http11Protocol destroy
INFO: Stopping Coyote HTTP/1.1 on http-8443
26 REPLIES 26

michaelk
Champ in-the-making
Champ in-the-making
I get an interesting error with the 4.1a "nightly" ..
Using CATALINA_BASE: /var/home/loc/alfresco-4.1.a/tomcat
Using CATALINA_HOME: /var/home/loc/alfresco-4.1.a/tomcat
Using CATALINA_TMPDIR: /var/home/loc/alfresco-4.1.a/tomcat/temp
Using JRE_HOME: /var/home/loc/alfresco-4.1.a/java
Using CLASSPATH: /var/home/loc/alfresco-4.1.a/tomcat/bin/bootstrap.jar
Using CATALINA_PID: /var/home/loc/alfresco-4.1.a/tomcat/temp/catalina.pid
Feb 25, 2012 9:01:11 AM org.apache.catalina.startup.ClassLoaderFactory validateFile
WARNING: Problem with directory [/var/home/loc/alfresco-4.1.a/tomcat/shared/lib], exists: [false], isDirectory: [false], canRead: [false]

This directory doesn't exist (and didn't in 4.0.c).  So in shutting down Tomcat expects to see something in this directory but barfs when the directory is not found!
Adding the directory does not solve the problem though 8-(

lachmac
Champ in-the-making
Champ in-the-making
In my posting above I have included parts of the "catalina.out" is there any clue in that what could be wrong? Smiley Surprisedops:

It feels a bit iffy, and more that a bit, to get a log file full of severe warnings, and to have the system hang for close to 5 minutes on shutdown.  Smiley Surprised

Since this is not considered to be any problem, according to what I see in this thread, I guess any hope for a solution will be quite a way away. Pity. :shock:

michaelk
Champ in-the-making
Champ in-the-making
I did file a report but it was closed because Alfresco couldn't reproduce the error 8-(
I guess we don't really exist…

https://issues.alfresco.com/jira/browse/ALF-12801

loftux
Star Contributor
Star Contributor
Can you edit the startup/shutdown scripts to make sure you have
export CATALINA_PID="/path/to/catalina.pid"
(it is required for forced shutdown to work)
and then edit tomcat/scripts/ctl.sh to have (not sure here of the exact name for the script, took it from this discussion)
$TOMCAT_BINDIR/shutdown.sh 30 -force

That will force a shutdown after 30 seconds.

michaelk
Champ in-the-making
Champ in-the-making
Can you edit the startup/shutdown scripts to make sure you have
export CATALINA_PID="/path/to/catalina.pid"
(it is required for forced shutdown to work)
and then edit tomcat/scripts/ctl.sh to have (not sure here of the exact name for the script, took it from this discussion)
$TOMCAT_BINDIR/shutdown.sh 30 -force

That will force a shutdown after 30 seconds.

Yes, this will shorten the time until a brute force kill … but it doesn't solve the problem…  (I'm worried about a corruption to the repository…am I paranoid ??)

loftux
Star Contributor
Star Contributor
Yes, this will shorten the time until a brute force kill … but it doesn't solve the problem…  (I'm worried about a corruption to the repository…am I paranoid ??)
If you see the INFO: Stopping Coyote HTTP/1.1 on http-8080 in the log, and there it's where it stops, then yes. By that time all connections to the database are dropped, and for what I know any classes that can mess with the contentstore are unloaded.

You can probably check in your db if there are any open connections just to make sure.

But I also noticed that there was a change in 4.1 nightly that prevented complete shutdown, and I think the issue you opened should not have been closed. It is definitely worth looking into, it may be a symptom of some class not behaving.

mrogers
Star Contributor
Star Contributor
Need a thread dump to see what the problem is.    Then we can re-open the JIRA.

michaelk
Champ in-the-making
Champ in-the-making
Need a thread dump to see what the problem is.    Then we can re-open the JIRA.

Here is the thread dump (while Tomcat is choked on shutdown)

2012-02-28 16:12:31
Full thread dump Java HotSpot(TM) 64-Bit Server VM (17.1-b03 mixed mode):

"DestroyJavaVM" prio=10 tid=0x0000000040113000 nid=0x6e9e waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"TimeLimitedCollector timer thread" daemon prio=10 tid=0x0000000041474800 nid=0x6ff8 waiting on condition [0x00007ff0c0dfa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at org.apache.lucene.search.TimeLimitingCollector$TimerThread.run(TimeLimitingCollector.java:78)

"Timer-9" daemon prio=10 tid=0x0000000040a26800 nid=0x6fee in Object.wait() [0x00007ff0bae61000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff11f1dc7c0> (a java.util.TaskQueue)
   at java.lang.Object.wait(Object.java:485)
   at java.util.TimerThread.mainLoop(Timer.java:483)
   - locked <0x00007ff11f1dc7c0> (a java.util.TaskQueue)
   at java.util.TimerThread.run(Timer.java:462)

"http-8443-4" daemon prio=10 tid=0x00000000408ca000 nid=0x6f9c runnable [0x00007ff0b4e55000]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at com.sun.net.ssl.internal.ssl.InputRecord.readFully(InputRecord.java:293)
   at com.sun.net.ssl.internal.ssl.InputRecord.read(InputRecord.java:331)
   at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:798)
   - locked <0x00007ff11f039868> (a java.lang.Object)
   at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:755)
   at com.sun.net.ssl.internal.ssl.AppInputStream.read(AppInputStream.java:75)
   - locked <0x00007ff11f03aa20> (a com.sun.net.ssl.internal.ssl.AppInputStream)
   at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
   at org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
   at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:814)
   at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-14" daemon prio=10 tid=0x000000004136d800 nid=0x6f9b in Object.wait() [0x00007ff0b4f56000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f5714448> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f5714448> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-13" daemon prio=10 tid=0x00000000405cf000 nid=0x6f9a in Object.wait() [0x00007ff0b5057000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f5714ff8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f5714ff8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-12" daemon prio=10 tid=0x0000000040f87800 nid=0x6f99 in Object.wait() [0x00007ff0b5158000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f5715b88> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f5715b88> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-11" daemon prio=10 tid=0x000000004136d000 nid=0x6f98 in Object.wait() [0x00007ff0b5259000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f5718888> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f5718888> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-10" daemon prio=10 tid=0x0000000040f6b000 nid=0x6f97 in Object.wait() [0x00007ff0b535a000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f5719418> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f5719418> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8443-3" daemon prio=10 tid=0x0000000042022800 nid=0x6f93 runnable [0x00007ff0b555c000]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at com.sun.net.ssl.internal.ssl.InputRecord.readFully(InputRecord.java:293)
   at com.sun.net.ssl.internal.ssl.InputRecord.read(InputRecord.java:331)
   at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:798)
   - locked <0x00007ff0f501eb88> (a java.lang.Object)
   at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:755)
   at com.sun.net.ssl.internal.ssl.AppInputStream.read(AppInputStream.java:75)
   - locked <0x00007ff0f502fdd0> (a com.sun.net.ssl.internal.ssl.AppInputStream)
   at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
   at org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
   at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:814)
   at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
   at java.lang.Thread.run(Thread.java:662)

"http-8443-2" daemon prio=10 tid=0x00000000405a3000 nid=0x6f92 in Object.wait() [0x00007ff0b565d000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f571c698> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f571c698> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8443-1" daemon prio=10 tid=0x0000000040d2c800 nid=0x6f91 runnable [0x00007ff0b575e000]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at com.sun.net.ssl.internal.ssl.InputRecord.readFully(InputRecord.java:293)
   at com.sun.net.ssl.internal.ssl.InputRecord.read(InputRecord.java:331)
   at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:798)
   - locked <0x00007ff11f03b3c0> (a java.lang.Object)
   at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:755)
   at com.sun.net.ssl.internal.ssl.AppInputStream.read(AppInputStream.java:75)
   - locked <0x00007ff11f04c800> (a com.sun.net.ssl.internal.ssl.AppInputStream)
   at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
   at org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
   at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:814)
   at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
   at java.lang.Thread.run(Thread.java:662)

"http-8443-Acceptor-0" daemon prio=10 tid=0x00007ff0bcdcf800 nid=0x6f90 waiting on condition [0x00007ff0b585f000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:344)
   at java.lang.Thread.run(Thread.java:662)

"TP-Processor4" daemon prio=10 tid=0x00007ff0be111800 nid=0x6f8e in Object.wait() [0x00007ff0b5a61000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f47df738> (a org.apache.jk.common.ChannelSocket)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.jk.common.ChannelSocket.accept(ChannelSocket.java:306)
   - locked <0x00007ff0f47df738> (a org.apache.jk.common.ChannelSocket)
   at org.apache.jk.common.ChannelSocket.acceptConnections(ChannelSocket.java:666)
   at org.apache.jk.common.ChannelSocket$SocketAcceptor.runIt(ChannelSocket.java:877)
   at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:690)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-9" daemon prio=10 tid=0x0000000040802000 nid=0x6f8a in Object.wait() [0x00007ff0b5e65000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f573b398> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f573b398> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-8" daemon prio=10 tid=0x0000000040c21000 nid=0x6f89 in Object.wait() [0x00007ff0b5f66000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f574a080> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f574a080> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-7" daemon prio=10 tid=0x0000000040638000 nid=0x6f88 in Object.wait() [0x00007ff0b6067000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f579d850> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f579d850> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-6" daemon prio=10 tid=0x000000004020a800 nid=0x6f87 in Object.wait() [0x00007ff0b6168000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f57a0400> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f57a0400> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-5" daemon prio=10 tid=0x0000000040209800 nid=0x6f86 in Object.wait() [0x00007ff0b6269000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f57a1420> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f57a1420> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-4" daemon prio=10 tid=0x0000000040209000 nid=0x6f85 in Object.wait() [0x00007ff0b636a000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f57a44f8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f57a44f8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-3" daemon prio=10 tid=0x0000000040e15000 nid=0x6f84 in Object.wait() [0x00007ff0b646b000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f57a5088> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f57a5088> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-2" daemon prio=10 tid=0x0000000040e14800 nid=0x6f83 in Object.wait() [0x00007ff0b656c000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f57a5c70> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f57a5c70> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-1" daemon prio=10 tid=0x0000000041545000 nid=0x6f82 in Object.wait() [0x00007ff0c04c6000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f57a8880> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
   - locked <0x00007ff0f57a8880> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
   at java.lang.Thread.run(Thread.java:662)

"http-8080-Acceptor-0" daemon prio=10 tid=0x00007ff0bcba9800 nid=0x6f81 waiting on condition [0x00007ff0bb366000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:344)
   at java.lang.Thread.run(Thread.java:662)

"MultiThreadedHttpConnectionManager cleanup" daemon prio=10 tid=0x00007ff0bdbee800 nid=0x6f55 in Object.wait() [0x00007ff0b67fb000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0e7c03848> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
   - locked <0x00007ff0e7c03848> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
   at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ReferenceQueueThread.run(MultiThreadedHttpConnectionManager.java:1122)

"RMI RenewClean-[204.187.13.213:51928]" daemon prio=10 tid=0x00000000412c8000 nid=0x6f4c in Object.wait() [0x00007ff0b6e01000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f17f74c0> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
   - locked <0x00007ff0f17f74c0> (a java.lang.ref.ReferenceQueue$Lock)
   at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)
   at java.lang.Thread.run(Thread.java:662)

"RMI TCP Accept-0" daemon prio=10 tid=0x00007ff0bdd2d800 nid=0x6f4b runnable [0x00007ff0b6f02000]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)
   - locked <0x00007ff0f17fe868> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
   at java.lang.Thread.run(Thread.java:662)

"Thread-21" daemon prio=10 tid=0x0000000040589000 nid=0x6f28 in Object.wait() [0x00007ff0b8f22000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f2e32338> (a java.util.LinkedList)
   at java.lang.Object.wait(Object.java:485)
   at com.sun.star.lib.util.AsynchronousFinalizer$1.run(AsynchronousFinalizer.java:89)
   - locked <0x00007ff0f2e32338> (a java.util.LinkedList)

"Timer-7" prio=10 tid=0x00007ff0bcd69800 nid=0x6f27 in Object.wait() [0x00007ff0b9023000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f2cbff60> (a java.util.TaskQueue)
   at java.lang.Object.wait(Object.java:485)
   at java.util.TimerThread.mainLoop(Timer.java:483)
   - locked <0x00007ff0f2cbff60> (a java.util.TaskQueue)
   at java.util.TimerThread.run(Timer.java:462)

"Timer-6" prio=10 tid=0x00007ff0bd8af800 nid=0x6f19 in Object.wait() [0x00007ff0b9427000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f181f858> (a java.util.TaskQueue)
   at java.lang.Object.wait(Object.java:485)
   at java.util.TimerThread.mainLoop(Timer.java:483)
   - locked <0x00007ff0f181f858> (a java.util.TaskQueue)
   at java.util.TimerThread.run(Timer.java:462)

"Timer-5" prio=10 tid=0x00007ff0be509000 nid=0x6f0c in Object.wait() [0x00007ff0b9629000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f1f9cc28> (a java.util.TaskQueue)
   at java.lang.Object.wait(Object.java:485)
   at java.util.TimerThread.mainLoop(Timer.java:483)
   - locked <0x00007ff0f1f9cc28> (a java.util.TaskQueue)
   at java.util.TimerThread.run(Timer.java:462)

"Timer-4" prio=10 tid=0x00007ff0be508800 nid=0x6f0b in Object.wait() [0x00007ff0b972a000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f1f9d2d0> (a java.util.TaskQueue)
   at java.lang.Object.wait(Object.java:485)
   at java.util.TimerThread.mainLoop(Timer.java:483)
   - locked <0x00007ff0f1f9d2d0> (a java.util.TaskQueue)
   at java.util.TimerThread.run(Timer.java:462)

"Timer-3" prio=10 tid=0x00007ff0bd502800 nid=0x6f05 in Object.wait() [0x00007ff0b982b000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f1f9d978> (a java.util.TaskQueue)
   at java.lang.Object.wait(Object.java:485)
   at java.util.TimerThread.mainLoop(Timer.java:483)
   - locked <0x00007ff0f1f9d978> (a java.util.TaskQueue)
   at java.util.TimerThread.run(Timer.java:462)

"Timer-2" prio=10 tid=0x00007ff0be50c000 nid=0x6f04 in Object.wait() [0x00007ff0b992c000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0f1f9e020> (a java.util.TaskQueue)
   at java.lang.Object.wait(Object.java:485)
   at java.util.TimerThread.mainLoop(Timer.java:483)
   - locked <0x00007ff0f1f9e020> (a java.util.TaskQueue)
   at java.util.TimerThread.run(Timer.java:462)

"RMI TCP Connection(idle)" daemon prio=10 tid=0x00000000416a6000 nid=0x6efe waiting on condition [0x00007ff0b9a4d000]
   java.lang.Thread.State: TIMED_WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x00007ff0e2e2ddf0> (a java.util.concurrent.SynchronousQueue$TransferStack)
   at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
   at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
   at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
   at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:662)

"RMI RenewClean-[204.187.13.213:38436,org.alfresco.util.remote.server.socket.HostConfigurableSocketFactory@0]" daemon prio=10 tid=0x0000000040bd3000 nid=0x6efd in Object.wait() [0x00007ff0b9b4e000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0eaf50b30> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
   - locked <0x00007ff0eaf50b30> (a java.lang.ref.ReferenceQueue$Lock)
   at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)
   at java.lang.Thread.run(Thread.java:662)

"RMI TCP Accept-0" daemon prio=10 tid=0x00007ff0bd26c000 nid=0x6efc runnable [0x00007ff0b9c4f000]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)
   - locked <0x00007ff0eaf9e7c0> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
   at java.lang.Thread.run(Thread.java:662)

"RMI RenewClean-[204.187.13.213:50508]" daemon prio=10 tid=0x0000000041039000 nid=0x6ee7 in Object.wait() [0x00007ff0bb063000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0e7987508> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
   - locked <0x00007ff0e7987508> (a java.lang.ref.ReferenceQueue$Lock)
   at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)
   at java.lang.Thread.run(Thread.java:662)

"RMI Scheduler(0)" daemon prio=10 tid=0x00000000414b9800 nid=0x6ee6 waiting on condition [0x00007ff0bb265000]
   java.lang.Thread.State: TIMED_WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x00007ff0e2e32360> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
   at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
   at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
   at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:662)

"MultiThreadedHttpConnectionManager cleanup" daemon prio=10 tid=0x0000000040b7b000 nid=0x6eb9 in Object.wait() [0x00007ff0bba6d000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0e51d5aa8> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
   - locked <0x00007ff0e51d5aa8> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
   at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ReferenceQueueThread.run(MultiThreadedHttpConnectionManager.java:1122)

"GC Daemon" daemon prio=10 tid=0x00007ff0bc160800 nid=0x6eac in Object.wait() [0x00007ff0c1580000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0e2f61860> (a sun.misc.GC$LatencyLock)
   at sun.misc.GC$Daemon.run(GC.java:100)
   - locked <0x00007ff0e2f61860> (a sun.misc.GC$LatencyLock)

"RMI TCP Accept-0" daemon prio=10 tid=0x00007ff0bc055000 nid=0x6eaa runnable [0x00007ff0c17d5000]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)
   - locked <0x00007ff0e2de1010> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:34)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
   at java.lang.Thread.run(Thread.java:662)

"Low Memory Detector" daemon prio=10 tid=0x00000000401a5800 nid=0x6ea8 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"CompilerThread1" daemon prio=10 tid=0x00000000401a2000 nid=0x6ea7 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"CompilerThread0" daemon prio=10 tid=0x000000004019e800 nid=0x6ea6 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" daemon prio=10 tid=0x000000004019c800 nid=0x6ea5 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" daemon prio=10 tid=0x000000004017e000 nid=0x6ea4 in Object.wait() [0x00007ff0c1f29000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0e2f61e50> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
   - locked <0x00007ff0e2f61e50> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
   at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

"Reference Handler" daemon prio=10 tid=0x0000000040176800 nid=0x6ea3 in Object.wait() [0x00007ff0c202a000]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x00007ff0e2f61970> (a java.lang.ref.Reference$Lock)
   at java.lang.Object.wait(Object.java:485)
   at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
   - locked <0x00007ff0e2f61970> (a java.lang.ref.Reference$Lock)

"VM Thread" prio=10 tid=0x0000000040172800 nid=0x6ea2 runnable

"GC task thread#0 (ParallelGC)" prio=10 tid=0x0000000040126000 nid=0x6e9f runnable

"GC task thread#1 (ParallelGC)" prio=10 tid=0x0000000040128000 nid=0x6ea0 runnable

"VM Periodic Task Thread" prio=10 tid=0x00007ff0bc062000 nid=0x6eab waiting on condition

JNI global references: 1460

Heap
PSYoungGen      total 283968K, used 61519K [0x00007ff10d830000, 0x00007ff122a30000, 0x00007ff122d80000)
  eden space 223616K, 23% used [0x00007ff10d830000,0x00007ff110c43498,0x00007ff11b290000)
  from space 60352K, 13% used [0x00007ff11ef40000,0x00007ff11f740828,0x00007ff122a30000)
  to   space 61248K, 0% used [0x00007ff11b290000,0x00007ff11b290000,0x00007ff11ee60000)
PSOldGen        total 403200K, used 306575K [0x00007ff0e2d80000, 0x00007ff0fb740000, 0x00007ff10d830000)
  object space 403200K, 76% used [0x00007ff0e2d80000,0x00007ff0f58e3ef0,0x00007ff0fb740000)
PSPermGen       total 223616K, used 168380K [0x00007ff0c2d80000, 0x00007ff0d07e0000, 0x00007ff0e2d80000)
  object space 223616K, 75% used [0x00007ff0c2d80000,0x00007ff0cd1ef388,0x00007ff0d07e0000)


mrogers
Star Contributor
Star Contributor
Can't see any alfresco threads in that dump.

michaelk
Champ in-the-making
Champ in-the-making
Can't see any alfresco threads in that dump.

So what does that imply?  Have the alfresco threads been killed sucessfully and it is waiting on other regular Tomcat threads?  This is the Tomcat distribution with Alfresco..  Did it change between 4.0c and d?