topic Re: Alfresco running 100% CPU several days... in Alfresco Archive

Alfresco running 100% CPU several days...

dranakan — Thu, 27 Aug 2009 15:10:10 GMT

Hello,I am doing different tests with Alfresco Labs 3.0 (and DB Ingres 9.3) on RedHat 5.2. I have upload by CIFS some files which normaly start an action. I have received an error from the CIFS (jlan) and now Alfresco is running to 130% CPU (I use two cores) and nothing appends… (actions do not begi

Re: Alfresco running 100% CPU several days...

dward — Thu, 27 Aug 2009 15:15:30 GMT

If you are using a Sun JDK, you can use the jstack command to do a thread dump of the Alfresco process at periodic intervals. This may reveal what is stuck where and allow you to log a JIRA.

Re: Alfresco running 100% CPU several days...

dranakan — Fri, 28 Aug 2009 06:54:23 GMT

Thank your dward !

Alfresco is always using the CPU…

To use jtack, we need first to get the PID of java alfresco process (here 3410)

[alfresco@localhost Alfresco3]$ ps aux | grep java
alfresco  3410 79.6 53.4 1516052 1247352 ?     Sl   Aug26 1985:22 /usr/bin/java -Xms512m -Xmx1024m -XX:MaxPermSize=256m -server -Duser.language=fr -Duser.region=FR -XX:CompileCommand=exclude,org/apache/lucene/index/IndexReader$1,doBody -XX:CompileCommand=exclude,org/alfresco/repo/search/impl/lucene/index/IndexInfo$Merger,mergeIndexes -XX:CompileCommand=exclude,org/alfresco/repo/search/impl/lucene/index/IndexInfo$Merger,mergeDeletions -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/opt/Alfresco3/tomcat/conf/logging.properties -Djava.endorsed.dirs=/opt/Alfresco3/tomcat/endorsed -classpath :/opt/Alfresco3/tomcat/bin/bootstrap.jar -Dcatalina.base=/opt/Alfresco3/tomcat -Dcatalina.home=/opt/Alfresco3/tomcat -Djava.io.tmpdir=/opt/Alfresco3/tomcat/temp org.apache.catalina.startup.Bootstrap start
alfresco 13890  0.0  0.0   3912   672 pts/1    S+   08:43   0:00 grep java
[alfresco@localhost Alfresco3]$ /usr/java/jdk1.6.0_13/bin/jstack 3410 > jstack_alfresco.log
‍‍‍‍‍

jstack_alfresco.log


2009-08-28 08:37:20
Full thread dump Java HotSpot(TM) Server VM (11.3-b02 mixed mode):

"Attach Listener" daemon prio=10 tid=0x0a129000 nid=0x34a8 waiting on condition [0x00000000..0x00000000]
   java.lang.Thread.State: RUNNABLE

"http-8080-8" daemon prio=10 tid=0x0a99bc00 nid=0x4748 in Object.wait() [0x5d7fe000..0x5d7fedb0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
   - locked <0x8a7abb80> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
   at java.lang.Thread.run(Thread.java:619)

"http-8080-7" daemon prio=10 tid=0x0a99a800 nid=0x4747 in Object.wait() [0x5e65c000..0x5e65ce30]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
   - locked <0x8a7ad520> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
   at java.lang.Thread.run(Thread.java:619)

"http-8080-6" daemon prio=10 tid=0x0a83d800 nid=0x4746 in Object.wait() [0x5e6ad000..0x5e6ae0b0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
   - locked <0x8a7abd10> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
   at java.lang.Thread.run(Thread.java:619)

"http-8080-5" daemon prio=10 tid=0x0a83c800 nid=0x4745 in Object.wait() [0x5e6fe000..0x5e6ff130]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
   - locked <0x8a7e3850> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
   at java.lang.Thread.run(Thread.java:619)

"http-8080-4" daemon prio=10 tid=0x0a83c000 nid=0x4744 in Object.wait() [0x5f283000..0x5f283fb0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
   - locked <0x8a778460> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
   at java.lang.Thread.run(Thread.java:619)

"defaultAsyncAction2" daemon prio=10 tid=0x0a7a4000 nid=0xf53 waiting on condition [0x5f469000..0x5f469db0]
   java.lang.Thread.State: WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x75dc5470> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
   at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:619)

"defaultAsyncAction1" daemon prio=10 tid=0x63a4d400 nid=0xf34 waiting on condition [0x5f418000..0x5f418e30]
   java.lang.Thread.State: WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x75dc5470> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
   at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:619)

"File Reaper" daemon prio=10 tid=0x63808400 nid=0xf33 in Object.wait() [0x5f3c7000..0x5f3c80b0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x7df705f8> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
   - locked <0x7df705f8> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
   at org.apache.commons.io.FileCleaner$1.run(FileCleaner.java:62)

"http-8080-3" daemon prio=10 tid=0x09fe9800 nid=0xeb2 in Object.wait() [0x5f5fe000..0x5f5ff0b0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
   - locked <0x7bbb42e0> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
   at java.lang.Thread.run(Thread.java:619)

"http-8080-2" daemon prio=10 tid=0x0a622000 nid=0xeb1 in Object.wait() [0x5f797000..0x5f798130]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
   - locked <0x7bbd06f8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
   at java.lang.Thread.run(Thread.java:619)

"http-8080-1" daemon prio=10 tid=0x0abc1800 nid=0xeb0 in Object.wait() [0x5f7e8000..0x5f7e8fb0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
   - locked <0x7bbd08a8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
   at java.lang.Thread.run(Thread.java:619)

"http-8080-Acceptor-0" daemon prio=10 tid=0x0a3e8c00 nid=0xeaf runnable [0x5f839000..0x5f83a030]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
   - locked <0x74e09570> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:61)
   at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:310)
   at java.lang.Thread.run(Thread.java:619)

"ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon prio=10 tid=0x0a4f1000 nid=0xeae waiting on condition [0x60dfe000..0x60dfeeb0]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1579)
   at java.lang.Thread.run(Thread.java:619)

"Thread-64" prio=10 tid=0x62adcc00 nid=0xe8e in Object.wait() [0x60b5c000..0x60b5cf30]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x68f9d618> (a java.lang.Class for org.alfresco.web.framework.TaskManager)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.web.framework.TaskWorkerThread.run(TaskWorkerThread.java:72)
   - locked <0x68f9d618> (a java.lang.Class for org.alfresco.web.framework.TaskManager)

"Thread-63" prio=10 tid=0x634b9c00 nid=0xe8d in Object.wait() [0x60976000..0x60976db0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x68f9d618> (a java.lang.Class for org.alfresco.web.framework.TaskManager)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.web.framework.TaskWorkerThread.run(TaskWorkerThread.java:72)
   - locked <0x68f9d618> (a java.lang.Class for org.alfresco.web.framework.TaskManager)

"Thread-62" prio=10 tid=0x62adf800 nid=0xe8c in Object.wait() [0x6085c000..0x6085ce30]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x68f9d618> (a java.lang.Class for org.alfresco.web.framework.TaskManager)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.web.framework.TaskWorkerThread.run(TaskWorkerThread.java:72)
   - locked <0x68f9d618> (a java.lang.Class for org.alfresco.web.framework.TaskManager)

"Thread-61" prio=10 tid=0x63d64c00 nid=0xe8b in Object.wait() [0x60a69000..0x60a6a0b0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x68f9d618> (a java.lang.Class for org.alfresco.web.framework.TaskManager)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.web.framework.TaskWorkerThread.run(TaskWorkerThread.java:72)
   - locked <0x68f9d618> (a java.lang.Class for org.alfresco.web.framework.TaskManager)

"Thread-60" prio=10 tid=0x63d64800 nid=0xe8a in Object.wait() [0x60769000..0x6076a130]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x68f9d618> (a java.lang.Class for org.alfresco.web.framework.TaskManager)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.web.framework.TaskWorkerThread.run(TaskWorkerThread.java:72)
   - locked <0x68f9d618> (a java.lang.Class for org.alfresco.web.framework.TaskManager)

"Thread-59" prio=10 tid=0x638d5400 nid=0xe89 waiting on condition [0x6103f000..0x6103ffb0]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at org.alfresco.web.framework.TaskStarterThread.run(TaskStarterThread.java:65)

"Thread-58" daemon prio=10 tid=0x0a383c00 nid=0xe56 in Object.wait() [0x623fe000..0x623ff030]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x7b439810> (a java.util.LinkedList)
   at java.lang.Object.wait(Object.java:485)
   at com.sun.star.lib.util.AsynchronousFinalizer$1.run(AsynchronousFinalizer.java:94)
   - locked <0x7b439810> (a java.util.LinkedList)

"Timer-1" daemon prio=10 tid=0x0a7d3400 nid=0xe52 in Object.wait() [0x5f88a000..0x5f88af30]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.util.TimerThread.mainLoop(Timer.java:509)
   - locked <0x7b253000> (a java.util.TaskQueue)
   at java.util.TimerThread.run(Timer.java:462)

"14652433@qtp0-1 - Acceptor0 SocketConnector@0.0.0.0:7070" prio=10 tid=0x0a7d4c00 nid=0xe51 runnable [0x5f8db000..0x5f8dbdb0]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
   - locked <0x7b26d090> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at org.mortbay.jetty.bio.SocketConnector.accept(SocketConnector.java:99)
   at org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:707)
   at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:522)

"29269767@qtp0-0" prio=10 tid=0x0a7d2c00 nid=0xe50 in Object.wait() [0x625fe000..0x625fee30]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:565)
   - locked <0x7b253950> (a org.mortbay.thread.QueuedThreadPool$PoolThread)

"AlfrescoJbpmJobExector:127.0.0.1:1" prio=10 tid=0x62e60800 nid=0xe2c in Object.wait() [0x5f92c000..0x5f92d0b0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at org.jbpm.job.executor.JobExecutorThread.run(JobExecutorThread.java:72)
   - locked <0x7b26d270> (a org.alfresco.repo.workflow.jbpm.AlfrescoJobExecutor)

"MessageDispatcher" prio=10 tid=0x638d3800 nid=0xe2a runnable [0x5f97d000..0x5f97e130]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
   at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
   at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
   - locked <0x7b26d358> (a java.io.BufferedInputStream)
   at com.sun.star.lib.connections.socket.SocketConnection.read(SocketConnection.java:163)
   at com.sun.star.lib.uno.bridges.java_remote.XConnectionInputStream_Adapter.read(XConnectionInputStream_Adapter.java:64)
   at java.io.DataInputStream.readInt(DataInputStream.java:370)
   at com.sun.star.lib.uno.protocols.urp.urp.readBlock(urp.java:491)
   at com.sun.star.lib.uno.protocols.urp.urp.readMessage(urp.java:590)
   at com.sun.star.lib.uno.bridges.java_remote.java_remote_bridge$MessageDispatcher.invoke(java_remote_bridge.java:157)
   at com.sun.star.lib.uno.bridges.java_remote.java_remote_bridge$MessageDispatcher.run(java_remote_bridge.java:144)

"CIFS_IdleSessionReaper_NIO" daemon prio=10 tid=0x638d4400 nid=0xe26 waiting on condition [0x5f9ce000..0x5f9cefb0]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at org.alfresco.jlan.smb.server.nio.NIOCifsConnectionsHandler$IdleSessionReaper.run(NIOCifsConnectionsHandler.java:160)
   at java.lang.Thread.run(Thread.java:619)

"CIFSConnectionsHandler" prio=10 tid=0x61e34c00 nid=0xe25 runnable [0x5fa1f000..0x5fa20030]
   java.lang.Thread.State: RUNNABLE
   at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:215)
   at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
   at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
   - locked <0x7b26d578> (a sun.nio.ch.Util$1)
   - locked <0x7b26d588> (a java.util.Collections$UnmodifiableSet)
   - locked <0x7b26d538> (a sun.nio.ch.EPollSelectorImpl)
   at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
   at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84)
   at org.alfresco.jlan.smb.server.nio.NIOCifsConnectionsHandler.run(NIOCifsConnectionsHandler.java:400)
   at java.lang.Thread.run(Thread.java:619)

"CIFSRequestHandler_1" prio=10 tid=0x61e34400 nid=0xe24 in Object.wait() [0x5fa70000..0x5fa70eb0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.jlan.server.SrvSessionQueue.waitWhileEmpty(SrvSessionQueue.java:108)
   - locked <0x7b344920> (a org.alfresco.jlan.server.SrvSessionQueue)
   at org.alfresco.jlan.smb.server.nio.CIFSRequestHandler.run(CIFSRequestHandler.java:241)
   at java.lang.Thread.run(Thread.java:619)

"NetBIOSRefresh" daemon prio=10 tid=0x0a4e4800 nid=0xe22 waiting on condition [0x5fac1000..0x5fac1db0]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at org.alfresco.jlan.netbios.server.NetBIOSNameServer$NetBIOSNameRefresh.run(NetBIOSNameServer.java:584)

"NetBIOSRequest" daemon prio=10 tid=0x0a4e5000 nid=0xe21 in Object.wait() [0x5fb12000..0x5fb12e30]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.jlan.netbios.server.NetBIOSNameServer$NetBIOSRequestHandler.run(NetBIOSNameServer.java:221)
   - locked <0x7b34bd08> (a java.util.Vector)

"CIFS Server" prio=10 tid=0x62cad400 nid=0xe20 waiting on condition [0x5fb63000..0x5fb640b0]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at org.alfresco.jlan.smb.server.SMBServer.run(SMBServer.java:531)
   at java.lang.Thread.run(Thread.java:619)

"NetBIOS Name Server" daemon prio=10 tid=0x62cac000 nid=0xe1f runnable [0x5fbb4000..0x5fbb5130]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainDatagramSocketImpl.receive0(Native Method)
   - locked <0x7b345010> (a java.net.PlainDatagramSocketImpl)
   at java.net.PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)
   - locked <0x7b345010> (a java.net.PlainDatagramSocketImpl)
   at java.net.DatagramSocket.receive(DatagramSocket.java:712)
   - locked <0x7b34c4f0> (a java.net.DatagramPacket)
   - locked <0x7b344fe8> (a java.net.DatagramSocket)
   at org.alfresco.jlan.netbios.server.NetBIOSNameServer.run(NetBIOSNameServer.java:1619)
   at java.lang.Thread.run(Thread.java:619)

"NodeMonitor_Alfresco" daemon prio=10 tid=0x62cac800 nid=0xe1e in Object.wait() [0x5fc05000..0x5fc05fb0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.filesys.repo.NodeEventQueue.waitWhileEmpty(NodeEventQueue.java:117)
   - locked <0x7b23be50> (a org.alfresco.filesys.repo.NodeEventQueue)
   at org.alfresco.filesys.repo.NodeEventQueue.removeEvent(NodeEventQueue.java:84)
   - locked <0x7b23be50> (a org.alfresco.filesys.repo.NodeEventQueue)
   at org.alfresco.filesys.repo.NodeMonitor.run(NodeMonitor.java:531)
   at java.lang.Thread.run(Thread.java:619)

"Notify_Alfresco" daemon prio=10 tid=0x632e7400 nid=0xe1d in Object.wait() [0x5fc56000..0x5fc57030]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.jlan.smb.server.notify.NotifyChangeHandler.run(NotifyChangeHandler.java:1006)
   - locked <0x7b23af58> (a org.alfresco.jlan.smb.server.notify.NotifyChangeEventList)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker25" daemon prio=10 tid=0x620f4c00 nid=0xe1c in Object.wait() [0x5fca7000..0x5fca7eb0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.jlan.server.thread.ThreadRequestQueue.removeRequest(ThreadRequestQueue.java:118)
   - locked <0x7b242050> (a java.util.LinkedList)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:115)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker24" daemon prio=10 tid=0x620f3800 nid=0xe1b waiting for monitor entry [0x5fcf8000..0x5fcf8f30]
   java.lang.Thread.State: BLOCKED (on object monitor)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1539)
   - waiting to lock <0x8a6be2b0> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendErrorResponseSMB(SMBSrvSession.java:1723)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendErrorResponseSMB(SMBSrvSession.java:1653)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procNTCreateAndX(NTProtocolHandler.java:5424)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:305)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker23" daemon prio=10 tid=0x620f2000 nid=0xe1a runnable [0x5fd47000..0x5fd49db0]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at com.ingres.gcf.dam.IoBuff.fillBuffer(Unknown Source)
   at com.ingres.gcf.dam.IoBuff.next(Unknown Source)
   - locked <0x8a6afe40> (a com.ingres.gcf.dam.InBuff)
   at com.ingres.gcf.dam.InBuff.receive(Unknown Source)
   at com.ingres.gcf.dam.MsgIn.receive(Unknown Source)
   at com.ingres.gcf.jdbc.DrvObj.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.exec(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.executeUpdate(Unknown Source)
   at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:101)
   at org.hibernate.persister.entity.AbstractEntityPersister.update(AbstractEntityPersister.java:2412)
   at org.hibernate.persister.entity.AbstractEntityPersister.updateOrInsert(AbstractEntityPersister.java:2312)
   at org.hibernate.persister.entity.AbstractEntityPersister.update(AbstractEntityPersister.java:2612)
   at org.hibernate.action.EntityUpdateAction.execute(EntityUpdateAction.java:96)
   at org.hibernate.engine.ActionQueue.execute(ActionQueue.java:322)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:306)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:183)
   at org.hibernate.event.def.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:298)
   at org.hibernate.event.def.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:27)
   at org.hibernate.impl.SessionImpl.flush(SessionImpl.java:1000)
   at sun.reflect.GeneratedMethodAccessor564.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.orm.hibernate3.HibernateTemplate$CloseSuppressingInvocationHandler.invoke(HibernateTemplate.java:1202)
   at $Proxy70.flush(Unknown Source)
   at org.alfresco.repo.domain.hibernate.DirtySessionMethodInterceptor.setQueryFlushMode(DirtySessionMethodInterceptor.java:257)
   at org.alfresco.repo.node.db.hibernate.HibernateNodeDaoServiceImpl$23.doInHibernate(HibernateNodeDaoServiceImpl.java:2243)
   at org.springframework.orm.hibernate3.HibernateTemplate.execute(HibernateTemplate.java:372)
   at org.springframework.orm.hibernate3.HibernateTemplate.execute(HibernateTemplate.java:338)
   at org.alfresco.repo.node.db.hibernate.HibernateNodeDaoServiceImpl.getChildAssoc(HibernateNodeDaoServiceImpl.java:2247)
   at sun.reflect.GeneratedMethodAccessor368.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:296)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:177)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:144)
   at org.alfresco.repo.transaction.TransactionalDaoInterceptor.invoke(TransactionalDaoInterceptor.java:68)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.alfresco.repo.domain.hibernate.DirtySessionMethodInterceptor.invoke(DirtySessionMethodInterceptor.java:381)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
   at $Proxy2.getChildAssoc(Unknown Source)
   at org.alfresco.repo.node.db.DbNodeServiceImpl.getChildByName(DbNodeServiceImpl.java:1480)
   at sun.reflect.GeneratedMethodAccessor364.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:296)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:177)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:144)
   at org.alfresco.repo.transaction.SingleEntryTransactionResourceInterceptor.invokeInternal(SingleEntryTransactionResourceInterceptor.java:163)
   at org.alfresco.repo.transaction.SingleEntryTransactionResourceInterceptor.invoke(SingleEntryTransactionResourceInterceptor.java:138)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
   at $Proxy7.getChildByName(Unknown Source)
   at sun.reflect.GeneratedMethodAccessor364.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:296)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:177)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:144)
   at org.alfresco.repo.tenant.MultiTNodeServiceInterceptor.invoke(MultiTNodeServiceInterceptor.java:110)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
   at $Proxy7.getChildByName(Unknown Source)
   at sun.reflect.GeneratedMethodAccessor364.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.alfresco.repo.service.StoreRedirectorProxyFactory$RedirectorInvocationHandler.invoke(StoreRedirectorProxyFactory.java:221)
   at $Proxy8.getChildByName(Unknown Source)
   at sun.reflect.GeneratedMethodAccessor364.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:296)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:177)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:144)
   at org.alfresco.repo.node.MLPropertyInterceptor.invoke(MLPropertyInterceptor.java:306)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.alfresco.repo.node.MLPropertyInterceptor.invoke(MLPropertyInterceptor.java:306)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.alfresco.repo.node.NodeRefPropertyMethodInterceptor.invoke(NodeRefPropertyMethodInterceptor.java:274)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.alfresco.repo.node.NodeRefPropertyMethodInterceptor.invoke(NodeRefPropertyMethodInterceptor.java:274)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
   at $Proxy7.getChildByName(Unknown Source)
   at org.alfresco.repo.model.filefolder.FileFolderServiceImpl.searchSimple(FileFolderServiceImpl.java:319)
   at sun.reflect.GeneratedMethodAccessor781.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:296)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:177)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:144)
   at org.alfresco.repo.model.filefolder.TempFileMarkerInterceptor.invoke(TempFileMarkerInterceptor.java:83)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.alfresco.repo.model.ml.MLContentInterceptor.invoke(MLContentInterceptor.java:131)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.alfresco.repo.model.filefolder.MLTranslationInterceptor.invoke(MLTranslationInterceptor.java:210)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at net.sf.acegisecurity.intercept.method.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:80)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.alfresco.repo.security.permissions.impl.ExceptionTranslatorMethodInterceptor.invoke(ExceptionTranslatorMethodInterceptor.java:49)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.alfresco.repo.audit.AuditComponentImpl.audit(AuditComponentImpl.java:275)
   at org.alfresco.repo.audit.AuditMethodInterceptor.invoke(AuditMethodInterceptor.java:69)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:107)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
   at $Proxy53.searchSimple(Unknown Source)
   at org.alfresco.filesys.repo.CifsHelper.getDirectDescendents(CifsHelper.java:433)
   at org.alfresco.filesys.repo.CifsHelper.addDescendents(CifsHelper.java:408)
   at org.alfresco.filesys.repo.CifsHelper.getNodeRefs(CifsHelper.java:501)
   at org.alfresco.filesys.repo.CifsHelper.getNodeRef(CifsHelper.java:524)
   at org.alfresco.filesys.repo.ContentDiskDriver.getNodeForPath(ContentDiskDriver.java:2573)
   at org.alfresco.filesys.repo.ContentDiskDriver.getFileInformation(ContentDiskDriver.java:716)
   at org.alfresco.filesys.repo.ContentDiskDriver.fileExists(ContentDiskDriver.java:1154)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procNTCreateAndX(NTProtocolHandler.java:5449)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:305)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker22" daemon prio=10 tid=0x620f0800 nid=0xe19 in Object.wait() [0x5fd9a000..0x5fd9ae30]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.jlan.server.thread.ThreadRequestQueue.removeRequest(ThreadRequestQueue.java:118)
   - locked <0x7b242050> (a java.util.LinkedList)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:115)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker21" daemon prio=10 tid=0x620ef000 nid=0xe18 in Object.wait() [0x5fdeb000..0x5fdec0b0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.jlan.server.thread.ThreadRequestQueue.removeRequest(ThreadRequestQueue.java:118)
   - locked <0x7b242050> (a java.util.LinkedList)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:115)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker20" daemon prio=10 tid=0x620edc00 nid=0xe17 in Object.wait() [0x5fe3c000..0x5fe3d130]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.jlan.server.thread.ThreadRequestQueue.removeRequest(ThreadRequestQueue.java:118)
   - locked <0x7b242050> (a java.util.LinkedList)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:115)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker19" daemon prio=10 tid=0x63cd7000 nid=0xe16 in Object.wait() [0x5fe8d000..0x5fe8dfb0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.jlan.server.thread.ThreadRequestQueue.removeRequest(ThreadRequestQueue.java:118)
   - locked <0x7b242050> (a java.util.LinkedList)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:115)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker18" daemon prio=10 tid=0x63cd5800 nid=0xe15 runnable [0x5fede000..0x5fedf030]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at com.ingres.gcf.dam.IoBuff.fillBuffer(Unknown Source)
   at com.ingres.gcf.dam.IoBuff.next(Unknown Source)
   - locked <0x8a5ef840> (a com.ingres.gcf.dam.InBuff)
   at com.ingres.gcf.dam.InBuff.receive(Unknown Source)
   at com.ingres.gcf.dam.MsgIn.receive(Unknown Source)
   at com.ingres.gcf.jdbc.DrvObj.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.exec(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.executeBatch(Unknown Source)
   - locked <0x8a63b420> (a java.util.LinkedList)
   at org.apache.commons.dbcp.DelegatingStatement.executeBatch(DelegatingStatement.java:294)
   at org.hibernate.jdbc.BatchingBatcher.doExecuteBatch(BatchingBatcher.java:48)
   at org.hibernate.jdbc.AbstractBatcher.executeBatch(AbstractBatcher.java:246)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:309)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:182)
   at org.hibernate.event.def.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:298)
   at org.hibernate.event.def.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:27)
   at org.hibernate.impl.SessionImpl.flush(SessionImpl.java:1000)
   at org.hibernate.impl.SessionImpl.managedFlush(SessionImpl.java:338)
   at org.hibernate.transaction.JDBCTransaction.commit(JDBCTransaction.java:106)
   at org.springframework.orm.hibernate3.HibernateTransactionManager.doCommit(HibernateTransactionManager.java:575)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:662)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:632)
   at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:314)
   at org.alfresco.util.transaction.SpringAwareUserTransaction.commit(SpringAwareUserTransaction.java:466)
   - locked <0x8a6311c0> (a org.alfresco.util.transaction.SpringAwareUserTransaction)
   at org.alfresco.filesys.alfresco.AlfrescoDiskDriver.endTransaction(AlfrescoDiskDriver.java:229)
   at org.alfresco.jlan.server.SrvSession.endTransaction(SrvSession.java:523)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1550)
   - locked <0x8a5ffa58> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procCloseFile(NTProtocolHandler.java:1442)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:251)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker17" daemon prio=10 tid=0x63cd4400 nid=0xe14 runnable [0x5ff2e000..0x5ff2feb0]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at com.ingres.gcf.dam.IoBuff.fillBuffer(Unknown Source)
   at com.ingres.gcf.dam.IoBuff.next(Unknown Source)
   - locked <0x8a6c4a78> (a com.ingres.gcf.dam.InBuff)
   at com.ingres.gcf.dam.InBuff.receive(Unknown Source)
   at com.ingres.gcf.dam.MsgIn.receive(Unknown Source)
   at com.ingres.gcf.jdbc.DrvObj.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.exec(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.executeBatch(Unknown Source)
   - locked <0x8a6e1588> (a java.util.LinkedList)
   at org.apache.commons.dbcp.DelegatingStatement.executeBatch(DelegatingStatement.java:294)
   at org.hibernate.jdbc.BatchingBatcher.doExecuteBatch(BatchingBatcher.java:48)
   at org.hibernate.jdbc.AbstractBatcher.executeBatch(AbstractBatcher.java:246)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:309)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:182)
   at org.hibernate.event.def.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:298)
   at org.hibernate.event.def.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:27)
   at org.hibernate.impl.SessionImpl.flush(SessionImpl.java:1000)
   at sun.reflect.GeneratedMethodAccessor564.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.orm.hibernate3.HibernateTemplate$CloseSuppressingInvocationHandler.invoke(HibernateTemplate.java:1202)
   at $Proxy70.flush(Unknown Source)
   at org.alfresco.repo.domain.hibernate.DirtySessionMethodInterceptor.setQueryFlushMode(DirtySessionMethodInterceptor.java:257)
   at org.alfresco.repo.node.db.hibernate.HibernateNodeDaoServiceImpl$28.doInHibernate(HibernateNodeDaoServiceImpl.java:2632)
   at org.springframework.orm.hibernate3.HibernateTemplate.execute(HibernateTemplate.java:372)
   at org.springframework.orm.hibernate3.HibernateTemplate.execute(HibernateTemplate.java:338)
   at org.alfresco.repo.node.db.hibernate.HibernateNodeDaoServiceImpl.getParentAssocsInternal(HibernateNodeDaoServiceImpl.java:2636)
   at org.alfresco.repo.node.db.hibernate.HibernateNodeDaoServiceImpl.getParentAssocs(HibernateNodeDaoServiceImpl.java:2667)
   at sun.reflect.GeneratedMethodAccessor333.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:296)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:177)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:144)
   at org.alfresco.repo.transaction.TransactionalDaoInterceptor.invoke(TransactionalDaoInterceptor.java:68)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.alfresco.repo.domain.hibernate.DirtySessionMethodInterceptor.invoke(DirtySessionMethodInterceptor.java:381)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
   at $Proxy2.getParentAssocs(Unknown Source)
   at org.alfresco.repo.node.db.DbNodeServiceImpl.getParentAssocs(DbNodeServiceImpl.java:1331)
   at org.alfresco.repo.node.AbstractNodeServiceImpl.getParentAssocs(AbstractNodeServiceImpl.java:580)
   at sun.reflect.GeneratedMethodAccessor282.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:296)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:177)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:144)
   at org.alfresco.repo.transaction.SingleEntryTransactionResourceInterceptor.invokeInternal(SingleEntryTransactionResourceInterceptor.java:163)
   at org.alfresco.repo.transaction.SingleEntryTransactionResourceInterceptor.invoke(SingleEntryTransactionResourceInterceptor.java:138)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
   at $Proxy7.getParentAssocs(Unknown Source)
   at sun.reflect.GeneratedMethodAccessor282.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:296)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:177)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:144)
   at org.alfresco.repo.tenant.MultiTNodeServiceInterceptor.invoke(MultiTNodeServiceInterceptor.java:110)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
   at $Proxy7.getParentAssocs(Unknown Source)
   at sun.reflect.GeneratedMethodAccessor282.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.alfresco.repo.service.StoreRedirectorProxyFactory$RedirectorInvocationHandler.invoke(StoreRedirectorProxyFactory.java:221)
   at $Proxy8.getParentAssocs(Unknown Source)
   at org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.getNodeCounts(ADMLuceneIndexerImpl.java:1280)
   at org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocuments(ADMLuceneIndexerImpl.java:578)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerImpl.indexImpl(AbstractLuceneIndexerImpl.java:632)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerImpl.indexImpl(AbstractLuceneIndexerImpl.java:657)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerImpl.flushPending(AbstractLuceneIndexerImpl.java:789)
   at org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.doPrepare(ADMLuceneIndexerImpl.java:1591)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerImpl.prepare(AbstractLuceneIndexerImpl.java:472)
   at org.alfresco.repo.search.impl.lucene.AbstractLuceneIndexerAndSearcherFactory.prepare(AbstractLuceneIndexerAndSearcherFactory.java:783)
   at org.alfresco.repo.transaction.AlfrescoTransactionSupport$TransactionSynchronizationImpl.beforeCommit(AlfrescoTransactionSupport.java:661)
   at org.springframework.transaction.support.TransactionSynchronizationUtils.triggerBeforeCommit(TransactionSynchronizationUtils.java:48)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.triggerBeforeCommit(AbstractPlatformTransactionManager.java:835)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:645)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:632)
   at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:314)
   at org.alfresco.util.transaction.SpringAwareUserTransaction.commit(SpringAwareUserTransaction.java:466)
   - locked <0x8a6e18f0> (a org.alfresco.util.transaction.SpringAwareUserTransaction)
   at org.alfresco.filesys.alfresco.AlfrescoDiskDriver.endTransaction(AlfrescoDiskDriver.java:229)
   at org.alfresco.jlan.server.SrvSession.endTransaction(SrvSession.java:523)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1550)
   - locked <0x8a6be2b0> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procNTCreateAndX(NTProtocolHandler.java:5760)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:305)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker16" daemon prio=10 tid=0x63cd2c00 nid=0xe13 waiting for monitor entry [0x5ff80000..0x5ff80f30]
   java.lang.Thread.State: BLOCKED (on object monitor)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1539)
   - waiting to lock <0x8a65a7a0> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.CoreProtocolHandler.procEcho(CoreProtocolHandler.java:1052)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:335)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker15" daemon prio=10 tid=0x63cd1400 nid=0xe12 waiting for monitor entry [0x5ffd1000..0x5ffd1db0]
   java.lang.Thread.State: BLOCKED (on object monitor)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1539)
   - waiting to lock <0x8a5ffa58> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.CoreProtocolHandler.procEcho(CoreProtocolHandler.java:1052)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:335)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker14" daemon prio=10 tid=0x63cd0000 nid=0xe11 waiting for monitor entry [0x60022000..0x60022e30]
   java.lang.Thread.State: BLOCKED (on object monitor)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1539)
   - waiting to lock <0x8a6be2b0> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.CoreProtocolHandler.procEcho(CoreProtocolHandler.java:1052)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:335)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker13" daemon prio=10 tid=0x6384a400 nid=0xe10 waiting for monitor entry [0x60073000..0x600740b0]
   java.lang.Thread.State: BLOCKED (on object monitor)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1539)
   - waiting to lock <0x8a468118> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procTrans2QueryPath(NTProtocolHandler.java:4132)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.processTransactionBuffer(NTProtocolHandler.java:1749)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procTransact2(NTProtocolHandler.java:1570)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:226)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker12" daemon prio=10 tid=0x63848c00 nid=0xe0f runnable [0x600c4000..0x600c5130]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at com.ingres.gcf.dam.IoBuff.fillBuffer(Unknown Source)
   at com.ingres.gcf.dam.IoBuff.next(Unknown Source)
   - locked <0x75b16858> (a com.ingres.gcf.dam.InBuff)
   at com.ingres.gcf.dam.InBuff.receive(Unknown Source)
   at com.ingres.gcf.dam.MsgIn.receive(Unknown Source)
   at com.ingres.gcf.jdbc.DrvObj.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.exec(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.executeBatch(Unknown Source)
   - locked <0x8a5ba150> (a java.util.LinkedList)
   at org.apache.commons.dbcp.DelegatingStatement.executeBatch(DelegatingStatement.java:294)
   at org.hibernate.jdbc.BatchingBatcher.doExecuteBatch(BatchingBatcher.java:48)
   at org.hibernate.jdbc.AbstractBatcher.executeBatch(AbstractBatcher.java:246)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:309)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:182)
   at org.hibernate.event.def.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:298)
   at org.hibernate.event.def.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:27)
   at org.hibernate.impl.SessionImpl.flush(SessionImpl.java:1000)
   at org.hibernate.impl.SessionImpl.managedFlush(SessionImpl.java:338)
   at org.hibernate.transaction.JDBCTransaction.commit(JDBCTransaction.java:106)
   at org.springframework.orm.hibernate3.HibernateTransactionManager.doCommit(HibernateTransactionManager.java:575)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:662)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:632)
   at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:314)
   at org.alfresco.util.transaction.SpringAwareUserTransaction.commit(SpringAwareUserTransaction.java:466)
   - locked <0x8a59b6f8> (a org.alfresco.util.transaction.SpringAwareUserTransaction)
   at org.alfresco.filesys.alfresco.AlfrescoDiskDriver.endTransaction(AlfrescoDiskDriver.java:229)
   at org.alfresco.jlan.server.SrvSession.endTransaction(SrvSession.java:523)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1550)
   - locked <0x8a468118> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procCloseFile(NTProtocolHandler.java:1442)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:251)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker11" daemon prio=10 tid=0x63847800 nid=0xe0e waiting for monitor entry [0x60115000..0x60115fb0]
   java.lang.Thread.State: BLOCKED (on object monitor)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1539)
   - waiting to lock <0x89de2c50> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.CoreProtocolHandler.procEcho(CoreProtocolHandler.java:1052)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:335)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker10" daemon prio=10 tid=0x63846000 nid=0xe0d waiting for monitor entry [0x60166000..0x60167030]
   java.lang.Thread.State: BLOCKED (on object monitor)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1539)
   - waiting to lock <0x8a65a7a0> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procTrans2QueryPath(NTProtocolHandler.java:4132)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.processTransactionBuffer(NTProtocolHandler.java:1749)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procTransact2(NTProtocolHandler.java:1570)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:226)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

To long for 1 post… more on next post…

Re: Alfresco running 100% CPU several days...

dranakan — Fri, 28 Aug 2009 06:55:05 GMT

(this is the end of the jstack command)

"AlfJLANWorker9" daemon prio=10 tid=0x63844800 nid=0xe0c runnable [0x601b7000..0x601b7eb0]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at com.ingres.gcf.dam.IoBuff.fillBuffer(Unknown Source)
   at com.ingres.gcf.dam.IoBuff.next(Unknown Source)
   - locked <0x8a607f60> (a com.ingres.gcf.dam.InBuff)
   at com.ingres.gcf.dam.InBuff.receive(Unknown Source)
   at com.ingres.gcf.dam.MsgIn.receive(Unknown Source)
   at com.ingres.gcf.jdbc.DrvObj.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.exec(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.executeBatch(Unknown Source)
   - locked <0x8a68fee0> (a java.util.LinkedList)
   at org.apache.commons.dbcp.DelegatingStatement.executeBatch(DelegatingStatement.java:294)
   at org.hibernate.jdbc.BatchingBatcher.doExecuteBatch(BatchingBatcher.java:48)
   at org.hibernate.jdbc.AbstractBatcher.executeBatch(AbstractBatcher.java:246)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:309)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:182)
   at org.hibernate.event.def.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:298)
   at org.hibernate.event.def.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:27)
   at org.hibernate.impl.SessionImpl.flush(SessionImpl.java:1000)
   at org.hibernate.impl.SessionImpl.managedFlush(SessionImpl.java:338)
   at org.hibernate.transaction.JDBCTransaction.commit(JDBCTransaction.java:106)
   at org.springframework.orm.hibernate3.HibernateTransactionManager.doCommit(HibernateTransactionManager.java:575)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:662)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:632)
   at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:314)
   at org.alfresco.util.transaction.SpringAwareUserTransaction.commit(SpringAwareUserTransaction.java:466)
   - locked <0x8a679960> (a org.alfresco.util.transaction.SpringAwareUserTransaction)
   at org.alfresco.filesys.alfresco.AlfrescoDiskDriver.endTransaction(AlfrescoDiskDriver.java:229)
   at org.alfresco.jlan.server.SrvSession.endTransaction(SrvSession.java:523)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1550)
   - locked <0x8a65a7a0> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procCloseFile(NTProtocolHandler.java:1442)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:251)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker8" daemon prio=10 tid=0x62ee3000 nid=0xe0b in Object.wait() [0x60208000..0x60208f30]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.jlan.server.thread.ThreadRequestQueue.removeRequest(ThreadRequestQueue.java:118)
   - locked <0x7b242050> (a java.util.LinkedList)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:115)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker7" daemon prio=10 tid=0x62ee1c00 nid=0xe0a runnable [0x60259000..0x60259db0]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at com.ingres.gcf.dam.IoBuff.fillBuffer(Unknown Source)
   at com.ingres.gcf.dam.IoBuff.next(Unknown Source)
   - locked <0x75b20960> (a com.ingres.gcf.dam.InBuff)
   at com.ingres.gcf.dam.InBuff.receive(Unknown Source)
   at com.ingres.gcf.dam.MsgIn.receive(Unknown Source)
   at com.ingres.gcf.jdbc.DrvObj.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.exec(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.executeBatch(Unknown Source)
   - locked <0x8a40d700> (a java.util.LinkedList)
   at org.apache.commons.dbcp.DelegatingStatement.executeBatch(DelegatingStatement.java:294)
   at org.hibernate.jdbc.BatchingBatcher.doExecuteBatch(BatchingBatcher.java:48)
   at org.hibernate.jdbc.AbstractBatcher.executeBatch(AbstractBatcher.java:246)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:309)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:182)
   at org.hibernate.event.def.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:298)
   at org.hibernate.event.def.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:27)
   at org.hibernate.impl.SessionImpl.flush(SessionImpl.java:1000)
   at org.hibernate.impl.SessionImpl.managedFlush(SessionImpl.java:338)
   at org.hibernate.transaction.JDBCTransaction.commit(JDBCTransaction.java:106)
   at org.springframework.orm.hibernate3.HibernateTransactionManager.doCommit(HibernateTransactionManager.java:575)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:662)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:632)
   at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:314)
   at org.alfresco.util.transaction.SpringAwareUserTransaction.commit(SpringAwareUserTransaction.java:466)
   - locked <0x8a3ee0a0> (a org.alfresco.util.transaction.SpringAwareUserTransaction)
   at org.alfresco.filesys.alfresco.AlfrescoDiskDriver.endTransaction(AlfrescoDiskDriver.java:229)
   at org.alfresco.jlan.server.SrvSession.endTransaction(SrvSession.java:523)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1550)
   - locked <0x89de2c50> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procCloseFile(NTProtocolHandler.java:1442)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:251)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker6" daemon prio=10 tid=0x62ee0400 nid=0xe09 waiting for monitor entry [0x602aa000..0x602aae30]
   java.lang.Thread.State: BLOCKED (on object monitor)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1539)
   - waiting to lock <0x8a5be498> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procTrans2QueryFile(NTProtocolHandler.java:4333)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.processTransactionBuffer(NTProtocolHandler.java:1755)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procTransact2(NTProtocolHandler.java:1570)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:226)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker5" daemon prio=10 tid=0x62edec00 nid=0xe08 in Object.wait() [0x602fb000..0x602fc0b0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.jlan.server.thread.ThreadRequestQueue.removeRequest(ThreadRequestQueue.java:118)
   - locked <0x7b242050> (a java.util.LinkedList)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:115)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker4" daemon prio=10 tid=0x62edd800 nid=0xe07 in Object.wait() [0x6034c000..0x6034d130]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.jlan.server.thread.ThreadRequestQueue.removeRequest(ThreadRequestQueue.java:118)
   - locked <0x7b242050> (a java.util.LinkedList)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:115)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker3" daemon prio=10 tid=0x632e3400 nid=0xe06 runnable [0x6039d000..0x6039dfb0]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at com.ingres.gcf.dam.IoBuff.fillBuffer(Unknown Source)
   at com.ingres.gcf.dam.IoBuff.next(Unknown Source)
   - locked <0x8a57bd70> (a com.ingres.gcf.dam.InBuff)
   at com.ingres.gcf.dam.InBuff.receive(Unknown Source)
   at com.ingres.gcf.dam.MsgIn.receive(Unknown Source)
   at com.ingres.gcf.jdbc.DrvObj.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.exec(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.executeBatch(Unknown Source)
   - locked <0x8a581db0> (a java.util.LinkedList)
   at org.apache.commons.dbcp.DelegatingStatement.executeBatch(DelegatingStatement.java:294)
   at org.hibernate.jdbc.BatchingBatcher.doExecuteBatch(BatchingBatcher.java:48)
   at org.hibernate.jdbc.AbstractBatcher.executeBatch(AbstractBatcher.java:246)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:309)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:182)
   at org.hibernate.event.def.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:298)
   at org.hibernate.event.def.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:27)
   at org.hibernate.impl.SessionImpl.flush(SessionImpl.java:1000)
   at org.hibernate.impl.SessionImpl.managedFlush(SessionImpl.java:338)
   at org.hibernate.transaction.JDBCTransaction.commit(JDBCTransaction.java:106)
   at org.springframework.orm.hibernate3.HibernateTransactionManager.doCommit(HibernateTransactionManager.java:575)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:662)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:632)
   at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:314)
   at org.alfresco.util.transaction.SpringAwareUserTransaction.commit(SpringAwareUserTransaction.java:466)
   - locked <0x8a571418> (a org.alfresco.util.transaction.SpringAwareUserTransaction)
   at org.alfresco.filesys.alfresco.AlfrescoDiskDriver.endTransaction(AlfrescoDiskDriver.java:229)
   at org.alfresco.jlan.server.SrvSession.endTransaction(SrvSession.java:523)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1550)
   - locked <0x8a5be498> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.procCloseFile(NTProtocolHandler.java:1442)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:251)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker2" daemon prio=10 tid=0x636b9c00 nid=0xe05 waiting for monitor entry [0x603ee000..0x603ef030]
   java.lang.Thread.State: BLOCKED (on object monitor)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1539)
   - waiting to lock <0x8a468118> (a org.alfresco.jlan.smb.server.SMBSrvSession)
   at org.alfresco.jlan.smb.server.SMBSrvSession.sendResponseSMB(SMBSrvSession.java:1524)
   at org.alfresco.jlan.smb.server.CoreProtocolHandler.procEcho(CoreProtocolHandler.java:1052)
   at org.alfresco.jlan.smb.server.NTProtocolHandler.runProtocol(NTProtocolHandler.java:335)
   at org.alfresco.jlan.smb.server.SMBSrvSession.runHandler(SMBSrvSession.java:1344)
   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1436)
   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:105)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
   at java.lang.Thread.run(Thread.java:619)

"AlfJLANWorker1" daemon prio=10 tid=0x632e7c00 nid=0xe04 in Object.wait() [0x6043f000..0x6043feb0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at org.alfresco.jlan.server.thread.ThreadRequestQueue.removeRequest(ThreadRequestQueue.java:118)
   - locked <0x7b242050> (a java.util.LinkedList)
   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:115)
   at java.lang.Thread.run(Thread.java:619)

"indexThread10" daemon prio=10 tid=0x636b8400 nid=0xdf2 waiting on condition [0x60490000..0x60490f30]
   java.lang.Thread.State: WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x75c12168> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
   at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:619)

"indexThread9" daemon prio=10 tid=0x0aba8800 nid=0xdf1 waiting on condition [0x604e1000..0x604e1db0]
   java.lang.Thread.State: WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x75c12150> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:778)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1929)
   at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:619)

"indexThread8" daemon prio=10 tid=0x0aba7400 nid=0xdf0 waiting on condition [0x60532000..0x60532e30]
   java.lang.Thread.State: WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x75c12150> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:778)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1929)
   at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:619)

"indexThread7" daemon prio=10 tid=0x636b7400 nid=0xdef waiting on condition [0x60583000..0x605840b0]
   java.lang.Thread.State: WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x75c12168> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
   at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:619)

"indexThread6" daemon prio=10 tid=0x636b6800 nid=0xdee runnable [0x605d4000..0x605d5130]
   java.lang.Thread.State: WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x75c12168> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
   at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:619)

"indexThread5" daemon prio=10 tid=0x6342bc00 nid=0xded waiting on condition [0x60625000..0x60625fb0]
   java.lang.Thread.State: WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x75c12150> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:778)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1929)
   at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:619)

"indexThread4" daemon prio=10 tid=0x63258000 nid=0xdec waiting on condition [0x60676000..0x60677030]
   java.lang.Thread.State: WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x75c12150> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:778)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1929)
   at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:619)

"Thread-14" daemon prio=10 tid=0x63428800 nid=0xde3 runnable [0x606c7000..0x606c7eb0]
   java.lang.Thread.State: RUNNABLE
   at java.io.FileInputStream.readBytes(Native Method)
   at java.io.FileInputStream.read(FileInputStream.java:199)
   at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
   at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
   - locked <0x7a335748> (a java.io.BufferedInputStream)
   at java.io.FilterInputStream.read(FilterInputStream.java:90)
   at org.alfresco.util.exec.RuntimeExec$InputStreamReaderThread.run(RuntimeExec.java:742)
   - locked <0x7a315108> (a org.alfresco.util.exec.RuntimeExec$InputStreamReaderThread)

"Thread-13" daemon prio=10 tid=0x6344bc00 nid=0xde2 runnable [0x60718000..0x60718f30]
   java.lang.Thread.State: RUNNABLE
   at java.io.FileInputStream.readBytes(Native Method)
   at java.io.FileInputStream.read(FileInputStream.java:199)
   at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
   at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
   at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
   - locked <0x7a3153f8> (a java.io.BufferedInputStream)
   at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
   at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
   - locked <0x7a36ddd8> (a java.io.BufferedInputStream)
   at java.io.FilterInputStream.read(FilterInputStream.java:90)
   at org.alfresco.util.exec.RuntimeExec$InputStreamReaderThread.run(RuntimeExec.java:742)
   - locked <0x7a315298> (a org.alfresco.util.exec.RuntimeExec$InputStreamReaderThread)

"process reaper" daemon prio=10 tid=0x62ac6000 nid=0xdde runnable [0x60c69000..0x60c69db0]
   java.lang.Thread.State: RUNNABLE
   at java.lang.UNIXProcess.waitForProcessExit(Native Method)
   at java.lang.UNIXProcess.access$900(UNIXProcess.java:20)
   at java.lang.UNIXProcess$1$1.run(UNIXProcess.java:132)

"indexThread3" daemon prio=10 tid=0x0a90d000 nid=0xddd waiting on condition [0x60cba000..0x60cbae30]
   java.lang.Thread.State: WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x75c12150> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:778)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1929)
   at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:619)

"indexThread2" daemon prio=10 tid=0x09ed0800 nid=0xddc runnable [0x60d0b000..0x60d0c0b0]
   java.lang.Thread.State: RUNNABLE
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo$Merger.mergeDeletions(IndexInfo.java:2996)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo$Merger.runImpl(IndexInfo.java:2871)
   at org.alfresco.repo.search.impl.lucene.index.IndexInfo$AbstractSchedulable.run(IndexInfo.java:2711)
   at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
   at java.lang.Thread.run(Thread.java:619)

"indexThread1" daemon prio=10 tid=0x0aaa2800 nid=0xddb waiting on condition [0x60d5c000..0x60d5d130]
   java.lang.Thread.State: WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x75c12168> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
   at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:619)

"Timer-0" daemon prio=10 tid=0x0a657c00 nid=0xdda in Object.wait() [0x60dad000..0x60dadfb0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.util.TimerThread.mainLoop(Timer.java:509)
   - locked <0x7969a760> (a java.util.TaskQueue)
   at java.util.TimerThread.run(Timer.java:462)

"RMI RenewClean-[127.0.0.1:50506]" daemon prio=10 tid=0x0a599400 nid=0xdc3 in Object.wait() [0x607ba000..0x607baf30]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
   - locked <0x76ed35f0> (a java.lang.ref.ReferenceQueue$Lock)
   at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)
   at java.lang.Thread.run(Thread.java:619)

"RMI TCP Accept-50506" daemon prio=10 tid=0x6325ac00 nid=0xdc2 runnable [0x6080b000..0x6080bdb0]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
   - locked <0x76e3ba80> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
   at java.lang.Thread.run(Thread.java:619)

"RMI RenewClean-[127.0.0.1:50505]" daemon prio=10 tid=0x0a604400 nid=0xdc0 in Object.wait() [0x609c7000..0x609c80b0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
   - locked <0x76a04ef8> (a java.lang.ref.ReferenceQueue$Lock)
   at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)
   at java.lang.Thread.run(Thread.java:619)

"RMI TCP Accept-50505" daemon prio=10 tid=0x63cb3000 nid=0xdbf runnable [0x60a18000..0x60a19130]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
   - locked <0x769a5c70> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
   at java.lang.Thread.run(Thread.java:619)

"RMI RenewClean-[127.0.0.1:50504]" daemon prio=10 tid=0x0aa71400 nid=0xdbd in Object.wait() [0x608ad000..0x608ae030]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
   - locked <0x76a05348> (a java.lang.ref.ReferenceQueue$Lock)
   at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)
   at java.lang.Thread.run(Thread.java:619)

"RMI TCP Accept-50504" daemon prio=10 tid=0x62de8c00 nid=0xdbc runnable [0x608fe000..0x608feeb0]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
   - locked <0x769a5e48> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
   at java.lang.Thread.run(Thread.java:619)

"RMI RenewClean-[127.0.0.1:50503]" daemon prio=10 tid=0x0a441c00 nid=0xdba in Object.wait() [0x60aba000..0x60abadb0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
   - locked <0x76a05be8> (a java.lang.ref.ReferenceQueue$Lock)
   at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)
   at java.lang.Thread.run(Thread.java:619)

"RMI TCP Accept-50503" daemon prio=10 tid=0x6381f400 nid=0xdb9 runnable [0x60b0b000..0x60b0be30]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
   - locked <0x769a6020> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
   at java.lang.Thread.run(Thread.java:619)

"RMI RenewClean-[127.0.0.1:50502]" daemon prio=10 tid=0x0a716800 nid=0xdb7 in Object.wait() [0x60bad000..0x60bae130]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
   - locked <0x76a06c08> (a java.lang.ref.ReferenceQueue$Lock)
   at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)
   at java.lang.Thread.run(Thread.java:619)

"RMI TCP Accept-50502" daemon prio=10 tid=0x6382e000 nid=0xdb6 runnable [0x60bfe000..0x60bfefb0]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
   - locked <0x769a7ea8> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
   at java.lang.Thread.run(Thread.java:619)

"RMI RenewClean-[127.0.0.1:50501]" daemon prio=10 tid=0x0a727000 nid=0xdb4 in Object.wait() [0x60f9d000..0x60f9deb0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
   - locked <0x76a05798> (a java.lang.ref.ReferenceQueue$Lock)
   at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)
   at java.lang.Thread.run(Thread.java:619)

"RMI TCP Accept-50501" daemon prio=10 tid=0x62eedc00 nid=0xdb3 runnable [0x60fee000..0x60feef30]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
   - locked <0x769a8080> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
   at java.lang.Thread.run(Thread.java:619)

"Thread-11" prio=10 tid=0x6320e400 nid=0xdb2 in Object.wait() [0x610d4000..0x610d4db0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at org.alfresco.repo.avm.AVMRemoteTransportService.run(AVMRemoteTransportService.java:153)
   - locked <0x76903598> (a org.alfresco.repo.avm.AVMRemoteTransportService)
   at java.lang.Thread.run(Thread.java:619)

"DefaultScheduler_QuartzSchedulerThread" prio=10 tid=0x636c1800 nid=0xdae waiting on condition [0x61125000..0x611260b0]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:275)

"DefaultScheduler_Worker-10" prio=10 tid=0x636c0400 nid=0xdad in Object.wait() [0x61177000..0x61177130]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:523)
   - locked <0x7661da80> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultScheduler_Worker-9" prio=10 tid=0x636bec00 nid=0xdac in Object.wait() [0x611c7000..0x611c7fb0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:523)
   - locked <0x7661d8e8> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultScheduler_Worker-8" prio=10 tid=0x62d47800 nid=0xdab in Object.wait() [0x61218000..0x61219030]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:523)
   - locked <0x76617730> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultScheduler_Worker-7" prio=10 tid=0x62d46000 nid=0xdaa runnable [0x61269000..0x61269eb0]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at com.ingres.gcf.dam.IoBuff.fillBuffer(Unknown Source)
   at com.ingres.gcf.dam.IoBuff.next(Unknown Source)
   - locked <0x8a705a20> (a com.ingres.gcf.dam.InBuff)
   at com.ingres.gcf.dam.InBuff.receive(Unknown Source)
   at com.ingres.gcf.dam.MsgIn.receive(Unknown Source)
   at com.ingres.gcf.jdbc.DrvObj.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.exec(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.executeBatch(Unknown Source)
   - locked <0x8a980880> (a java.util.LinkedList)
   at org.apache.commons.dbcp.DelegatingStatement.executeBatch(DelegatingStatement.java:294)
   at org.hibernate.jdbc.BatchingBatcher.doExecuteBatch(BatchingBatcher.java:48)
   at org.hibernate.jdbc.BatchingBatcher.addToBatch(BatchingBatcher.java:34)
   at org.hibernate.persister.collection.AbstractCollectionPersister.remove(AbstractCollectionPersister.java:1048)
   at org.hibernate.action.CollectionRemoveAction.execute(CollectionRemoveAction.java:88)
   at org.hibernate.engine.ActionQueue.execute(ActionQueue.java:322)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:306)
   at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:184)
   at org.hibernate.event.def.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:298)
   at org.hibernate.event.def.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:27)
   at org.hibernate.impl.SessionImpl.flush(SessionImpl.java:1000)
   at org.hibernate.impl.SessionImpl.managedFlush(SessionImpl.java:338)
   at org.hibernate.transaction.JDBCTransaction.commit(JDBCTransaction.java:106)
   at org.springframework.orm.hibernate3.HibernateTransactionManager.doCommit(HibernateTransactionManager.java:575)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:662)
   at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:632)
   at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:314)
   at org.alfresco.util.transaction.SpringAwareUserTransaction.commit(SpringAwareUserTransaction.java:466)
   - locked <0x8a8d0f40> (a org.alfresco.util.transaction.SpringAwareUserTransaction)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:334)
   at org.alfresco.repo.node.db.DeletedNodeCleanupWorker.purgeOldDeletedNodes(DeletedNodeCleanupWorker.java:114)
   at org.alfresco.repo.node.db.DeletedNodeCleanupWorker.doCleanInternal(DeletedNodeCleanupWorker.java:38)
   at org.alfresco.repo.node.cleanup.AbstractNodeCleanupWorker$1.execute(AbstractNodeCleanupWorker.java:128)
   at org.alfresco.repo.node.cleanup.AbstractNodeCleanupWorker$1.execute(AbstractNodeCleanupWorker.java:126)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:320)
   at org.alfresco.repo.node.cleanup.AbstractNodeCleanupWorker$2.doWork(AbstractNodeCleanupWorker.java:135)
   at org.alfresco.repo.node.cleanup.AbstractNodeCleanupWorker$2.doWork(AbstractNodeCleanupWorker.java:133)
   at org.alfresco.repo.security.authentication.AuthenticationUtil.runAs(AuthenticationUtil.java:437)
   at org.alfresco.repo.node.cleanup.AbstractNodeCleanupWorker.doCleanWithTxn(AbstractNodeCleanupWorker.java:138)
   at org.alfresco.repo.node.cleanup.AbstractNodeCleanupWorker.doClean(AbstractNodeCleanupWorker.java:85)
   at org.alfresco.repo.node.cleanup.NodeCleanupRegistry.doClean(NodeCleanupRegistry.java:44)
   at org.alfresco.repo.node.cleanup.NodeCleanupJob.execute(NodeCleanupJob.java:60)
   at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
   at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)

"DefaultScheduler_Worker-6" prio=10 tid=0x62d44c00 nid=0xda9 in Object.wait() [0x612ba000..0x612baf30]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:523)
   - locked <0x76617400> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultScheduler_Worker-5" prio=10 tid=0x62feb400 nid=0xda8 runnable [0x6130a000..0x6130bdb0]
   java.lang.Thread.State: RUNNABLE
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.read(SocketInputStream.java:129)
   at com.ingres.gcf.dam.IoBuff.fillBuffer(Unknown Source)
   at com.ingres.gcf.dam.IoBuff.next(Unknown Source)
   - locked <0x75b10748> (a com.ingres.gcf.dam.InBuff)
   at com.ingres.gcf.dam.InBuff.receive(Unknown Source)
   at com.ingres.gcf.dam.MsgIn.receive(Unknown Source)
   at com.ingres.gcf.jdbc.DrvObj.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcStmt.readResults(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.exec(Unknown Source)
   at com.ingres.gcf.jdbc.JdbcPrep.executeUpdate(Unknown Source)
   at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:101)
   at org.hibernate.hql.ast.exec.BasicExecutor.execute(BasicExecutor.java:75)
   at org.hibernate.hql.ast.QueryTranslatorImpl.executeUpdate(QueryTranslatorImpl.java:396)
   at org.hibernate.engine.query.HQLQueryPlan.performExecuteUpdate(HQLQueryPlan.java:259)
   at org.hibernate.impl.SessionImpl.executeUpdate(SessionImpl.java:1141)
   at org.hibernate.impl.QueryImpl.executeUpdate(QueryImpl.java:94)
   at org.alfresco.repo.domain.hibernate.HibernateUsageDeltaDAO$2.doInHibernate(HibernateUsageDeltaDAO.java:161)
   at org.springframework.orm.hibernate3.HibernateTemplate.execute(HibernateTemplate.java:372)
   at org.springframework.orm.hibernate3.HibernateTemplate.execute(HibernateTemplate.java:338)
   at org.alfresco.repo.domain.hibernate.HibernateUsageDeltaDAO.deleteDeltas(HibernateUsageDeltaDAO.java:166)
   at org.alfresco.repo.domain.hibernate.HibernateUsageDeltaDAO.deleteDeltas(HibernateUsageDeltaDAO.java:149)
   at org.alfresco.repo.usage.UsageServiceImpl.deleteDeltas(UsageServiceImpl.java:65)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:296)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:177)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:144)
   at org.alfresco.repo.tenant.MultiTNodeServiceInterceptor.invoke(MultiTNodeServiceInterceptor.java:110)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:166)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
   at $Proxy42.deleteDeltas(Unknown Source)
   at org.alfresco.repo.usage.UserUsageTrackingComponent$9.execute(UserUsageTrackingComponent.java:558)
   at org.alfresco.repo.usage.UserUsageTrackingComponent$9.execute(UserUsageTrackingComponent.java:539)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:320)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:246)
   at org.alfresco.repo.usage.UserUsageTrackingComponent.collapseUsage(UserUsageTrackingComponent.java:579)
   at org.alfresco.repo.usage.UserUsageTrackingComponent.access$600(UserUsageTrackingComponent.java:60)
   at org.alfresco.repo.usage.UserUsageTrackingComponent$8.doWork(UserUsageTrackingComponent.java:519)
   at org.alfresco.repo.usage.UserUsageTrackingComponent$8.doWork(UserUsageTrackingComponent.java:517)
   at org.alfresco.repo.security.authentication.AuthenticationUtil.runAs(AuthenticationUtil.java:437)
   at org.alfresco.repo.usage.UserUsageTrackingComponent.collapseUsages(UserUsageTrackingComponent.java:515)
   at org.alfresco.repo.usage.UserUsageTrackingComponent.execute(UserUsageTrackingComponent.java:143)
   at org.alfresco.repo.usage.UserUsageCollapseJob.execute(UserUsageCollapseJob.java:48)
   at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
   at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)

"DefaultScheduler_Worker-4" prio=10 tid=0x620f9c00 nid=0xda7 in Object.wait() [0x6135c000..0x6135ce30]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:523)
   - locked <0x766170d0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultScheduler_Worker-3" prio=10 tid=0x63ca8000 nid=0xda6 in Object.wait() [0x613ad000..0x613ae0b0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:523)
   - locked <0x76616f38> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultScheduler_Worker-2" prio=10 tid=0x63cc7400 nid=0xda5 in Object.wait() [0x613ff000..0x613ff130]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:523)
   - locked <0x76616da0> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"DefaultScheduler_Worker-1" prio=10 tid=0x63215800 nid=0xda4 in Object.wait() [0x6235c000..0x6235cfb0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:523)
   - locked <0x76616c08> (a org.quartz.simpl.SimpleThreadPool$WorkerThread)

"FileStateReaper" daemon prio=10 tid=0x634aa400 nid=0xda3 waiting on condition [0x623ad000..0x623ae030]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at org.alfresco.filesys.state.FileStateReaper.run(FileStateReaper.java:150)
   at java.lang.Thread.run(Thread.java:619)

"RMI RenewClean-[127.0.0.1:37239]" daemon prio=10 tid=0x0a5b2800 nid=0xda1 in Object.wait() [0x6255c000..0x6255cf30]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
   - locked <0x767a8240> (a java.lang.ref.ReferenceQueue$Lock)
   at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)
   at java.lang.Thread.run(Thread.java:619)

"RMI Scheduler(0)" daemon prio=10 tid=0x63927000 nid=0xda0 waiting on condition [0x625ad000..0x625addb0]
   java.lang.Thread.State: TIMED_WAITING (parking)
   at sun.misc.Unsafe.park(Native Method)
   - parking to wait for  <0x765fa080> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
   at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
   at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
   at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
   at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
   at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
   at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
   at java.lang.Thread.run(Thread.java:619)

"GC Daemon" daemon prio=10 tid=0x62cb5c00 nid=0xd9e in Object.wait() [0x6275c000..0x6275d0b0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at sun.misc.GC$Daemon.run(GC.java:100)
   - locked <0x761bb3c8> (a sun.misc.GC$LatencyLock)

"RMI Reaper" prio=10 tid=0x63a2cc00 nid=0xd9d in Object.wait() [0x627ad000..0x627ae130]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   - waiting on <0x761bb500> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
   - locked <0x761bb500> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
   at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:333)
   at java.lang.Thread.run(Thread.java:619)

"RMI TCP Accept-0" daemon prio=10 tid=0x6205f800 nid=0xd9c runnable [0x627fe000..0x627fefb0]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
   - locked <0x761bb668> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
   at java.lang.Thread.run(Thread.java:619)

"RMI TCP Accept-50500" daemon prio=10 tid=0x621f5c00 nid=0xd9b runnable [0x6295c000..0x6295d030]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
   - locked <0x75e0f658> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
   at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
   at java.lang.Thread.run(Thread.java:619)

"PassthruReaper" daemon prio=10 tid=0x0a407800 nid=0xd98 waiting on condition [0x629ad000..0x629adf30]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at org.alfresco.repo.security.authentication.ntlm.NTLMAuthenticationComponentImpl$PassthruReaperThread.run(NTLMAuthenticationComponentImpl.java:176)

"PassthruOfflineChecker" daemon prio=10 tid=0x0a21c800 nid=0xd97 waiting on condition [0x629fe000..0x629fedb0]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at org.alfresco.jlan.server.auth.passthru.PassthruServers$PassthruOfflineChecker.run(PassthruServers.java:128)

"Store org.alfresco.cache.ticketsCache Spool Thread" daemon prio=10 tid=0x622a1400 nid=0xd72 sleeping[0x6307b000..0x6307be30]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
   at java.lang.Thread.sleep(Native Method)
   at net.sf.ehcache.store.DiskStore.spoolAndExpiryThreadMain(DiskStore.java:588)
   at net.sf.ehcache.store.DiskStore.access$800(DiskStore.java:64)
   at net.sf.ehcache.store.DiskStore$SpoolAndExpiryThread.run(DiskStore.java:1074)

"Low Memory Detector" daemon prio=10 tid=0x09f54400 nid=0xd5e runnable [0x00000000..0x00000000]
   java.lang.Thread.State: RUNNABLE

"CompilerThread1" daemon prio=10 tid=0x09f52800 nid=0xd5d waiting on condition [0x00000000..0x64143468]
   java.lang.Thread.State: RUNNABLE

"CompilerThread0" daemon prio=10 tid=0x09f4f800 nid=0xd5c waiting on condition [0x00000000..0x641c44e8]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" daemon prio=10 tid=0x09f4e000 nid=0xd5b runnable [0x00000000..0x64215b90]
   java.lang.Thread.State: RUNNABLE

"Finalizer" daemon prio=10 tid=0x09f39800 nid=0xd5a in Object.wait() [0x64466000..0x64466f30]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
   - locked <0x7567ed88> (a java.lang.ref.ReferenceQueue$Lock)
   at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
   at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

"Reference Handler" daemon prio=10 tid=0x09f38000 nid=0xd59 in Object.wait() [0x644b7000..0x644b7db0]
   java.lang.Thread.State: WAITING (on object monitor)
   at java.lang.Object.wait(Native Method)
   at java.lang.Object.wait(Object.java:485)
   at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
   - locked <0x7567ed60> (a java.lang.ref.Reference$Lock)

"main" prio=10 tid=0x09e8a800 nid=0xd53 runnable [0xb7f5d000..0xb7f5e1f8]
   java.lang.Thread.State: RUNNABLE
   at java.net.PlainSocketImpl.socketAccept(Native Method)
   at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
   - locked <0x7bc30848> (a java.net.SocksSocketImpl)
   at java.net.ServerSocket.implAccept(ServerSocket.java:453)
   at java.net.ServerSocket.accept(ServerSocket.java:421)
   at org.apache.catalina.core.StandardServer.await(StandardServer.java:389)
   at org.apache.catalina.startup.Catalina.await(Catalina.java:642)
   at org.apache.catalina.startup.Catalina.start(Catalina.java:602)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:288)
   at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:413)

"VM Thread" prio=10 tid=0x09f34800 nid=0xd58 runnable 

"GC task thread#0 (ParallelGC)" prio=10 tid=0x09e91c00 nid=0xd54 runnable 

"GC task thread#1 (ParallelGC)" prio=10 tid=0x09e93400 nid=0xd55 runnable 

"GC task thread#2 (ParallelGC)" prio=10 tid=0x09e94800 nid=0xd56 runnable 

"GC task thread#3 (ParallelGC)" prio=10 tid=0x09e96000 nid=0xd57 runnable 

"VM Periodic Task Thread" prio=10 tid=0x09f56000 nid=0xd5f waiting on condition 

JNI global references: 798

‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

I am using Alfresco 3.0 and I suppose that the possible bug should be correct in the 3.2 Community. That's way I will not search more.
But, can somebody tell me what I should do in this situation if I was in production :?:

Re: Alfresco running 100% CPU several days...

dranakan — Mon, 01 Mar 2010 13:26:58 GMT

Hello,

I have an Alfresco Installation using the 100% CPU (new server working from 1 month). I have restarted (alf_stop and pkill because didn't stop, restart) it but it is always to 100%… I am using 32.r2 with Mysql. What can I do ?

Thanks

I have found this in Threads

"DefaultScheduler_Worker-3" prio=10 tid=0x08f8b400 nid=0x86b runnable [0x62b82000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:92)
        at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:86)
        - locked <0x71801578> (a sun.nio.ch.ChannelInputStream)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
        - locked <0x718055a0> (a java.io.BufferedInputStream)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
        - locked <0x718055c0> (a java.io.BufferedInputStream)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
        - locked <0x718055e0> (a java.io.BufferedInputStream)
        at java.io.FilterInputStream.read(FilterInputStream.java:66)
        at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
        at org.apache.pdfbox.io.PushBackInputStream.read(PushBackInputStream.java:84)
        at org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionary(BaseParser.java:200)
        at org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
        at org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionaryValue(BaseParser.java:141)
        at org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionary(BaseParser.java:213)
        at org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
        at org.apache.pdfbox.pdfparser.PDFParser.parseObject(PDFParser.java:519)
        at org.apache.pdfbox.pdfparser.PDFParser.parse(PDFParser.java:179)
        at org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:841)
        at org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:808)
        at org.alfresco.repo.content.transform.PdfBoxContentTransformer.transformInternal(PdfBoxContentTransformer.java:74)
        at org.alfresco.repo.content.transform.AbstractContentTransformer2.transform(AbstractContentTransformer2.java:167)
        at org.alfresco.repo.content.transform.AbstractContentTransformer2.transform(AbstractContentTransformer2.java:143)
        at org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.indexProperty(ADMLuceneIndexerImpl.java:948)
        at org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocumentsImpl(ADMLuceneIndexerImpl.java:625)
        at org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocuments(ADMLuceneIndexerImpl.java:590)
        at org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.updateFullTextSearch(ADMLuceneIndexerImpl.java:1569)
        at org.alfresco.repo.search.impl.lucene.fts.FullTextSearchIndexerImpl.index(FullTextSearchIndexerImpl.java:190)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
        at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at $Proxy70.index(Unknown Source)
        at org.alfresco.repo.search.impl.lucene.fts.FTSIndexerJob.execute(FTSIndexerJob.java:52)
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Before restarting, I have seen this in the logs :

       
12:19:22,012  ERROR [org.alfresco.fileserver] org.alfresco.jlan.netbios.NetBIOSException: NBREQ Called name is not this server (GED)
12:19:22,013  ERROR [org.alfresco.fileserver]   at org.alfresco.jlan.smb.server.SMBSrvSession.procNetBIOSSessionRequest(SMBSrvSession.java:881)
12:19:22,013  ERROR [org.alfresco.fileserver]   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1446)
12:19:22,013  ERROR [org.alfresco.fileserver]   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:111)
12:19:22,013  ERROR [org.alfresco.fileserver]   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
12:19:22,013  ERROR [org.alfresco.fileserver]   at java.lang.Thread.run(Thread.java:619)
12:19:22,013  ERROR [org.alfresco.fileserver] org.alfresco.jlan.netbios.NetBIOSException: NBREQ Called name is not this server (GED)
12:19:22,013  ERROR [org.alfresco.fileserver]   at org.alfresco.jlan.smb.server.SMBSrvSession.procNetBIOSSessionRequest(SMBSrvSession.java:881)
12:19:22,013  ERROR [org.alfresco.fileserver]   at org.alfresco.jlan.smb.server.SMBSrvSession.processPacket(SMBSrvSession.java:1446)
12:19:22,013  ERROR [org.alfresco.fileserver]   at org.alfresco.jlan.smb.server.nio.NIOCIFSThreadRequest.runRequest(NIOCIFSThreadRequest.java:111)
12:19:22,013  ERROR [org.alfresco.fileserver]   at org.alfresco.jlan.server.thread.ThreadRequestPool$ThreadWorker.run(ThreadRequestPool.java:141)
12:19:22,013  ERROR [org.alfresco.fileserver]   at java.lang.Thread.run(Thread.java:619)
12:19:26,419  ERROR [repo.action.AsynchronousActionExecutionQueueImpl] Failed to execute asynchronous action: Action[ id=f9cacddb-0c61-418a-bd8d-3a5a1d6c79bc, node=workspace://SpacesStore/f9cacddb-0c61-418a-bd8d-3a5a1d6c79bc ]
org.hibernate.exception.GenericJDBCException: could not load an entity: [org.alfresco.repo.domain.hibernate.NodeImpl#11931]
        at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:103)
        at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:91)
        at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43)
        at org.hibernate.loader.Loader.loadEntity(Loader.java:1874)
        at org.hibernate.loader.entity.AbstractEntityLoader.load(AbstractEntityLoader.java:48)
        at org.hibernate.loader.entity.AbstractEntityLoader.load(AbstractEntityLoader.java:42)
        at org.hibernate.persister.entity.AbstractEntityPersister.load(AbstractEntityPersister.java:3049)
        at org.hibernate.event.def.DefaultLoadEventListener.loadFromDatasource(DefaultLoadEventListener.java:399)
        at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:375)
        at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:139)
        at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:195)
        at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:103)
        at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:878)
        at org.hibernate.impl.SessionImpl.get(SessionImpl.java:815)
        at org.hibernate.impl.SessionImpl.get(SessionImpl.java:808)
        at org.alfresco.repo.node.db.hibernate.HibernateNodeDaoServiceImpl.getNodeOrNull(HibernateNodeDaoServiceImpl.java:797)
        at org.alfresco.repo.node.db.hibernate.HibernateNodeDaoServiceImpl.getNodePair(HibernateNodeDaoServiceImpl.java:1185)
        at sun.reflect.GeneratedMethodAccessor212.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
..
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.Connection was implicitly closed due to underlying exception/error:

** BEGIN NESTED EXCEPTION **

com.mysql.jdbc.exceptions.jdbc4.CommunicationsException
MESSAGE: The last packet successfully received from the server was237098 milliseconds ago.The last packet sent successfully to the server was 237098 milliseconds ago, which  is longer than the server configured value of 'wait_timeout'. You should consider either expiring and/or testing connection validity before use in your application, increasing the server configured values for client timeouts, or using the Connector/J connection property 'autoReconnect=true' to avoid this problem.

STACKTRACE:

com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: The last packet successfully received from the server was237098 milliseconds ago.The last packet sent successfully to the server was 237098 milliseconds ago, which  is longer than the server configured value of 'wait_timeout'. You should consider either expiring and/or testing connection validity before use in your application, increasing the server configured values for client timeouts, or using the Connector/J connection property 'autoReconnect=true' to avoid this problem.
        at sun.reflect.GeneratedConstructorAccessor371.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
        at com.mysql.jdbc.Util.handleNewInstance(Util.java:406)
        at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1074)
        at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3270)
        at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1932)
        at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2101)
        at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2554)
        at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1761)
        at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:1912)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93)
        at org.hibernate.jdbc.AbstractBatcher.getResultSet(AbstractBatcher.java:186)
        at org.hibernate.loader.Loader.getResultSet(Loader.java:1787)
        at org.hibernate.loader.Loader.doQuery(Loader.java:674)
        at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:236)
        at org.hibernate.loader.Loader.loadEntity(Loader.java:1860)
        at org.hibernate.loader.entity.AbstractEntityLoader.load(AbstractEntityLoader.java:48)
        at org.hibernate.loader.entity.AbstractEntityLoader.load(AbstractEntityLoader.java:42)
        at org.hibernate.persister.entity.AbstractEntityPersister.load(AbstractEntityPersister.java:3049)
        at org.hibernate.event.def.DefaultLoadEventListener.loadFromDatasource(DefaultLoadEventListener.java:399)

t org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:375)
        at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:139)
        at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:195)
        at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:103)
        at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:878)
        at org.hibernate.impl.SessionImpl.get(SessionImpl.java:815)
        at org.hibernate.impl.SessionImpl.get(SessionImpl.java:808)
        at org.alfresco.repo.node.db.hibernate.HibernateNodeDaoServiceImpl.getNodeOrNull(HibernateNodeDaoServiceImpl.java:797)
        at org.alfresco.repo.node.db.hibernate.HibernateNodeDaoServiceImpl.getNodePair(HibernateNodeDaoServiceImpl.java:1185)
        at sun.reflect.GeneratedMethodAccessor212.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
        at org.alfresco.repo.transaction.TransactionalDaoInterceptor.invoke(TransactionalDaoInterceptor.java:68)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
        at org.alfresco.repo.domain.hibernate.DirtySessionMethodInterceptor.invoke(DirtySessionMethodInterceptor.java:419)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
        at org.alfresco.repo.transaction.SingleEntryTransactionResourceInterceptor.invokeInternal(SingleEntryTransactionResourceInterceptor.java:169)
        at org.alfresco.repo.transaction.SingleEntryTransactionResourceInterceptor.invoke(SingleEntryTransactionResourceInterceptor.java:138)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at $Proxy9.getNodePair(Unknown Source)
        at org.alfresco.repo.node.db.DbNodeServiceImpl.exists(DbNodeServiceImpl.java:170)
        at sun.reflect.GeneratedMethodAccessor341.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
        at org.alfresco.repo.tenant.MultiTNodeServiceInterceptor.invoke(MultiTNodeServiceInterceptor.java:110)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at $Proxy11.exists(Unknown Source)
        at sun.reflect.GeneratedMethodAccessor341.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.alfresco.repo.service.StoreRedirectorProxyFactory$RedirectorInvocationHandler.invoke(StoreRedirectorProxyFactory.java:221)
        at $Proxy12.exists(Unknown Source)
        at sun.reflect.GeneratedMethodAccessor341.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
        at org.alfresco.repo.node.MLPropertyInterceptor.invoke(MLPropertyInterceptor.java:306)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
        at org.alfresco.repo.node.MLPropertyInterceptor.invoke(MLPropertyInterceptor.java:306)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)

at org.alfresco.repo.node.NodeRefPropertyMethodInterceptor.invoke(NodeRefPropertyMethodInterceptor.java:274)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
        at org.alfresco.repo.node.NodeRefPropertyMethodInterceptor.invoke(NodeRefPropertyMethodInterceptor.java:274)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at $Proxy11.exists(Unknown Source)
        at org.alfresco.repo.action.evaluator.ComparePropertyValueEvaluator.evaluateImpl(ComparePropertyValueEvaluator.java:179)
        at org.alfresco.repo.action.evaluator.CompareMimeTypeEvaluator.evaluateImpl(CompareMimeTypeEvaluator.java:90)
        at org.alfresco.repo.action.evaluator.ActionConditionEvaluatorAbstractBase.evaluate(ActionConditionEvaluatorAbstractBase.java:97)
        at org.alfresco.repo.action.ActionServiceImpl.evaluateSimpleCondition(ActionServiceImpl.java:490)
        at org.alfresco.repo.action.ActionServiceImpl.evaluateActionCondition(ActionServiceImpl.java:478)
        at org.alfresco.repo.action.ActionServiceImpl.evaluateAction(ActionServiceImpl.java:399)
        at org.alfresco.repo.action.ActionServiceImpl.executeActionImpl(ActionServiceImpl.java:645)
        at org.alfresco.repo.action.AsynchronousActionExecutionQueueImpl$ActionExecutionWrapper$1$1.execute(AsynchronousActionExecutionQueueImpl.java:369)
        at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:327)
        at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:234)
        at org.alfresco.repo.action.AsynchronousActionExecutionQueueImpl$ActionExecutionWrapper$1.doWork(AsynchronousActionExecutionQueueImpl.java:378)
        at org.alfresco.repo.security.authentication.AuthenticationUtil.runAs(AuthenticationUtil.java:514)
        at org.alfresco.repo.action.AsynchronousActionExecutionQueueImpl$ActionExecutionWrapper.run(AsynchronousActionExecutionQueueImpl.java:381)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)
Caused by: java.net.SocketException: Broken pipe
        at java.net.SocketOutputStream.socketWrite0(Native Method)
        at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
        at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
        at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
        at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
        at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3251)
        … 88 more


** END NESTED EXCEPTION **


        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
        at com.mysql.jdbc.Util.handleNewInstance(Util.java:406)
        at com.mysql.jdbc.Util.getInstance(Util.java:381)
        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:984)
        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:956)
        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:926)
        at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1115)
        at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4111)
        at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4077)
        at org.apache.commons.dbcp.PoolingConnection.makeObject(PoolingConnection.java:193)
        at org.apache.commons.pool.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:964)
        at org.apache.commons.dbcp.PoolingConnection.prepareStatement(PoolingConnection.java:92)
        … 85 more
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

My startup arguments :

/usr/java/jdk1.6.0_17/bin/java -Xms512m -Xmx1024m -XX:MaxPermSize=256m -server‍

Re: Alfresco running 100% CPU several days...

dranakan — Tue, 02 Mar 2010 07:05:50 GMT

Hello,

I have done two jstack (to see what Alfresco do) :

2010-03-01 14:10:04 : http://www.megaupload.com/?d=YO72F2ZE or on Jira: https://issues.alfresco.com/jira/secure/attachment/17070/jstack_alfresco_2010-03-01_141004.log

2010-03-02 07:57:11 : http://www.megaupload.com/?d=NWO1NQCH or on Jira https://issues.alfresco.com/jira/secure/attachment/17071/jstack_alfresco_2010-03-02_075711.log

TOP

top - 08:04:30 up 33 days,  8:21,  1 user,  load average: 1.00, 1.02, 1.04
Tasks:  57 total,   1 running,  56 sleeping,   0 stopped,   0 zombie
Cpu(s): 33.3%us, 23.5%sy,  0.0%ni, 43.0%id,  0.1%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   2097328k total,  1365344k used,   731984k free,    47776k buffers
Swap:  1081336k total,   119020k used,   962316k free,   869476k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 2120 alfresco  18   0 1453m 359m 4316 S 99.9 17.5   1073:58 java
…
‍‍‍‍‍‍‍‍‍‍

Can somebody help me ?

Thanks

(On Jira : https://issues.alfresco.com/jira/browse/ALF-1918)

Re: Alfresco running 100% CPU several days...

dranakan — Tue, 02 Mar 2010 10:39:30 GMT

I suspect a problem with pdfbox because it appears all the time with jstack.

"DefaultScheduler_Worker-3" prio=10 tid=0x08f8b400 nid=0x86b runnable [0x62b82000]
   java.lang.Thread.State: RUNNABLE
        at java.lang.ThreadLocal$ThreadLocalMap.access$100(ThreadLocal.java:242)
        at java.lang.ThreadLocal.set(ThreadLocal.java:164)
        at sun.nio.ch.Util.getTemporaryDirectBuffer(Util.java:51)
        at sun.nio.ch.IOUtil.read(IOUtil.java:205)
        at sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:144)
        - locked <0x7050d448> (a java.lang.Object)
        at org.alfresco.repo.content.AbstractContentAccessor$CallbackFileChannel.read(AbstractContentAccessor.java:422)
        at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:48)
        at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:92)
        at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:86)
        - locked <0x7050d4a0> (a sun.nio.ch.ChannelInputStream)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
        - locked <0x705114c8> (a java.io.BufferedInputStream)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
        - locked <0x705114e8> (a java.io.BufferedInputStream)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
        - locked <0x70511508> (a java.io.BufferedInputStream)
        at java.io.FilterInputStream.read(FilterInputStream.java:66)
        at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
        at org.apache.pdfbox.io.PushBackInputStream.read(PushBackInputStream.java:84)
        at org.apache.pdfbox.pdfparser.BaseParser.skipSpaces(BaseParser.java:1190)
        at org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionary(BaseParser.java:188)
        at org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
        at org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionaryValue(BaseParser.java:141)
        at org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionary(BaseParser.java:213)
        at org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
        at org.apache.pdfbox.pdfparser.PDFParser.parseObject(PDFParser.java:519)
        at org.apache.pdfbox.pdfparser.PDFParser.parse(PDFParser.java:179)
        at org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:841)
        at org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:808)
        at org.alfresco.repo.content.transform.PdfBoxContentTransformer.transformInternal(PdfBoxContentTransformer.java:74)
        at org.alfresco.repo.content.transform.AbstractContentTransformer2.transform(AbstractContentTransformer2.java:167)
        at org.alfresco.repo.content.transform.AbstractContentTransformer2.transform(AbstractContentTransformer2.java:143)
        at org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.indexProperty(ADMLuceneIndexerImpl.java:948)
        at org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocumentsImpl(ADMLuceneIndexerImpl.java:625)
        at org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocuments(ADMLuceneIndexerImpl.java:590)
        at org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.updateFullTextSearch(ADMLuceneIndexerImpl.java:1569)
        at org.alfresco.repo.search.impl.lucene.fts.FullTextSearchIndexerImpl.index(FullTextSearchIndexerImpl.java:190)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
        at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at $Proxy70.index(Unknown Source)
        at org.alfresco.repo.search.impl.lucene.fts.FTSIndexerJob.execute(FTSIndexerJob.java:52)
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

What can I do ?

Re: Alfresco running 100% CPU several days...

dranakan — Wed, 03 Mar 2010 09:53:46 GMT

Using HotTread, I can confirm that PDFBox is using the CPU :

50.0% CPU Usage by Thread 'DefaultScheduler_Worker-3'
  4/10 snapshots sharing following 41 elements
    java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
    java.io.BufferedInputStream.read(BufferedInputStream.java:317)
    java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
    java.io.BufferedInputStream.read(BufferedInputStream.java:317)
    java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
    java.io.BufferedInputStream.read(BufferedInputStream.java:237)
    java.io.FilterInputStream.read(FilterInputStream.java:66)
    java.io.PushbackInputStream.read(PushbackInputStream.java:122)
    org.apache.pdfbox.io.PushBackInputStream.read(PushBackInputStream.java:84)
    org.apache.pdfbox.pdfparser.BaseParser.skipSpaces(BaseParser.java:1190)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionary(BaseParser.java:188)
    org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionaryValue(BaseParser.java:141)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionary(BaseParser.java:213)
    org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
    org.apache.pdfbox.pdfparser.PDFParser.parseObject(PDFParser.java:519)
    org.apache.pdfbox.pdfparser.PDFParser.parse(PDFParser.java:179)
    org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:841)
    org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:808)
    org.alfresco.repo.content.transform.PdfBoxContentTransformer.transformInternal(PdfBoxContentTransformer.java:74)
    org.alfresco.repo.content.transform.AbstractContentTransformer2.transform(AbstractContentTransformer2.java:167)
    org.alfresco.repo.content.transform.AbstractContentTransformer2.transform(AbstractContentTransformer2.java:143)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.indexProperty(ADMLuceneIndexerImpl.java:948)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocumentsImpl(ADMLuceneIndexerImpl.java:625)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocuments(ADMLuceneIndexerImpl.java:590)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.updateFullTextSearch(ADMLuceneIndexerImpl.java:1569)
    org.alfresco.repo.search.impl.lucene.fts.FullTextSearchIndexerImpl.index(FullTextSearchIndexerImpl.java:190)
    sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:597)
    org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
    org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
    org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
    $Proxy70.index(Unknown Source)
    org.alfresco.repo.search.impl.lucene.fts.FTSIndexerJob.execute(FTSIndexerJob.java:52)
    org.quartz.core.JobRunShell.run(JobRunShell.java:202)
    org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)
  2/10 snapshots sharing following 49 elements
    sun.nio.ch.FileDispatcher.read0(Native Method)
    sun.nio.ch.FileDispatcher.read(FileDispatcher.java:26)
    sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:233)
    sun.nio.ch.IOUtil.read(IOUtil.java:206)
    sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:144)
    org.alfresco.repo.content.AbstractContentAccessor$CallbackFileChannel.read(AbstractContentAccessor.java:422)
    sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:48)
    sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:92)
    sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:86)
    java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
    java.io.BufferedInputStream.read(BufferedInputStream.java:317)
    java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
    java.io.BufferedInputStream.read(BufferedInputStream.java:317)
    java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
    java.io.BufferedInputStream.read(BufferedInputStream.java:237)
    java.io.FilterInputStream.read(FilterInputStream.java:66)
    java.io.PushbackInputStream.read(PushbackInputStream.java:122)
    org.apache.pdfbox.io.PushBackInputStream.read(PushBackInputStream.java:84)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionary(BaseParser.java:200)
    org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionaryValue(BaseParser.java:141)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionary(BaseParser.java:213)
    org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
    org.apache.pdfbox.pdfparser.PDFParser.parseObject(PDFParser.java:519)
    org.apache.pdfbox.pdfparser.PDFParser.parse(PDFParser.java:179)
    org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:841)
    org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:808)
    org.alfresco.repo.content.transform.PdfBoxContentTransformer.transformInternal(PdfBoxContentTransformer.java:74)
    org.alfresco.repo.content.transform.AbstractContentTransformer2.transform(AbstractContentTransformer2.java:167)
    org.alfresco.repo.content.transform.AbstractContentTransformer2.transform(AbstractContentTransformer2.java:143)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.indexProperty(ADMLuceneIndexerImpl.java:948)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocumentsImpl(ADMLuceneIndexerImpl.java:625)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocuments(ADMLuceneIndexerImpl.java:590)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.updateFullTextSearch(ADMLuceneIndexerImpl.java:1569)
    org.alfresco.repo.search.impl.lucene.fts.FullTextSearchIndexerImpl.index(FullTextSearchIndexerImpl.java:190)
    sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:597)
    org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
    org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
    org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
    $Proxy70.index(Unknown Source)
    org.alfresco.repo.search.impl.lucene.fts.FTSIndexerJob.execute(FTSIndexerJob.java:52)
    org.quartz.core.JobRunShell.run(JobRunShell.java:202)
    org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)
  2/10 snapshots sharing following 50 elements
    sun.nio.ch.FileDispatcher.read0(Native Method)
    sun.nio.ch.FileDispatcher.read(FileDispatcher.java:26)
    sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:233)
    sun.nio.ch.IOUtil.read(IOUtil.java:206)
    sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:144)
    org.alfresco.repo.content.AbstractContentAccessor$CallbackFileChannel.read(AbstractContentAccessor.java:422)
    sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:48)
    sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:92)
    sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:86)
    java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
    java.io.BufferedInputStream.read(BufferedInputStream.java:317)
    java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
    java.io.BufferedInputStream.read(BufferedInputStream.java:317)
    java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
    java.io.BufferedInputStream.read(BufferedInputStream.java:237)
    java.io.FilterInputStream.read(FilterInputStream.java:66)
    java.io.PushbackInputStream.read(PushbackInputStream.java:122)
    org.apache.pdfbox.io.PushBackInputStream.read(PushBackInputStream.java:84)
    org.apache.pdfbox.io.PushBackInputStream.peek(PushBackInputStream.java:62)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionary(BaseParser.java:189)
    org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionaryValue(BaseParser.java:141)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionary(BaseParser.java:213)
    org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
    org.apache.pdfbox.pdfparser.PDFParser.parseObject(PDFParser.java:519)
    org.apache.pdfbox.pdfparser.PDFParser.parse(PDFParser.java:179)
    org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:841)
    org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:808)
    org.alfresco.repo.content.transform.PdfBoxContentTransformer.transformInternal(PdfBoxContentTransformer.java:74)
    org.alfresco.repo.content.transform.AbstractContentTransformer2.transform(AbstractContentTransformer2.java:167)
    org.alfresco.repo.content.transform.AbstractContentTransformer2.transform(AbstractContentTransformer2.java:143)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.indexProperty(ADMLuceneIndexerImpl.java:948)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocumentsImpl(ADMLuceneIndexerImpl.java:625)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocuments(ADMLuceneIndexerImpl.java:590)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.updateFullTextSearch(ADMLuceneIndexerImpl.java:1569)
    org.alfresco.repo.search.impl.lucene.fts.FullTextSearchIndexerImpl.index(FullTextSearchIndexerImpl.java:190)
    sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:597)
    org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
    org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
    org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
    $Proxy70.index(Unknown Source)
    org.alfresco.repo.search.impl.lucene.fts.FTSIndexerJob.execute(FTSIndexerJob.java:52)
    org.quartz.core.JobRunShell.run(JobRunShell.java:202)
    org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)
  2/10 snapshots sharing following 30 elements
    org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionaryValue(BaseParser.java:141)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionary(BaseParser.java:213)
    org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
    org.apache.pdfbox.pdfparser.PDFParser.parseObject(PDFParser.java:519)
    org.apache.pdfbox.pdfparser.PDFParser.parse(PDFParser.java:179)
    org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:841)
    org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:808)
    org.alfresco.repo.content.transform.PdfBoxContentTransformer.transformInternal(PdfBoxContentTransformer.java:74)
    org.alfresco.repo.content.transform.AbstractContentTransformer2.transform(AbstractContentTransformer2.java:167)
    org.alfresco.repo.content.transform.AbstractContentTransformer2.transform(AbstractContentTransformer2.java:143)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.indexProperty(ADMLuceneIndexerImpl.java:948)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocumentsImpl(ADMLuceneIndexerImpl.java:625)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.createDocuments(ADMLuceneIndexerImpl.java:590)
    org.alfresco.repo.search.impl.lucene.ADMLuceneIndexerImpl.updateFullTextSearch(ADMLuceneIndexerImpl.java:1569)
    org.alfresco.repo.search.impl.lucene.fts.FullTextSearchIndexerImpl.index(FullTextSearchIndexerImpl.java:190)
    sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:597)
    org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
    org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
    org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
    $Proxy70.index(Unknown Source)
    org.alfresco.repo.search.impl.lucene.fts.FTSIndexerJob.execute(FTSIndexerJob.java:52)
    org.quartz.core.JobRunShell.run(JobRunShell.java:202)
    org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)

19.0% CPU Usage by Thread 'RMI TCP Connection(4285)-127.0.0.1'
  6/10 snapshots sharing following 33 elements
    sun.management.ThreadImpl.getThreadInfo0(Native Method)
    sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:145)
    sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:597)
    com.sun.jmx.mbeanserver.ConvertingMethod.invokeWithOpenReturn(ConvertingMethod.java:167)
    com.sun.jmx.mbeanserver.MXBeanIntrospector.invokeM2(MXBeanIntrospector.java:96)
    com.sun.jmx.mbeanserver.MXBeanIntrospector.invokeM2(MXBeanIntrospector.java:33)
    com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
    com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
    com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
    javax.management.StandardMBean.invoke(StandardMBean.java:391)
    com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
    com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
    javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1426)
    javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
    javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1264)
    javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1359)
    javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
    sun.reflect.GeneratedMethodAccessor1513.invoke(Unknown Source)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:597)
    sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
    sun.rmi.transport.Transport$1.run(Transport.java:159)
    java.security.AccessController.doPrivileged(Native Method)
    sun.rmi.transport.Transport.serviceCall(Transport.java:155)
    sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
    sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
    sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
    java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    java.lang.Thread.run(Thread.java:619)
  4/10 snapshots sharing following 32 elements
    sun.management.ThreadImpl.getThreadInfo0(Native Method)
    sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:145)
    sun.reflect.GeneratedMethodAccessor1539.invoke(Unknown Source)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:597)
    com.sun.jmx.mbeanserver.ConvertingMethod.invokeWithOpenReturn(ConvertingMethod.java:167)
    com.sun.jmx.mbeanserver.MXBeanIntrospector.invokeM2(MXBeanIntrospector.java:96)
    com.sun.jmx.mbeanserver.MXBeanIntrospector.invokeM2(MXBeanIntrospector.java:33)
    com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
    com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
    com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
    javax.management.StandardMBean.invoke(StandardMBean.java:391)
    com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
    com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
    javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1426)
    javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
    javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1264)
    javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1359)
    javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
    sun.reflect.GeneratedMethodAccessor1513.invoke(Unknown Source)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:597)
    sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
    sun.rmi.transport.Transport$1.run(Transport.java:159)
    java.security.AccessController.doPrivileged(Native Method)
    sun.rmi.transport.Transport.serviceCall(Transport.java:155)
    sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
    sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
    sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
    java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    java.lang.Thread.run(Thread.java:619)

0.0% CPU Usage by Thread 'main'
  10/10 snapshots sharing following 13 elements
    java.net.PlainSocketImpl.socketAccept(Native Method)
    java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)
    java.net.ServerSocket.implAccept(ServerSocket.java:453)
    java.net.ServerSocket.accept(ServerSocket.java:421)
    org.apache.catalina.core.StandardServer.await(StandardServer.java:389)
    org.apache.catalina.startup.Catalina.await(Catalina.java:642)
    org.apache.catalina.startup.Catalina.start(Catalina.java:602)
    sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:597)
    org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:288)
    org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:413)‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Alfresco running 100% CPU several days...

dranakan — Mon, 08 Mar 2010 07:34:32 GMT

Hello,

Alf_data (also lucene-indexes) and the mysql was on a NFS drive. On the French forum, someone advised me to have the lucene-indexes on the local disk.
The alf_data and mysql have been moved two day ago on the local disk but I still get the CPU usage…

top - 08:07:29 up 2 days, 17:49,  1 user,  load average: 1.05, 1.02, 1.00
Tasks:  58 total,   1 running,  57 sleeping,   0 stopped,   0 zombie
Cpu(s): 56.7%us, 41.9%sy,  0.0%ni,  1.3%id,  0.1%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   2097328k total,  2078184k used,    19144k free,    85832k buffers
Swap:  1081336k total,       36k used,  1081300k free,  1565096k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
15362 alfresco  18   0 1434m 342m  12m S 99.8 16.7   3828:09 java
‍‍‍‍‍‍‍‍‍

Working with pdfbox :

49.0% CPU Usage by Thread 'DefaultScheduler_Worker-6'
  3/10 snapshots sharing following 48 elements
    sun.nio.ch.FileDispatcher.read0(Native Method)
    sun.nio.ch.FileDispatcher.read(FileDispatcher.java:26)
    sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:233)
    sun.nio.ch.IOUtil.read(IOUtil.java:206)
    sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:144)
    org.alfresco.repo.content.AbstractContentAccessor$CallbackFileChannel.read(AbstractContentAccessor.java:422)
    sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:48)
    sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:92)
    sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:86)
    java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
    java.io.BufferedInputStream.read(BufferedInputStream.java:317)
    java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
    java.io.BufferedInputStream.read(BufferedInputStream.java:317)
    java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
    java.io.BufferedInputStream.read(BufferedInputStream.java:237)
    java.io.FilterInputStream.read(FilterInputStream.java:66)
    java.io.PushbackInputStream.read(PushbackInputStream.java:122)
    org.apache.pdfbox.io.PushBackInputStream.read(PushBackInputStream.java:84)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionary(BaseParser.java:200)
    org.apache.pdfbox.pdfparser.BaseParser.parseDirObject(BaseParser.java:870)
    org.apache.pdfbox.pdfparser.BaseParser.parseCOSDictionaryValue(BaseParser.java:141)
…
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Alfresco running 100% CPU several days...

dranakan — Tue, 09 Mar 2010 09:51:36 GMT

Hello,

I have changed the arguments to start alfresco (to have more performance) :


/usr/java/jdk1.6.0_17/bin/java -server -Xcomp -Xbatch -Xss1M -Xms1G -Xmx1500m -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode -XX:NewSize=512m -XX:MaxPermSize=128M -XX:CMSInitiatingOccupancyFraction=80 -Dalfresco.home=/opt/Alfresco -Dcom.sun.management.jmxremote -XX:CompileCommand=exclude,org/apache/lucene/index/IndexReader$1,doBody -XX:CompileCommand=exclude,org/alfresco/repo/search/impl/lucene/index/IndexInfo$Merger,mergeIndexes -XX:CompileCommand=exclude,org/alfresco/repo/search/impl/lucene/index/IndexInfo$Merger,mergeDeletions -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/opt/Alfresco/tomcat/conf/logging.properties -Djava.endorsed.dirs=/opt/Alfresco/tomcat/endorsed -classpath :/opt/Alfresco/tomcat/bin/bootstrap.jar -Dcatalina.base=/opt/Alfresco/tomcat -Dcatalina.home=/opt/Alfresco/tomcat -Djava.io.tmpdir=/opt/Alfresco/tomcat/temp org.apache.catalina.startup.Bootstrap start
‍‍‍

The server has 2 gb ram.

I don't think that the problem is with Mysql because it doesn't run a lot :

mysqladmin processlist -u root -p
Enter password:
+—–+———-+—————–+———-+———+——+——-+——– ———-+
| Id  | User     | Host            | db       | Command | Time | State | Info            |
+—–+———-+—————–+———-+———+——+——-+——– ———-+
| 323 | alfresco | localhost:47685 | alfresco | Sleep   | 22   |       |                |
| 324 | alfresco | localhost:47686 | alfresco | Sleep   | 682  |       |              |
| 325 | alfresco | localhost:47687 | alfresco | Sleep   | 7    |       |                   |
| 333 | root     | localhost       |          | Query   | 0    |       | show processlist |
+—–+———-+—————–+———-+———+——+——-+——————+‍‍‍‍‍‍‍‍‍‍

Someone knows how we can know the state of the indexation :?: For exemple indication like : 245 files indexed on 10'000 files.

Thanks

Re: Alfresco running 100% CPU several days...

dranakan — Wed, 10 Mar 2010 14:27:36 GMT

Seems to be ok with pdfbox-1.0.0.jar instead of pdfbox-0.8.0-incubating.jar.

Can I use the pdfbox-1.0.0.jar with Alfresco 32.r2 ? Has been checked ?

Thanks

Re: Alfresco running 100% CPU several days...

snig — Wed, 07 Jul 2010 10:24:40 GMT

Have you been successful in removing the error replacing the pdfbox jar?
For me, the problem still persists.

However, looks like they have resolved this in 3.3g community.