Alfresco Server Crashed

[mahkath]

Hi All,

Currently we are migrating data from one Alfresco to other Alfresco Instance using Webservice API's.

We are using Alfresco 2.1 + Solaris 10 x86
Migration is happening from past two days, but unfortunately one of the Alfresco server (destination server)crashed.

Here is the log message printed in catalina.out file.

#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
#  SIGSEGV (0xb) at pc=0xf8891055, pid=14903, tid=105
#
# Java VM: Java HotSpot(TM) Server VM (1.5.0_11-b03 mixed mode)
# Problematic frame:
# J  org.hibernate.type.TypeFactory.disassemble([Ljava/lang/Object;[Lorg/hibernate/type/Type;[ZLorg/hibernate/engine/SessionImplementor;Ljava/lang/Object;)[Ljava/io/Serializable;
#
[thread 106 also had an error]
# An error report file with more information is saved as [thread 106 also had an error]
#
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
#‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Please let me know if there is any issue in Alfresco for bulk Migration.

Regards,
Mahesh

[mahkath]

Here is complete core dump of the Alfresco.

#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
#  SIGSEGV (0xb) at pc=0xf8891055, pid=14903, tid=105
#
# Java VM: Java HotSpot(TM) Server VM (1.5.0_11-b03 mixed mode)
# Problematic frame:
# J  org.hibernate.type.TypeFactory.disassemble([Ljava/lang/Object;[Lorg/hibernate/type/Type;[ZLorg/hibernate/engine/SessionImplementor;Ljava/lang/Object;)[Ljava/io/Serializable;
#

—————  T H R E A D  —————

Current thread (0x0a38b130):  JavaThread "TraceableThread-2-thread-1" daemon [_thread_in_Java, id=105]

siginfo:si_signo=11, si_errno=0, si_code=2, si_addr=0xf7200000

Registers:
EAX=0xb3807318, EBX=0xf4da1030, ECX=0xf3b1e5d9, EDX=0xf4da1030
ESP=0xafadce90, EBP=0x00000001, ESI=0xb386b4c0, EDI=0xf7200000
EIP=0xf8891055, EFLAGS=0x00010282

Top of Stack: (sp=0xafadce90)
0xafadce90:   f2c7a2f8 f2c871f0 f4da1008 f4d9c9d8
0xafadcea0:   f4da0ff8 b7e1fa40 0a38b130 b5b147fb
0xafadceb0:   f2c871f0 00000000 fe72c11e f7c7b398
0xafadcec0:   00000000 f2c7a2f8 f2c871f0 afadced0
0xafadced0:   afadcf18 afadcf38 afadcf18 afadcee0
0xafadcee0:   f7c02a94 f2c871f0 f2c7a2f8 00000000
0xafadcef0:   b7e1fa40 f4d9c9d8 f4da0fe0 afadcefc
0xafadcf00:   b5b147fb afadcf38 b5b14f90 b663995c 

Instructions: (pc=0xf8891055)
0xf8891045:   74 27 b8 18 73 80 b3 8b 7e 18 8b 4f 08 83 c7 0c
0xf8891055:   f2 af 0f 85 05 00 00 00 89 46 14 33 ff 85 ff 0f 

Stack: [0xafa9e000,0xafade000),  sp=0xafadce90,  free space=251k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
J  org.hibernate.type.TypeFactory.disassemble([Ljava/lang/Object;[Lorg/hibernate/type/Type;[ZLorg/hibernate/engine/SessionImplementor;Ljava/lang/Object;)[Ljava/io/Serializable;

[error occurred during error reporting, step 120, id 0xb]


—————  P R O C E S S  —————

Java Threads: ( => current thread )
  0x08c102c8 JavaThread "TraceableThread-2-thread-2" daemon [_thread_in_Java, id=106]
=>0x0a38b130 JavaThread "TraceableThread-2-thread-1" daemon [_thread_in_Java, id=105]
  0x09282af8 JavaThread "http-8180-Monitor" [_thread_blocked, id=95]
  0x09281ec8 JavaThread "http-8180-Processor25" daemon [_thread_blocked, id=94]
  0x0b11f4f8 JavaThread "http-8180-Processor24" daemon [_thread_in_native, id=93]
  0x0b11e910 JavaThread "http-8180-Processor23" daemon [_thread_blocked, id=92]
  0x0b11dd28 JavaThread "http-8180-Processor22" daemon [_thread_in_native, id=91]
  0x0bc5d3a8 JavaThread "http-8180-Processor21" daemon [_thread_blocked, id=90]
  0x0bc5c820 JavaThread "http-8180-Processor20" daemon [_thread_blocked, id=89]
  0x0a74dc48 JavaThread "http-8180-Processor19" daemon [_thread_blocked, id=88]
  0x0a74d180 JavaThread "http-8180-Processor18" daemon [_thread_blocked, id=87]
  0x0a412478 JavaThread "http-8180-Processor17" daemon [_thread_blocked, id=86]
  0x086f9ef8 JavaThread "http-8180-Processor16" daemon [_thread_blocked, id=85]
  0x09edbb30 JavaThread "http-8180-Processor15" daemon [_thread_blocked, id=84]
  0x0a9e4f10 JavaThread "http-8180-Processor14" daemon [_thread_blocked, id=83]
  0x08f04e50 JavaThread "http-8180-Processor13" daemon [_thread_blocked, id=82]
  0x0a3202f0 JavaThread "http-8180-Processor12" daemon [_thread_blocked, id=81]
  0x09f63550 JavaThread "http-8180-Processor11" daemon [_thread_blocked, id=80]
  0x0a138c38 JavaThread "http-8180-Processor10" daemon [_thread_blocked, id=79]
  0x0944da58 JavaThread "http-8180-Processor9" daemon [_thread_blocked, id=78]
  0x099afde8 JavaThread "http-8180-Processor8" daemon [_thread_blocked, id=77]
  0x08f06d68 JavaThread "http-8180-Processor7" daemon [_thread_blocked, id=76]
  0x0b11fd48 JavaThread "http-8180-Processor6" daemon [_thread_blocked, id=75]
  0x095f40b8 JavaThread "http-8180-Processor5" daemon [_thread_blocked, id=74]
  0x096c87a0 JavaThread "http-8180-Processor4" daemon [_thread_blocked, id=73]
  0x0a714290 JavaThread "http-8180-Processor3" daemon [_thread_blocked, id=72]
  0x0a3211b8 JavaThread "http-8180-Processor2" daemon [_thread_blocked, id=71]
  0x08446f28 JavaThread "http-8180-Processor1" daemon [_thread_blocked, id=70]
  0x08fb2b48 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=69]
  0x08d38f48 JavaThread "AlfrescoJbpmJobExector:192.168.128.236:1" [_thread_blocked, id=67]
  0x082280a8 JavaThread "FTP Server" [_thread_in_native, id=66]
  0x09227490 JavaThread "Notify_workspace://SpacesStore/43a81dc1-3ed9-11de-9dea-a1cadbbd3f71" daemon [_thread_blocked, id=65]
  0x09091f00 JavaThread "Notify_workspace://SpacesStore/43a81dc1-3ed9-11de-9dea-a1cadbbd3f71" daemon [_thread_blocked, id=64]
  0x08229720 JavaThread "Index merger thread /export/home/share/alfresco_prod/lucene-indexes/workspace/SpacesStore" daemon [_thread_blocked, id=63]
  0x0a315e30 JavaThread "Index cleaner thread /export/home/share/alfresco_prod/lucene-indexes/workspace/SpacesStore" daemon [_thread_blocked, id=62]
  0x08628898 JavaThread "Index merger thread /export/home/share/alfresco_prod/lucene-indexes/archive/SpacesStore" daemon [_thread_blocked, id=61]
  0x082867e8 JavaThread "Index cleaner thread /export/home/share/alfresco_prod/lucene-indexes/archive/SpacesStore" daemon [_thread_blocked, id=60]
  0x09fd55b0 JavaThread "Index merger thread /export/home/share/alfresco_prod/lucene-indexes/workspace/lightWeightVersionStore" daemon [_thread_blocked, id=59]
  0x086cc768 JavaThread "Index cleaner thread /export/home/share/alfresco_prod/lucene-indexes/workspace/lightWeightVersionStore" daemon [_thread_blocked, id=58]
  0x0998ce60 JavaThread "Index merger thread /export/home/share/alfresco_prod/lucene-indexes/user/alfrescoUserStore" daemon [_thread_blocked, id=57]
  0x09f52b40 JavaThread "Index cleaner thread /export/home/share/alfresco_prod/lucene-indexes/user/alfrescoUserStore" daemon [_thread_blocked, id=56]
  0x0ab36b88 JavaThread "Index merger thread /export/home/share/alfresco_prod/lucene-indexes/system/system" daemon [_thread_blocked, id=55]
  0x0a1c1668 JavaThread "Index cleaner thread /export/home/share/alfresco_prod/lucene-indexes/system/system" daemon [_thread_blocked, id=54]
  0x0ae33b38 JavaThread "Store webservice.UserQuerySessionCache Spool Thread" daemon [_thread_blocked, id=53]
  0x0a5fd6e8 JavaThread "Store webservice.QuerySessionCache Spool Thread" daemon [_thread_blocked, id=52]
  0x0a53b250 JavaThread "Thread-12" [_thread_blocked, id=49]
  0x0944deb0 JavaThread "RMI LeaseChecker" daemon [_thread_blocked, id=46]
  0x099a4950 JavaThread "RMI RenewClean-[192.168.128.236:41498]" daemon [_thread_blocked, id=44]
  0x0a052f18 JavaThread "GC Daemon" daemon [_thread_blocked, id=42]
  0x085fde30 JavaThread "RMI Reaper" [_thread_blocked, id=41]
  0x085fdca8 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=40]
  0x08a23820 JavaThread "RMI TCP Accept-50500" daemon [_thread_in_native, id=39]
  0x09c8c858 JavaThread "Timer-1" daemon [_thread_blocked, id=38]
  0x09283200 JavaThread "DefaultScheduler_QuartzSchedulerThread" [_thread_blocked, id=37]
  0x091b3510 JavaThread "DefaultScheduler_Worker-10" [_thread_blocked, id=36]
  0x0abb11b8 JavaThread "DefaultScheduler_Worker-9" [_thread_blocked, id=35]
  0x091b56b0 JavaThread "DefaultScheduler_Worker-8" [_thread_blocked, id=34]
  0x0a086500 JavaThread "DefaultScheduler_Worker-7" [_thread_blocked, id=33]
  0x093849c8 JavaThread "DefaultScheduler_Worker-6" [_thread_blocked, id=32]
  0x0a9809e8 JavaThread "DefaultScheduler_Worker-5" [_thread_blocked, id=31]
  0x0a601790 JavaThread "DefaultScheduler_Worker-4" [_thread_blocked, id=30]
  0x0828eac0 JavaThread "DefaultScheduler_Worker-3" [_thread_blocked, id=29]
  0x09cf4840 JavaThread "DefaultScheduler_Worker-2" [_thread_blocked, id=28]
  0x097a4cc8 JavaThread "DefaultScheduler_Worker-1" [_thread_blocked, id=27]
  0x08c284c8 JavaThread "FileStateReaper" daemon [_thread_blocked, id=26]
  0x0a86d9f8 JavaThread "Store org.alfresco.cache.ticketsCache Spool Thread" daemon [_thread_blocked, id=16]
  0x0847da30 JavaThread "Timer-0" daemon [_thread_blocked, id=15]
  0x081b0be0 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=13]
  0x081af2c8 JavaThread "CompilerThread1" daemon [_thread_blocked, id=12]
  0x081ae538 JavaThread "CompilerThread0" daemon [_thread_blocked, id=11]
  0x081ad668 JavaThread "AdapterThread" daemon [_thread_blocked, id=10]
  0x081ac928 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=9]
  0x081a0648 JavaThread "Finalizer" daemon [_thread_blocked, id=8]
  0x081a0298 JavaThread "Reference Handler" daemon [_thread_blocked, id=7]
  0x08074858 JavaThread "main" [_thread_in_native, id=1]

Other Threads:
  0x0819e1c0 VMThread [id=6]
  0x081b2840 WatcherThread [id=14]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap
 PSYoungGen      total 91968K, used 74841K [0xf0800000, 0xf7200000, 0xf7a00000)
  eden space 75392K, 94% used [0xf0800000,0xf4dd2c88,0xf51a0000)
  from space 16576K, 20% used [0xf51a0000,0xf54e3ad0,0xf61d0000)
  to   space 15808K, 0% used [0xf6290000,0xf6290000,0xf7200000)
 PSOldGen        total 933888K, used 143689K [0xb7800000, 0xf0800000, 0xf0800000)
  object space 933888K, 15% used [0xb7800000,0xc0452710,0xf0800000)
 PSPermGen       total 49152K, used 48210K [0xb3800000, 0xb6800000, 0xb7800000)
  object space 49152K, 98% used [0xb3800000,0xb6714868,0xb6800000)

Dynamic libraries:
0x08050000    /usr/jdk1.5.0_11/bin/java
0xfefb0000    /lib/libthread.so.1
0xfef80000    /lib/libdl.so.1
0xfee50000    /lib/libc.so.1
0xfe600000    /usr/jdk1.5.0_11/jre/lib/i386/server/libjvm.so
0xfee30000    /lib/libsocket.so.1
0xfefa0000    /usr/lib/libsched.so.1
0xfee10000    /usr/lib/libCrun.so.1
0xfedf0000    /lib/libm.so.1
0xfed50000    /lib/libnsl.so.1
0xfecf0000    /lib/libm.so.2
0xfecc0000    /lib/libscf.so.1
0xfeca0000    /lib/libdoor.so.1
0xfec80000    /lib/libuutil.so.1
0xfe5e0000    /lib/libgen.so.1
0xfe5c0000    /lib/libmd.so.1
0xfe5a0000    /lib/libmp.so.2
0xfe580000    /usr/jdk1.5.0_11/jre/lib/i386/native_threads/libhpi.so
0xfe530000    /usr/jdk1.5.0_11/jre/lib/i386/libverify.so
0xfe500000    /usr/jdk1.5.0_11/jre/lib/i386/libjava.so
0xfe4d0000    /usr/jdk1.5.0_11/jre/lib/i386/libzip.so
0xb30b0000    /usr/jdk1.5.0_11/jre/lib/i386/libnet.so
0xb3090000    /usr/jdk1.5.0_11/jre/lib/i386/libj2pkcs11.so
0xb3060000    /usr/lib/libpkcs11.so
0xb3040000    /usr/lib/libcryptoutil.so.1
0xb2ff0000    /usr/lib/security/pkcs11_softtoken_extra.so
0xb0060000    /usr/jdk1.5.0_11/jre/lib/i386/libnio.so
0xb0040000    /lib/librt.so.1
0xb0020000    /lib/libaio.so.1
0xb0000000    /usr/lib/libsendfile.so.1
0xafb20000    /usr/jdk1.5.0_11/jre/lib/i386/librmi.so

VM Arguments:
jvm_args: -Xms1024m -Xmx1024m -DALFRESCO_PROD_2 -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/export/home/weblogic/alfresco_prod2/tomcat/conf/logging.properties -Djava.endorsed.dirs=/export/home/weblogic/alfresco_prod2/tomcat/common/endorsed -Dcatalina.base=/export/home/weblogic/alfresco_prod2/tomcat -Dcatalina.home=/export/home/weblogic/alfresco_prod2/tomcat -Djava.io.tmpdir=/export/home/weblogic/alfresco_prod2/tomcat/temp
java_command: org.apache.catalina.startup.Bootstrap start
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=/usr/java
PATH=/usr/local/bin:/export/home/weblogic/alfresco/ffmpeg/ffmpeg-checkout-2009-01-29:/usr/local/bin:/usr/bin:/usr/ucb:/etc:.
LD_LIBRARY_PATH=/usr/jdk1.5.0_11/jre/lib/i386/server:/usr/jdk1.5.0_11/jre/lib/i386:/usr/jdk1.5.0_11/jre/../lib/i386:/usr/local/lib:/usr/sfw/lib
SHELL=/sbin/sh

Signal Handlers:
SIGSEGV: [libjvm.so+0x522590], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGBUS: [libjvm.so+0x522590], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGFPE: [libjvm.so+0x1752c0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGPIPE: [libjvm.so+0x1752c0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGILL: [libjvm.so+0x1752c0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGHUP: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGQUIT: [libjvm.so+0x4c6bf0], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGTERM: [libjvm.so+0x4c6bf0], sa_mask[0]=0xffbffeff, sa_flags=0x00000004


—————  S Y S T E M  —————

OS:                       Solaris 10 10/08 s10x_u6wos_07b X86
           Copyright 2008 Sun Microsystems, Inc.  All Rights Reserved.
                        Use is subject to license terms.
                            Assembled 27 October 2008

uname:SunOS 5.10 Generic_137138-09 i86pc  (T2 libthread)
rlimit: STACK 10240k, CORE infinity, NOFILE 65536, AS infinity
load average:1.06 0.69 0.64

CPU:total 4 (cores per cpu 4, threads per core 1) family 31 model 2 stepping 3, cmov, cx8, fxsr, mmx, sse, sse2, sse3, mmxext, 3dnowext, 3dnow

Memory: 4k page, physical 6028860k(2750488k free)

vm_info: Java HotSpot(TM) Server VM (1.5.0_11-b03) for solaris-x86, built on Dec 15 2006 01:09:20 by unknown with unknown Workshop:0x550
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍