Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance?

Johan_Andersso1 — Sat, 30 May 2015 00:49:28 GMT

I cannot start the server after applying the hotfixes nuxeo-6.0-HF11-1.4.0 and nuxeo-6.0-HF12-1.0.1 Tomcat is starting up but the Nuxeo runtime is unable to start. What is the problem here and how may I fix this? Is there a way to rollback the hotfixes or undo them manually?

Best regards J

server.log from start attempt

2015-05-30 00:04:15,468 INFO  [main] [org.apache.coyote.http11.Http11Protocol] Initializing ProtocolHandler ["http-bio-0.0.0.0-8080"]
2015-05-30 00:04:15,480 INFO  [main] [org.apache.coyote.ajp.AjpProtocol] Initializing ProtocolHandler ["ajp-bio-0.0.0.0-auto-1"]
2015-05-30 00:04:15,482 INFO  [main] [org.apache.catalina.startup.Catalina] Initialization processed in 450 ms
2015-05-30 00:04:15,505 INFO  [main] [org.apache.catalina.core.StandardService] Starting service Catalina
2015-05-30 00:04:15,505 INFO  [main] [org.apache.catalina.core.StandardEngine] Starting Servlet Engine: Apache Tomcat/7.0.56
2015-05-30 00:04:18,028 INFO  [localhost-startStop-1] [org.apache.catalina.startup.HostConfig] Deploying configuration descriptor /var/lib/nuxeo/server/conf/Catalina/localhost/nuxeo.xml
2015-05-30 00:04:20,075 INFO  [localhost-startStop-1] [org.nuxeo.osgi.application.loader.FrameworkLoader] 
======================================================================
= Starting Nuxeo Framework
======================================================================
  * Server home = /var/lib/nuxeo/server
  * Runtime home = /var/lib/nuxeo/server/nxserver
  * Data Directory = /data/nuxeo/data
  * Log Directory = /var/log/nuxeo
  * Configuration Directory = /var/lib/nuxeo/server/nxserver/config
  * Temp Directory = /var/lib/nuxeo/server/tmp
======================================================================
2015-05-30 00:04:20,108 ERROR [localhost-startStop-1] [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/nuxeo]] Exception sending context initialized event to listener instance of class org.nuxeo.runtime.deployment.NuxeoStarter
java.lang.ExceptionInInitializerError
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
	at java.lang.Class.newInstance(Class.java:374)
	at org.nuxeo.osgi.BundleImpl.getActivator(BundleImpl.java:281)
	at org.nuxeo.osgi.BundleImpl.start(BundleImpl.java:300)
	at org.nuxeo.osgi.BundleRegistry.doRegister(BundleRegistry.java:179)
	at org.nuxeo.osgi.BundleRegistry.register(BundleRegistry.java:127)
	at org.nuxeo.osgi.BundleRegistry.install(BundleRegistry.java:99)
	at org.nuxeo.osgi.OSGiAdapter.install(OSGiAdapter.java:190)
	at org.nuxeo.osgi.application.loader.FrameworkLoader.install(FrameworkLoader.java:265)
	at org.nuxeo.osgi.application.loader.FrameworkLoader.doStart(FrameworkLoader.java:220)
	at org.nuxeo.osgi.application.loader.FrameworkLoader.start(FrameworkLoader.java:112)
	at org.nuxeo.runtime.deployment.NuxeoStarter.start(NuxeoStarter.java:121)
	at org.nuxeo.runtime.deployment.NuxeoStarter.contextInitialized(NuxeoStarter.java:89)
	at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4994)
	at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5492)
	at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
	at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901)
	at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877)
	at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:649)
	at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:672)
	at org.apache.catalina.startup.HostConfig$DeployDescriptor.run(HostConfig.java:1861)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalStateException: Runtime not initialized
	at org.nuxeo.runtime.api.Framework.checkRuntimeInitialized(Framework.java:531)
	at org.nuxeo.runtime.api.Framework.getProperty(Framework.java:365)
	at org.nuxeo.ecm.webengine.gwt.GwtBundleActivator.(GwtBundleActivator.java:48)
	... 29 more
2015-05-30 00:04:20,775 WARN  [localhost-startStop-1] [org.nuxeo.ecm.platform.ui.web.application.config.JSFAnnotationProvider] container scanned classes unavailable, applying default scanning
2015-05-30 00:04:25,833 WARN  [localhost-startStop-1] [org.jboss.seam.security.permission.PersistentPermissionResolver] no permission store available - please install a PermissionStore with the name 'org.jboss.seam.security.jpaPermissionStore' if persistent permissions are required.
2015-05-30 00:04:26,128 ERROR [localhost-startStop-1] [org.apache.catalina.core.StandardContext] Error listenerStart
2015-05-30 00:04:26,151 ERROR [localhost-startStop-1] [org.apache.catalina.core.StandardContext] Context [/nuxeo] startup failed due to previous errors
2015-05-30 00:04:26,179 INFO  [localhost-startStop-1] [org.apache.catalina.startup.HostConfig] Deployment of configuration descriptor /var/lib/nuxeo/server/conf/Catalina/localhost/nuxeo.xml has finished in 8,151 ms
2015-05-30 00:04:26,180 INFO  [localhost-startStop-1] [org.apache.catalina.startup.HostConfig] Deploying web application directory /var/lib/nuxeo/server/webapps/ROOT
2015-05-30 00:04:27,226 INFO  [localhost-startStop-1] [org.apache.catalina.startup.HostConfig] Deployment of web application directory /var/lib/nuxeo/server/webapps/ROOT has finished in 1,046 ms
2015-05-30 00:04:27,226 INFO  [localhost-startStop-1] [org.apache.catalina.startup.HostConfig] Deploying web application directory /var/lib/nuxeo/server/webapps/host-manager
2015-05-30 00:04:28,038 INFO  [localhost-startStop-1] [org.apache.catalina.startup.HostConfig] Deployment of web application directory /var/lib/nuxeo/server/webapps/host-manager has finished in 812 ms
2015-05-30 00:04:28,038 INFO  [localhost-startStop-1] [org.apache.catalina.startup.HostConfig] Deploying web application directory /var/lib/nuxeo/server/webapps/manager
2015-05-30 00:04:29,118 INFO  [localhost-startStop-1] [org.apache.catalina.startup.HostConfig] Deployment of web application directory /var/lib/nuxeo/server/webapps/manager has finished in 1,080 ms
2015-05-30 00:04:29,120 INFO  [main] [org.apache.coyote.http11.Http11Protocol] Starting ProtocolHandler ["http-bio-0.0.0.0-8080"]
2015-05-30 00:04:29,132 INFO  [main] [org.apache.coyote.ajp.AjpProtocol] Starting ProtocolHandler ["ajp-bio-0.0.0.0-auto-1-47454"]
2015-05-30 00:04:29,133 INFO  [main] [org.apache.catalina.startup.Catalina] Server startup in 13650 ms

Re: Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance?

Johan_Andersso1 — Sun, 31 May 2015 11:46:31 GMT

I am going to give the answer myself.

I don't know what the real problem was but the solution for me was to restore the essential files from the backup server.

While the service was not running I replaced the following directories to the state they had before the hotfix:

/var/lib/nuxeo/server/conf
/var/lib/nuxeo/server/bin
/var/lib/nuxeo/server/packages
/var/lib/nuxeo/server/nxserver
/var/lib/nuxeo/server/templates
/var/lib/nuxeo/server/webapps

It might have been enough with just nxserver and packages but to be really sure I took all directoies that had files changed by the hotfix.

I Then started nuxeo with

$ sudo /etc/init.d/nuxeo start

Et voilà! It all worked again.

Re: Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance?

Julien_Carsique — Mon, 01 Jun 2015 12:03:03 GMT

./bin/nuxeoctl mp-uninstall nuxeo-6.0-HF11

Re: Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance?

Julien_Carsique — Wed, 03 Jun 2015 11:40:14 GMT

That issue will be fixed in the next hotfix 6.0-HF13.

Re: Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance?

Johan_Andersso1 — Wed, 03 Jun 2015 18:09:07 GMT

Well thanx! That looks a lot easier. I will do that next time.

Re: Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance?

Johan_Andersso1 — Tue, 01 Sep 2015 08:08:21 GMT

Exactly the same error occurs after installing HF13.

topic Re: Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance? in Nuxeo Forum

Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance?

server.log from start attempt

Re: Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance?

Re: Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance?

Re: Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance?

Re: Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance?

Re: Nuxeo 6.0 does not restart after last hotfix. How may I save our Nuxeo instance?