cancel
Showing results for 
Search instead for 
Did you mean: 

Alfresco generating thousands of exceptions a minute, can't find the cause

lmitchell
Champ in-the-making
Champ in-the-making
Hi All

I'm new to Alfresco and I've got an issue that's quite vexing.

I've installed 4.2c Community Edition on Ubuntu 12.04 using Postgres and Tomcat bundled with the install binary and everything seemed to be working until I hit on three snags that I can only assume are related:
- Whenever I login to server:8080/share using the admin account I get a popup box with "Internal server error" and an OK button (click OK and it goes away until the next sign in)
- Whenever any user tries to create a site from within the Share interface it returns the following error in a popup titled "Could not create site"
00305598 Wrapped Exception (with status template): 00300128 Failed to execute script 'classpath*:alfresco/templates/webscripts/org/alfresco/repository/site/sites.post.json.js': nodeRef is a mandatory parameter

- On checking the log files I've noticed that Alfresco is generating literally thousands of exceptions a minute, all something along the lines of:

08:35:45,129 ERROR [org.springframework.extensions.webscripts.AbstractRuntime] Exception from executeScript - redirecting to status template error: 00293586 Unknown method specified to remote store API: has
org.springframework.extensions.webscripts.WebScriptException: 00293586 Unknown method specified to remote store API: has
   at org.alfresco.repo.web.scripts.bean.BaseRemoteStore.execute(BaseRemoteStore.java:326)
   at org.alfresco.repo.web.scripts.RepositoryContainer$3.execute(RepositoryContainer.java:422)
   at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:452)
   at org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecute(RepositoryContainer.java:491)
   at org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecuteAs(RepositoryContainer.java:529)
   at org.alfresco.repo.web.scripts.RepositoryContainer.executeScript(RepositoryContainer.java:268)
   at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:378)
   at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:209)
   at org.springframework.extensions.webscripts.servlet.WebScriptServlet.service(WebScriptServlet.java:132)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
   at org.alfresco.web.app.servlet.GlobalLocalizationFilter.doFilter(GlobalLocalizationFilter.java:61)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
   at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
   at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
   at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:502)
   at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
   at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
   at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
   at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
   at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
   at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1023)
   at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
   at org.apache.tomcat.util.net.AprEndpoint$SocketWithOptionsProcessor.run(AprEndpoint.java:1810)
   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:724)


The log file for any given 24 hour period is a good 100mb, so in just over a week it can generate an easy 1gb of logs - which is obviously not good and also makes it too big to upload, but the exceptions appear to just be the same thing repeating over and over anyway

Other than these issues everything seems to be functioning; users can upload, download and edit files and folders in the repository with no problems at all

I've tried rebuilding the SOLR indexes to no avail, I've checked the permissions on the alf_data folder and everything seems to be OK there as well. The other peculiar thing is that I did a fresh and identical install on a spare machine, did a cold backup and imported the PSQL database dump and alf_data files from the problem build into the fresh build (which was working fine to begin with) and the issue carried over as well.

To further compound the problem I didn't actually notice the issue until we'd already been using the build for a couple of weeks so there's now a few thousand documents stored in the problem build so starting again really isn't an option and doing a cold backup and restore into a new build just seems to take the problem along

Any help anybody can offer would be really, really appreciated
3 REPLIES 3

mitpatoliya
Star Collaborator
Star Collaborator
Any License related errors in log?
Any integration with LDAP or such system?
Other prominent error which gets repeated?

lmitchell
Champ in-the-making
Champ in-the-making
I've also got the following error which shows up periodically in the logs



Caused by: java.lang.IllegalArgumentException: nodeRef is a mandatory parameter
   at org.alfresco.util.ParameterCheck.mandatory(ParameterCheck.java:42)
   at org.alfresco.repo.node.db.DbNodeServiceImpl.getChildByName(DbNodeServiceImpl.java:1920)
   at sun.reflect.GeneratedMethodAccessor346.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   at java.lang.reflect.Method.invoke(Method.java:606)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
   at org.alfresco.repo.tenant.MultiTNodeServiceInterceptor.invoke(MultiTNodeServiceInterceptor.java:104)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
   at com.sun.proxy.$Proxy11.getChildByName(Unknown Source)
   at sun.reflect.GeneratedMethodAccessor346.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   at java.lang.reflect.Method.invoke(Method.java:606)
   at org.alfresco.repo.service.StoreRedirectorProxyFactory$RedirectorInvocationHandler.invoke(StoreRedirectorProxyFactory.java:215)
   at com.sun.proxy.$Proxy30.getChildByName(Unknown Source)
   at sun.reflect.GeneratedMethodAccessor346.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   at java.lang.reflect.Method.invoke(Method.java:606)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
   at org.alfresco.repo.tagging.TagScopePropertyMethodInterceptor.invoke(TagScopePropertyMethodInterceptor.java:152)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.alfresco.repo.node.MLPropertyInterceptor.invoke(MLPropertyInterceptor.java:306)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.alfresco.repo.lock.mem.LockableAspectInterceptor.invoke(LockableAspectInterceptor.java:200)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.alfresco.repo.node.NodeRefPropertyMethodInterceptor.invoke(NodeRefPropertyMethodInterceptor.java:269)
   at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
   at com.sun.proxy.$Proxy11.getChildByName(Unknown Source)
   at sun.reflect.GeneratedMethodAccessor346.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   at java.lang.reflect.Method.invoke(Method.java:606)
   at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309)
   at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:196)
   at com.sun.proxy.$Proxy11.getChildByName(Unknown Source)
   at org.alfresco.repo.web.scripts.bean.ADMRemoteStore.getSurfConfigNodeRef(ADMRemoteStore.java:944)
   at org.alfresco.repo.web.scripts.bean.ADMRemoteStore.aquireSurfConfigRef(ADMRemoteStore.java:912)
   at org.alfresco.repo.web.scripts.bean.ADMRemoteStore.resolveNodePath(ADMRemoteStore.java:806)
   at org.alfresco.repo.web.scripts.bean.ADMRemoteStore.resolveNodePath(ADMRemoteStore.java:767)
   at org.alfresco.repo.web.scripts.bean.ADMRemoteStore.access$300(ADMRemoteStore.java:98)
   at org.alfresco.repo.web.scripts.bean.ADMRemoteStore$4.doWork(ADMRemoteStore.java:458)
   at org.alfresco.repo.web.scripts.bean.ADMRemoteStore$4.doWork(ADMRemoteStore.java:454)
   at org.alfresco.repo.security.authentication.AuthenticationUtil.runAs(AuthenticationUtil.java:548)
   at org.alfresco.repo.web.scripts.bean.ADMRemoteStore.writeDocument(ADMRemoteStore.java:453)
   at org.alfresco.repo.web.scripts.bean.ADMRemoteStore.createDocuments(ADMRemoteStore.java:422)
   … 29 more

Other than that nothing seems to be different, it's that same exception getting thrown several times a second.

No integration with any other systems, it's a stock standard install using the community binary

No errors in the logs related to licenses at all

scouil
Star Contributor
Star Contributor
Hi,

Can you please stop your server, remove the log file, restart and just send us the log about 1 minute after the restart.
This way we can have the whole log and the first few noderef errors without the log being too big.