Outage caused by error on Alfresco

[robertscally]

Hi All,



I waited for alfresco site to load.


Eventually a failed to login message appears -

"The remote server may be unavailable or your authentication details have not been recognized"


This caused the site to be unavailable to anyone temporarily and it occurred only once. It worked again
after restarting the Alfresco application.


The following errors occurred during the issue:

15:54:58,973 ERROR [org.springframework.extensions.webscripts.AbstractRuntime] Exception from executeScript - redirecting to status template error: 01290109 Wrapped Exception (with status template): 01292094 Failed to execute script 'classpath*:alfresco/templates/webscripts/org/alfresco/repository/preference/preferences.get.js': 01292093 Failed to open stream onto channel: 
   accessor: ContentAccessor[ contentUrl=store://2016/2/17/17/40/38603f44-412e-4dd5-a75e-5f8e0423cd2d.bin, mimetype=text/plain, size=477, encoding=UTF-8, locale=en_IE]
org.springframework.extensions.webscripts.WebScriptException: 01290109 Wrapped Exception (with status template): 01292094 Failed to execute script 'classpath*:alfresco/templates/webscripts/org/alfresco/repository/preference/preferences.get.js': 01292093 Failed to open stream onto channel: 
   accessor: ContentAccessor[ contentUrl=store://2016/2/17/17/40/38603f44-412e-4dd5-a75e-5f8e0423cd2d.bin, mimetype=text/plain, size=477, encoding=UTF-8, locale=en_IE]
        at org.springframework.extensions.webscripts.AbstractWebScript.createStatusException(AbstractWebScript.java:970)
        at org.springframework.extensions.webscripts.DeclarativeWebScript.execute(DeclarativeWebScript.java:171)
        at org.alfresco.repo.web.scripts.RepositoryContainer$2.execute(RepositoryContainer.java:393)
        at org.alfresco.repo.transaction.RetryingTransactionHelper.doInTransaction(RetryingTransactionHelper.java:388)
        at org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecute(RepositoryContainer.java:462)
        at org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecuteAs(RepositoryContainer.java:500)
        at org.alfresco.repo.web.scripts.RepositoryContainer.executeScript(RepositoryContainer.java:316)
        at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:372)
        at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:209)
        at org.springframework.extensions.webscripts.servlet.WebScriptServlet.service(WebScriptServlet.java:118)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
        at org.alfresco.web.app.servlet.GlobalLocalizationFilter.doFilter(GlobalLocalizationFilter.java:58)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)
        at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
        at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987)
        at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
        at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:701)
Caused by: org.alfresco.scripts.ScriptException: 01292094 Failed to execute script 'classpath*:alfresco/templates/webscripts/org/alfresco/repository/preference/preferenc
es.get.js': 01292093 Failed to open stream onto channel: 
   accessor: ContentAccessor[ contentUrl=store://2016/2/17/17/40/38603f44-412e-4dd5-a75e-5f8e0423cd2d.bin, mimetype=text/plain, size=477, encoding=UTF-8, locale=en_IE]
        at org.alfresco.repo.jscript.RhinoScriptProcessor.execute(RhinoScriptProcessor.java:195)
        at org.alfresco.repo.processor.ScriptServiceImpl.execute(ScriptServiceImpl.java:212)
        at org.alfresco.repo.processor.ScriptServiceImpl.executeScript(ScriptServiceImpl.java:174)
        at org.alfresco.repo.web.scripts.RepositoryScriptProcessor.executeScript(RepositoryScriptProcessor.java:102)
        at org.springframework.extensions.webscripts.AbstractWebScript.executeScript(AbstractWebScript.java:1193)
        at org.springframework.extensions.webscripts.DeclarativeWebScript.execute(DeclarativeWebScript.java:86)
        … 27 more
Caused by: org.alfresco.service.cmr.repository.ContentIOException: 01292093 Failed to open stream onto channel: 
   accessor: ContentAccessor[ contentUrl=store://2016/2/17/17/40/38603f44-412e-4dd5-a75e-5f8e0423cd2d.bin, mimetype=text/plain, size=477, encoding=UTF-8, locale=en_IE]
        at org.alfresco.repo.content.AbstractContentReader.getContentInputStream(AbstractContentReader.java:401)
        at org.alfresco.repo.content.AbstractContentReader.getContentString(AbstractContentReader.java:502)
        at org.alfresco.repo.preference.PreferenceServiceImpl.getPreferences(PreferenceServiceImpl.java:151)
        at org.alfresco.repo.preference.script.ScriptPreferenceService.getPreferences(ScriptPreferenceService.java:58)
        at sun.reflect.GeneratedMethodAccessor647.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:622)
        at org.mozilla.javascript.MemberBox.invoke(MemberBox.java:155)
        at org.mozilla.javascript.NativeJavaMethod.call(NativeJavaMethod.java:243)
        at org.mozilla.javascript.optimizer.OptRuntime.call2(OptRuntime.java:76)
        at org.mozilla.javascript.gen.c1._c1(file:/var/lib/tomcat7/webapps/alfresco/WEB-INF/classes/alfresco/templates/webscripts/org/alfresco/repository/preference/preferences.get.js:14)
        at org.mozilla.javascript.gen.c1.call(file:/var/lib/tomcat7/webapps/alfresco/WEB-INF/classes/alfresco/templates/webscripts/org/alfresco/repository/preference/preferences.get.js)
        at org.mozilla.javascript.optimizer.OptRuntime.callName0(OptRuntime.java:108)
        at org.mozilla.javascript.gen.c1._c0(file:/var/lib/tomcat7/webapps/alfresco/WEB-INF/classes/alfresco/templates/webscripts/org/alfresco/repository/preference/preferences.get.js:20)
        at org.mozilla.javascript.gen.c1.call(file:/var/lib/tomcat7/webapps/alfresco/WEB-INF/classes/alfresco/templates/webscripts/org/alfresco/repository/preference/preferences.get.js)
        at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:393)
        at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:2834)
        at org.mozilla.javascript.gen.c1.call(file:/var/lib/tomcat7/webapps/alfresco/WEB-INF/classes/alfresco/templates/webscripts/org/alfresco/repository/preference/preferences.get.js)
        at org.mozilla.javascript.gen.c1.exec(file:/var/lib/tomcat7/webapps/alfresco/WEB-INF/classes/alfresco/templates/webscripts/org/alfresco/repository/preference/preferences.get.js)
        at org.alfresco.repo.jscript.RhinoScriptProcessor.executeScriptImpl(RhinoScriptProcessor.java:483)
        at org.alfresco.repo.jscript.RhinoScriptProcessor.execute(RhinoScriptProcessor.java:191)
        … 32 more
Caused by: org.alfresco.service.cmr.repository.ContentIOException: 01292092 Failed to open file channel: ContentAccessor[ contentUrl=store://2016/2/17/17/40/38603f44-412e-4dd5-a75e-5f8e0423cd2d.bin, mimetype=text/plain, size=477, encoding=UTF-8, locale=en_IE]
        at org.alfresco.repo.content.filestore.FileContentReader.getDirectReadableChannel(FileContentReader.java:234)
        at org.alfresco.repo.content.AbstractContentReader.getReadableChannel(AbstractContentReader.java:271)
        at org.alfresco.repo.content.AbstractContentReader.getContentInputStream(AbstractContentReader.java:375)
        … 52 more
Caused by: java.io.FileNotFoundException: /opt/data/alfresco/data/contentstore/2016/2/17/17/40/38603f44-412e-4dd5-a75e-5f8e0423cd2d.bin (Too many open files)
        at java.io.RandomAccessFile.open(Native Method)
        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:236)
        at org.alfresco.repo.content.filestore.FileContentReader.getDirectReadableChannel(FileContentReader.java:215)
        … 54 more
15:54:58,979 ERROR [org.springframework.extensions.webscripts.AbstractRuntime] Internal error
java.lang.NullPointerException‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

16:25:23,094 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:25:53,096 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:26:23,096 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:26:53,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:27:23,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:27:53,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:28:23,094 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:28:53,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:29:23,096 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:29:53,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:30:23,094 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:30:53,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:31:23,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:31:53,096 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:32:23,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:32:53,094 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:33:23,094 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:33:53,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:34:23,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:34:53,096 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:35:23,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:35:53,096 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:36:23,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:36:53,094 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:37:23,094 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:37:53,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:38:23,094 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null
16:38:53,095 INFO [org.alfresco.repo.activities.feed.AbstractFeedGenerator] Lock released: {http://www.alfresco.org/model/system/1.0}ActivityFeedGenerator [^], lock token null‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

[steven_okennedy]

Hi,

Have a look at http://docs.alfresco.com/4.0/tasks/fot-linux-openfiles.html

You need to configure Linux systems to allow Alfresco to open more than the default number of files

Regards

Steven