topic Re: Bulk Filesystem Importer install problems - Still!! Help!! in Alfresco Archive

Bulk Filesystem Importer install problems - Still!! Help!!

dirkblaze — Tue, 27 Sep 2011 11:19:10 GMT

I've installed the bulk filesystem importer (http://code.google.com/p/alfresco-bulk-filesystem-import/)Installed the amp. Everything seemed fine, restarted Alfresco, fine, however, trying to browse the UI, there seems to be nothing there:The Web Script /alfresco/service/bulk/import/filesystem has r

Re: Bulk Filesystem Importer install problems - Still!! Help!!

mrogers — Tue, 27 Sep 2011 12:16:11 GMT

Is there anything in your alfresco.log.

Particulally to do with the supported versions. The bulk filesystem import tool needed upgrading failry recently to support the latest versions of alfresco, has that happened?

Re: Bulk Filesystem Importer install problems - Still!! Help!!

dirkblaze — Tue, 27 Sep 2011 18:51:17 GMT

Ye, when trying to access the UI I get:

14:46:07,595 ERROR [org.springframework.extensions.webscripts.AbstractRuntime] Exception from executeScript - redirecting to status template error: 08270013 Script url /bulk/import/filesystem does not map to a Web Script.
org.springframework.extensions.webscripts.WebScriptException: 08270013 Script url /bulk/import/filesystem does not map to a Web Script.
   at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:153)
   at org.springframework.extensions.webscripts.servlet.WebScriptServlet.service(WebScriptServlet.java:118)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
   at org.alfresco.web.app.servlet.GlobalLocalizationFilter.doFilter(GlobalLocalizationFilter.java:58)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
   at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
   at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
   at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
   at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
   at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
   at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
   at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:852)
   at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
   at java.lang.Thread.run(Thread.java:680)

in the log.
Am running latest version of Community.
java version "1.6.0_22"

Re: Bulk Filesystem Importer install problems - Still!! Help!!

dirkblaze — Tue, 27 Sep 2011 19:41:03 GMT

only other error in log is:

15:14:01,692 ERROR [org.alfresco.fileserver] Failed to get local domain/workgroup name, using default of WORKGROUP
15:14:01,692 ERROR [org.alfresco.fileserver] (This may be due to firewall settings or incorrect <broadcast> setting)
15:14:01,823 ERROR [org.alfresco.fileserver] [SMB] Server error : org.alfresco.jlan.server.config.InvalidConfigurationException: Error initializing TCP-IP SMB session handler, Permission denied
15:14:01,875 ERROR [org.alfresco.fileserver] org.alfresco.jlan.server.config.InvalidConfigurationException: Error initializing TCP-IP SMB session handler, Permission denied
org.alfresco.jlan.server.config.InvalidConfigurationException: Error initializing TCP-IP SMB session handler, Permission denied
   at org.alfresco.jlan.smb.server.nio.NIOCifsConnectionsHandler.initializeHandler(NIOCifsConnectionsHandler.java:259)
   at org.alfresco.jlan.smb.server.SMBServer.run(SMBServer.java:472)
   at java.lang.Thread.run(Thread.java:680)

Re: Bulk Filesystem Importer install problems - Still!! Help!!

piski — Thu, 20 Oct 2011 08:04:41 GMT

Hi all,

I've the same issue on Alfresco 3.4.e with this tool.

If I browse the url http://MyServer/Alfresco/service/bulk/import/filesystem/, I get this error :

ERROR [extensions.webscripts.AbstractRuntime] Exception from executeScript - redirecting to status template error: 09200018 Script url /bulk/import/filesystem does not map to a Web Script.
org.springframework.extensions.webscripts.WebScriptException: 09200018 Script url /bulk/import/filesystem does not map to a Web Script.
   at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:153)
   at org.springframework.extensions.webscripts.servlet.WebScriptServlet.service(WebScriptServlet.java:118)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
   at org.alfresco.web.app.servlet.GlobalLocalizationFilter.doFilter(GlobalLocalizationFilter.java:58)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
   at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
   at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
   at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
   at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
   at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
   at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
   at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
   at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
   at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:396)
   at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Anyone knows what's the problem ?

Thanks !

Re: Bulk Filesystem Importer install problems - Still!! Help!!

sakkaje — Thu, 20 Oct 2011 10:52:41 GMT

Hi,

It took me some time to get the bulk install working. But now it works OK. First, it seems you have CIFS enabled in the logging. If you run Alfresco on Linux turn of CIFS: add this

cifs.enabled=false‍

to alfresco-global.properties.

For me running these commands worked:
export BULK=alfresco-bulk-filesystem-import-1.0.amp
java -jar $ALFRESCO_HOME/bin/alfresco-mmt.jar install $ALFRESCO_HOME/amps/$BULK $ALFRESCO_HOME/tomcat/webapps/alfresco.war -force -verbose
and
apply_amps.sh

Last thing. BULK is a bit euphemistic. You might need to run the import in smaller chunks to avoid Tomcat to crash or to get really slow. The import seemed to handle the chunks very well and it also created a thumbnail of PDF imports.

Re: Bulk Filesystem Importer install problems - Still!! Help!!

piski — Thu, 20 Oct 2011 13:30:39 GMT

The issue was on install (CIFS can be enabled, I'm on W2003 R2) :

I've installed the amp, it was well deployed into alfresco.war … but not rebuild within /webapps/alfresco !
So, I have shutdown Tomcat, drop the folder alfresco within webapps, restart Tomcat.
Alfresco.war has been redeployed successfully with the new files and the webscript works fine now.

A good way to check the install is to verify if you have the folder "templates" under Alfresco\tomcat\webapps\alfresco\WEB-INF\classes\alfresco\extension … if not, drop webapps/alfresco and restart Tomcat to redeploy alfresco.war

About the usage, do you know the "limit" of using this tool (number max of documents to import and/or max size of these) ?

Thanks for your help !

Re: Bulk Filesystem Importer install problems - Still!! Help!!

sakkaje — Thu, 20 Oct 2011 15:15:20 GMT

Well that will probably depend. The good thing is, the importer keeps updating you about it's progress. At some point you will see it is stalling while it is using a lot of resources. What i did is just kill tomcat and start again with a smaller batch. I think you can do this without much harm because it can handle duplicates. But i can image killing it during import does not give you a nice feeling. You could run the import for test the first time and when you have the perfect batch sizes and then do it again in the real system. Oh and you might want to give it some more space to work in (just a guess, what the numbers would be):


JAVA_OPTS=\"-Xms128m -Xmx7000m -Xss96k -XX:MaxPermSize=400m -Dalfresco.home=$CATALINA_HOME -Dcom.sun.management.jmxremote\"
‍‍‍

-Xmx should be a little smaller then the total RAM on your system i think. The JAVA_OPTS is an environment variable, you will need to restart tomcat after changing it.

Re: Bulk Filesystem Importer install problems - Still!! Help!!

divyeshhdoshi — Wed, 12 Sep 2012 10:17:47 GMT

Thanks it works !!!!!

Re: Bulk Filesystem Importer install problems - Still!! Help!!

brianh — Thu, 08 Nov 2012 12:29:55 GMT

A good way to check the install is to verify if you have the folder "templates" under Alfresco\tomcat\webapps\alfresco\WEB-INF\classes\alfresco\extension … if not, drop webapps/alfresco and restart Tomcat to redeploy alfresco.war

About the usage, do you know the "limit" of using this tool (number max of documents to import and/or max size of these) ?

Thanks for your help !

Yep, this was the key bit, thx.

Basically the instruction bullet points omits to say that follow backup of the alfresco.war one needs to purge the exiting 'alfresco/' folder in tomcat/webapps. Otherwise the new .WAR resulting from the mmt stage does actually get deployed on restart. Some people like to back the alfresco/ folder too, but it shouldn't strictly be necessary.