Bulk Filesystem Importer install problems - Still!! Help!!

[dirkblaze]

I've installed the bulk filesystem importer (http://code.google.com/p/alfresco-bulk-filesystem-import/)

Installed the amp.  Everything seemed fine, restarted Alfresco, fine, however, trying to browse the UI, there seems to be nothing there:

The Web Script /alfresco/service/bulk/import/filesystem has responded with a status of 404 - Not Found.

Looked at everything i could think of, everything seems fine.

Not sure what to do???

Please help??

terminal install session:


user$ java -jar /Applications/alfresco-3.4.d/bin/alfresco-mmt.jar install /Applications/alfresco-3.4.d/amps/alfresco-bulk-filesystem-import-1.0.amp  /Applications/alfresco-3.4.d/tomcat/webapps/alfresco.war  -verbose
Installing AMP '/Applications/alfresco-3.4.d/amps/alfresco-bulk-filesystem-import-1.0.amp' into WAR '/Applications/alfresco-3.4.d/tomcat/webapps/alfresco.war'
WAR has been backed up to '/Applications/alfresco-3.4.d/tomcat/webapps/alfresco.war-1317089840594.bak'
Adding files relating to version '1.0.0' of module 'org.alfresco.extension.alfresco-bulk-filesystem-import'
   - File '/WEB-INF/lib/alfresco-bulk-filesystem-import-1.0.jar' added to war from amp
   - File '/WEB-INF/classes/alfresco/extension/templates/webscripts/org/alfresco/extension/bulkfilesystemimport/ajaxspace.get.desc.xml' added to war from amp
   - File '/WEB-INF/classes/alfresco/extension/templates/webscripts/org/alfresco/extension/bulkfilesystemimport/status.get.xml.ftl' added to war from amp
   - File '/WEB-INF/classes/alfresco/extension/templates/webscripts/org/alfresco/extension/bulkfilesystemimport/ajaxspace.get.json.ftl' added to war from amp
   - File '/WEB-INF/classes/alfresco/extension/templates/webscripts/org/alfresco/extension/bulkfilesystemimport/ui.get.html.ftl' added to war from amp
   - File '/WEB-INF/classes/alfresco/extension/templates/webscripts/org/alfresco/extension/bulkfilesystemimport/initiate.get.desc.xml' added to war from amp
   - File '/WEB-INF/classes/alfresco/extension/templates/webscripts/org/alfresco/extension/bulkfilesystemimport/status.get.html.ftl' added to war from amp
   - File '/WEB-INF/classes/alfresco/extension/templates/webscripts/org/alfresco/extension/bulkfilesystemimport/ajaxspace.get.text.ftl' added to war from amp
   - File '/WEB-INF/classes/alfresco/extension/templates/webscripts/org/alfresco/extension/bulkfilesystemimport/status.get.desc.xml' added to war from amp
   - File '/WEB-INF/classes/alfresco/extension/templates/webscripts/org/alfresco/extension/bulkfilesystemimport/ui.get.desc.xml' added to war from amp
   - Directory '/WEB-INF/classes/alfresco/extension/templates/webscripts/org/alfresco/extension/bulkfilesystemimport' added to war
   - Directory '/WEB-INF/classes/alfresco/extension/templates/webscripts/org/alfresco/extension' added to war
   - Directory '/WEB-INF/classes/alfresco/extension/templates/webscripts/org/alfresco' added to war
   - Directory '/WEB-INF/classes/alfresco/extension/templates/webscripts/org' added to war
   - Directory '/WEB-INF/classes/alfresco/extension/templates/webscripts' added to war
   - Directory '/WEB-INF/classes/alfresco/extension/templates' added to war
   - File '/WEB-INF/classes/alfresco/module/org.alfresco.extension.alfresco-bulk-filesystem-import/alfresco-global.properties' added to war from amp
   - File '/WEB-INF/classes/alfresco/module/org.alfresco.extension.alfresco-bulk-filesystem-import/context/web-script-context.xml' added to war from amp
   - File '/WEB-INF/classes/alfresco/module/org.alfresco.extension.alfresco-bulk-filesystem-import/context/private-context.xml' added to war from amp
   - File '/WEB-INF/classes/alfresco/module/org.alfresco.extension.alfresco-bulk-filesystem-import/context/public-context.xml' added to war from amp
   - Directory '/WEB-INF/classes/alfresco/module/org.alfresco.extension.alfresco-bulk-filesystem-import/context' added to war
   - File '/WEB-INF/classes/alfresco/module/org.alfresco.extension.alfresco-bulk-filesystem-import/module-context.xml' added to war from amp
   - Directory '/WEB-INF/classes/alfresco/module/org.alfresco.extension.alfresco-bulk-filesystem-import' added to war

user$ sh /Applications/alfresco-3.4.d/alfresco.sh start110926 22:18:00 mysqld_safe Logging to '/Applications/alfresco-3.4.d/mysql/data/mysqld.log'.
110926 22:18:01 mysqld_safe Starting mysqld.bin daemon with databases from /Applications/alfresco-3.4.d/mysql/data
/Applications/alfresco-3.4.d/mysql/scripts/ctl.sh : mysql  started at port 3306
Using CATALINA_BASE:   /Applications/alfresco-3.4.d/tomcat
Using CATALINA_HOME:   /Applications/alfresco-3.4.d/tomcat
Using CATALINA_TMPDIR: /Applications/alfresco-3.4.d/tomcat/temp
Using JRE_HOME:        /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
Using CLASSPATH:       /Applications/alfresco-3.4.d/tomcat/bin/bootstrap.jar
/Applications/alfresco-3.4.d/tomcat/scripts/ctl.sh : tomcat started

[mrogers]

Is there anything in your alfresco.log.

Particulally to do with the supported versions.   The bulk filesystem import tool needed upgrading failry recently to support the latest versions of alfresco,  has that happened?

[dirkblaze]

Ye, when trying to access the UI I get:

14:46:07,595 ERROR [org.springframework.extensions.webscripts.AbstractRuntime] Exception from executeScript - redirecting to status template error: 08270013 Script url /bulk/import/filesystem does not map to a Web Script.
org.springframework.extensions.webscripts.WebScriptException: 08270013 Script url /bulk/import/filesystem does not map to a Web Script.
   at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:153)
   at org.springframework.extensions.webscripts.servlet.WebScriptServlet.service(WebScriptServlet.java:118)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
   at org.alfresco.web.app.servlet.GlobalLocalizationFilter.doFilter(GlobalLocalizationFilter.java:58)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
   at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
   at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
   at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
   at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
   at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
   at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
   at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:852)
   at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
   at java.lang.Thread.run(Thread.java:680)

in the log.
Am running latest version of Community.
java version "1.6.0_22"

[dirkblaze]

only other error in log is:

15:14:01,692 ERROR [org.alfresco.fileserver] Failed to get local domain/workgroup name, using default of WORKGROUP
15:14:01,692 ERROR [org.alfresco.fileserver] (This may be due to firewall settings or incorrect <broadcast> setting)
15:14:01,823 ERROR [org.alfresco.fileserver] [SMB] Server error : org.alfresco.jlan.server.config.InvalidConfigurationException: Error initializing TCP-IP SMB session handler, Permission denied
15:14:01,875 ERROR [org.alfresco.fileserver] org.alfresco.jlan.server.config.InvalidConfigurationException: Error initializing TCP-IP SMB session handler, Permission denied
org.alfresco.jlan.server.config.InvalidConfigurationException: Error initializing TCP-IP SMB session handler, Permission denied
   at org.alfresco.jlan.smb.server.nio.NIOCifsConnectionsHandler.initializeHandler(NIOCifsConnectionsHandler.java:259)
   at org.alfresco.jlan.smb.server.SMBServer.run(SMBServer.java:472)
   at java.lang.Thread.run(Thread.java:680)

[piski]

Hi all,

I've the same issue on Alfresco 3.4.e with this tool.

If I browse the url http://MyServer/Alfresco/service/bulk/import/filesystem/, I get this error :

ERROR [extensions.webscripts.AbstractRuntime] Exception from executeScript - redirecting to status template error: 09200018 Script url /bulk/import/filesystem does not map to a Web Script.
org.springframework.extensions.webscripts.WebScriptException: 09200018 Script url /bulk/import/filesystem does not map to a Web Script.
   at org.springframework.extensions.webscripts.AbstractRuntime.executeScript(AbstractRuntime.java:153)
   at org.springframework.extensions.webscripts.servlet.WebScriptServlet.service(WebScriptServlet.java:118)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
   at org.alfresco.web.app.servlet.GlobalLocalizationFilter.doFilter(GlobalLocalizationFilter.java:58)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
   at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
   at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
   at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
   at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
   at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
   at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
   at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
   at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
   at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:396)
   at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Anyone knows what's the problem ?

Thanks !

[sakkaje]

Hi,

It took me some time to get the bulk install working. But now it works OK. First, it seems you have CIFS enabled in the logging. If you run Alfresco on Linux turn of CIFS: add this

cifs.enabled=false‍

to alfresco-global.properties.

For me running these commands worked:
export BULK=alfresco-bulk-filesystem-import-1.0.amp
java -jar $ALFRESCO_HOME/bin/alfresco-mmt.jar install $ALFRESCO_HOME/amps/$BULK $ALFRESCO_HOME/tomcat/webapps/alfresco.war -force -verbose
and
apply_amps.sh

Last thing. BULK is a bit euphemistic. You might need to run the import in smaller chunks to avoid Tomcat to crash or to get really slow. The import seemed to handle the chunks very well and it also created a thumbnail of PDF imports.

[piski]

The issue was on install (CIFS can be enabled, I'm on W2003 R2) :

I've installed the amp, it was well deployed into alfresco.war … but not rebuild within /webapps/alfresco !
So, I have shutdown Tomcat, drop the folder alfresco within webapps, restart Tomcat.
Alfresco.war has been redeployed successfully with the new files and the webscript works fine now.

A good way to check the install is to verify if you have the folder "templates" under Alfresco\tomcat\webapps\alfresco\WEB-INF\classes\alfresco\extension … if not, drop webapps/alfresco and restart Tomcat to redeploy alfresco.war

About the usage, do you know the "limit" of using this tool (number max of documents to import and/or max size of these) ?

Thanks for your help !

[sakkaje]

Well that will probably depend. The good thing is, the importer keeps updating you about it's progress. At some point you will see it is stalling while it is using a lot of resources. What i did is just kill tomcat and start again with a smaller batch. I think you can do this without much harm because it can handle duplicates. But i can image killing it during import does not give you a nice feeling. You could run the import for test the first time and when you have the perfect batch sizes and then do it again in the real system. Oh and you might want to give it some more space to work in (just a guess, what the numbers would be):

JAVA_OPTS=\"-Xms128m -Xmx7000m -Xss96k -XX:MaxPermSize=400m -Dalfresco.home=$CATALINA_HOME -Dcom.sun.management.jmxremote\"
‍‍‍

-Xmx should be a little smaller then the total RAM on your system i think. The JAVA_OPTS is an environment variable, you will need to restart tomcat after changing it.

[divyeshhdoshi]

Thanks it works !!!!!

[brianh]

A good way to check the install is to verify if you have the folder "templates" under Alfresco\tomcat\webapps\alfresco\WEB-INF\classes\alfresco\extension … if not, drop webapps/alfresco and restart Tomcat to redeploy alfresco.war

About the usage, do you know the "limit" of using this tool (number max of documents to import and/or max size of these) ?

Thanks for your help !

Yep, this was the key bit, thx.

Basically the instruction bullet points omits to say that follow backup of the alfresco.war one needs to purge the exiting 'alfresco/' folder in tomcat/webapps.  Otherwise the new .WAR resulting from the mmt stage does actually get deployed on restart.  Some people like to back the alfresco/ folder too, but it shouldn't strictly be necessary.