topic Contentstore caching, number of open files problem in Alfresco Archive https://connect.hyland.com/t5/alfresco-archive/contentstore-caching-number-of-open-files-problem/m-p/257104#M210234 <HTML><HEAD></HEAD><BODY><SPAN>Hello, this is my first post in this forum. </SPAN><BR /><BR /><SPAN>I have a relatively large alfresco repository of 300 gb and I want to export some of the files within it to local filesystem. I have written a code using jcr api, like this: </SPAN><BR /><BR /><PRE class="language-none line-numbers"><CODE><BR />&nbsp;&nbsp;&nbsp;private void recursiveExport (Node root, String exportDir) throws RepositoryException, IOException {<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;if(root==null) {<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;return;<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;String currentDir = String.format("%s%s%s", exportDir, File.separator, root.getName().substring(root.getName().lastIndexOf(":")+1));<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;//folder<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;if(root.getPrimaryNodeType().getName().equals("cm:folder")){<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;new File(currentDir).mkdirs();<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;for(NodeIterator iterator = root.getNodes(); iterator.hasNext(); ){<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Node child = iterator.nextNode();<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;recursiveExport(child, currentDir+File.separator);<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;child = null;<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;//file<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;else{<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;FileOutputStream fos = new FileOutputStream(currentDir);<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Property prop = root.getProperty("cm:content");<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;if(prop==null){<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;return;<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;IOUtils.copy(prop.getStream(), fos);<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;fos.close();<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;prop.getStream().close();<BR /><BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;prop = null;<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;root = null;<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;fos = null;<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}<BR />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;logger.info(String.format("%s exported.", currentDir));<BR />&nbsp;&nbsp;&nbsp;}<BR /><SPAN class="line-numbers-rows"><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN><SPAN>‍</SPAN></SPAN></CODE></PRE><BR /><SPAN>I call this method with the root folder that I want to export. The code runs smoothly, however my problem is the number of open files while using this. Somehow alfresco </SPAN><STRONG>does not close</STRONG><SPAN> the file handles, leading to excess resource usage, as it can be checked with this command: </SPAN><BR /><PRE class="language-none line-numbers"><CODE>ls -1 /proc/`pidof java`/fd | wc -l <SPAN class="line-numbers-rows"><SPAN>‍</SPAN></SPAN></CODE></PRE><SPAN>The number of open files grows to high numbers (80000 in half an hour, my ulimit -n is 819200). I want this to exactly work like I have written the above code, opening the file, exporting it, and closing the streams, simple. I have checked which files are open, and they are *.bin files inside contentstore, so I suspect there is some configuration issues about it. </SPAN><BR /><BR /><SPAN>Can anybody lead me out of this situation? Thanks in advance</SPAN></BODY></HTML> Tue, 31 Jan 2012 16:44:08 GMT sebgymn 2012-01-31T16:44:08Z Contentstore caching, number of open files problem https://connect.hyland.com/t5/alfresco-archive/contentstore-caching-number-of-open-files-problem/m-p/257104#M210234 Hello, this is my first post in this forum. I have a relatively large alfresco repository of 300 gb and I want to export some of the files within it to local filesystem. I have written a code using jcr api, like this: &nbsp;&nbsp;&nbsp;private void recursiveExport (Node root, String exportDir) throws RepositoryExc Tue, 31 Jan 2012 16:44:08 GMT https://connect.hyland.com/t5/alfresco-archive/contentstore-caching-number-of-open-files-problem/m-p/257104#M210234 sebgymn 2012-01-31T16:44:08Z Re: Contentstore caching, number of open files problem https://connect.hyland.com/t5/alfresco-archive/contentstore-caching-number-of-open-files-problem/m-p/257105#M210235 <HTML><HEAD></HEAD><BODY><SPAN>I think you need to use finally block.</SPAN><BR /><SPAN>and should close all the files and streams in that block.</SPAN><BR /><SPAN>this might help.</SPAN><BR /><SPAN>Also check and try to remove if any unnecessary IO operation you are doing.</SPAN></BODY></HTML> Wed, 08 Feb 2012 10:43:46 GMT https://connect.hyland.com/t5/alfresco-archive/contentstore-caching-number-of-open-files-problem/m-p/257105#M210235 mitpatoliya 2012-02-08T10:43:46Z Re: Contentstore caching, number of open files problem https://connect.hyland.com/t5/alfresco-archive/contentstore-caching-number-of-open-files-problem/m-p/257106#M210236 <HTML><HEAD></HEAD><BODY><SPAN>Thanks for your reply, but that approach does not work. I have converted my code to use Foundation API, and problem gone. I guess this is a bug in JCR side.</SPAN></BODY></HTML> Mon, 13 Feb 2012 14:43:04 GMT https://connect.hyland.com/t5/alfresco-archive/contentstore-caching-number-of-open-files-problem/m-p/257106#M210236 sebgymn 2012-02-13T14:43:04Z