topic Re: safely crawl all documents via webscript in Alfresco Archive

safely crawl all documents via webscript

jaeni — Wed, 20 Jan 2016 10:44:40 GMT

what i am trying to do is:find all nodes in the repo and get their file size. also get all versions of the node and calculate the overall filesize of the node and its versions. how can i safely crawl every document in the repository?searchservice is going to hit the result-limit easily, even if i in

Re: safely crawl all documents via webscript

mrogers — Wed, 20 Jan 2016 11:38:48 GMT

It's not the solr cache that is filling up, its the transaction cache.

The node service does give you all results, so apart from being slow that is O.K.

The problem is that your code is executing in a single transaction and at some point there will likely be a limit on the number of database rows that can be updated

What the alfresco code does itself in those situations is to use the batch processor to break up your huge transaction into smaller chunks.    That's probably what you want to do here.

Re: safely crawl all documents via webscript

jaeni — Wed, 20 Jan 2016 13:33:12 GMT

Is there an easy example that i could re-use? if found user-rename tool but i am even more riddled now