topic Re: Max Nodes in a store? in Alfresco Archive

Max Nodes in a store?

docderivative — Tue, 04 Mar 2014 11:50:06 GMT

I have returned to a project that I initiated many years ago and found the implementation is not necessarily what I expected! In particular custom code has been written to distribute the content and its associated meta data across numerous stores. This additional code has significantly increased t

Re: Max Nodes in a store?

mrogers — Tue, 04 Mar 2014 13:19:40 GMT

Is there a particular JIRA reference to this "running out of memory" bug? Certainly its not unheard of for a million docs being used as a fairly modest test set these days.

If you are an alfresco customer it may be worth talking to alfresco support who will have advice and experience with working with larger volumes of data. But in general it makes sense to partition your data along business lines if that's possible.

Re: Max Nodes in a store?

lw7415 — Thu, 06 Mar 2014 18:53:00 GMT

In our experience we found that the amount of memory needed for SOLR is what really needs to be paid attention to when looking at installations with a large amount of nodes. We implemented a records management system with somewhere around 300,000 nodes and had to add lots of RAM to optimize the Alfresco system. We implemented this under version 3.4 but are now at 4.1.

The official Alfresco product documentation has a calculator to assist in estimating the amount of memory needed for SOLR.

We are looking to separate SOLR from the repository (i.e. run them on separate CPUs) in the future as we keep adding more nodes to our repository.

Hope this helps,

Lw

Re: Max Nodes in a store?

docderivative — Fri, 07 Mar 2014 12:49:01 GMT

Interesting. We have approx 15 stores with 1M nodes in each. Searching across stores is a pain since results need to be aggregated but maybe the 1M limit wasn't that bad an idea anyway. Might have to have a think about the partitioning.

Re: Max Nodes in a store?

docderivative — Fri, 07 Mar 2014 12:51:08 GMT

If 1M is a test set-up…. how large are the stores actually successfully being used by customers?

Partitioning is tricky; we already do some along business lines (and chronological order)

Re: Max Nodes in a store?

mrogers — Fri, 07 Mar 2014 18:45:07 GMT

Perhaps other forum users could chime in with their figures…