topic Re: Lucene re-index big problem in Alfresco Archive

Lucene re-index big problem

javixulo — Tue, 16 Oct 2012 12:29:19 GMT

Hello,I'm facing a big problem when trying to re-index a large amount of documents in Alfresco 4.0.In my Alfresco I've got around 4 million documents, and it always fail with out of memory exception. These are my java_opts:set JAVA_OPTS=%JAVA_OPTS% -Xms1024m -Xmx3072m -XX:MaxPermSize=512m -Dfile.enc

Re: Lucene re-index big problem

abarisone — Tue, 16 Oct 2012 12:59:55 GMT

Hi,
first of all here you can find the reference http://www.oracle.com/technetwork/java/javase/tech/vmoptions-jsp-140102.html

Xms == Xmx will let the JVM free to recalculate the memory in order to save resources.

If the out of memory exception seems due to PermGen space then increase it as much as you can.
If it comes from something like OutOfMemoryError: unable to create new native thread (too many threads, each thread has a large stack), decrease the -Xss parameter (I set 256k).

Regards,
Andrea

Re: Lucene re-index big problem

loftux — Tue, 16 Oct 2012 13:56:26 GMT

You can also have a look at the configuration options here
http://wiki.alfresco.com/wiki/Full-Text_Search_Configuration

Re: Lucene re-index big problem

javixulo — Wed, 17 Oct 2012 06:45:13 GMT

Hi,

First of all, thank u all

I got outofmemory, but heap memory, not permgen.

I dive into all this parameteres but I'm not very good selecting them, and it's a mess because everytime I try a new configuration I must wait about 2h to get the results… Can u give me an example of a good configuration in order to solve this problem?

And again, thank u all