topic Re: Alfresco opening same Lucene file over and over and never closing it. in Alfresco Archive

Alfresco opening same Lucene file over and over and never closing it.

markd_paulson — Wed, 27 Jan 2016 20:28:23 GMT

I recently upgraded the company website from 3.3g to 4.2f. We were having an issue getting search results beyond 1000 and it looked like upgrading would solve it. The good news is that we can query beyond 1000 and can delete the archived files all at once. The bad news is that the number of open fil

Re: Alfresco opening same Lucene file over and over and never closing it.

markd_paulson — Fri, 29 Jan 2016 18:33:24 GMT

Since it was the same Lucene index file that was being reopened and never closed, I thought the indexes might be fouled up.
1) I shutdown Alfresco.
2) I changed alfresco-global.properties: index.recovery.mode=FULL
3) I deleted /opt/alfresco/alf_data/lucene-indexes directory.
4) I restarted Alfresco.
5) I changed alfresco-global.properties index.recovery.mode back to AUTO, since I don't want it to re-index on any subsequent restarts of Alfresco.

I don't have conclusive proof of what happened to foul up the index, but I have a theory. So, take it with a grain of salt:
I'm assuming that when I first started after the upgrade that, when the number of open files reached the system max per process (was set at 1024), something in the index got askew. So, even after I raised the linux system limit for open files, the index needed fixing.

Re: Alfresco opening same Lucene file over and over and never closing it.

markd_paulson — Fri, 29 Jan 2016 21:59:07 GMT

It ran fine for a while, but eventually it started grabbing the same file over and over again without closing it:
[root@www alfresco-4.2.f]# lsof -p 4117 | grep cfs | more
java    4117 root   52u   REG                8,1   27407689   7242146 /opt/alfresco-4.2.f/alf_data/lucene-indexes/workspace/SpacesStore/6a3eb45a-befa-44dc-8e85-3008e832236c/_0.cfs
java    4117 root 142u   REG                8,1   27407689   7242146 /opt/alfresco-4.2.f/alf_data/lucene-indexes/workspace/SpacesStore/6a3eb45a-befa-44dc-8e85-3008e832236c/_0.cfs
java    4117 root 143u   REG                8,1   27407689   7242146 /opt/alfresco-4.2.f/alf_data/lucene-indexes/workspace/SpacesStore/6a3eb45a-befa-44dc-8e85-3008e832236c/_0.cfs
java    4117 root 144r   REG                8,1   27407689   7242146 /opt/alfresco-4.2.f/alf_data/lucene-indexes/workspace/SpacesStore/6a3eb45a-befa-44dc-8e85-3008e832236c/_0.cfs

The listing just continues like this and increases as time goes on.

I haven't been able to reproduce on the test server, but have tried all options I can think of.

Re: Alfresco opening same Lucene file over and over and never closing it.

douglascrp — Tue, 16 Feb 2016 17:58:02 GMT

Hey Mark.

Please, check this page https://wiki.alfresco.com/wiki/Too_many_open_files

You have to configure your server to be able to handle them.