topic Re: searchService finds deleted content in Alfresco Archive

searchService finds deleted content

iblanco — Fri, 01 Feb 2013 16:59:15 GMT

I was having trouble with a scheduled job due to the fact that the "fts-alfresco" search I was running was returning some node references to nodes that are already deleted. I thought that might be some kind of corruption on the Lucene index because fully rebuilding the index did solve the problem. B

Re: searchService finds deleted content

afaust — Sun, 03 Feb 2013 14:25:00 GMT

Hello,

one thing to keep in mind is that Lucene (and SOLR in 4.x) can be out-of-synch with the real state of the database, depending on how they are set up (tracking / index update intervals) and how long it takes to update the index for one specific set of changes. The search with fts-alfresco on workspace://SpacesStore should normally not return any deleted nodes, but may contain some when the deletion just occured and the indexer did not yet have a chance to remove them from the index. Since this can occur (and will likely do so sometime in a high load situations), you should always take care to check your search result nodes for existence (as an extension programmer), before performing any operations on them.

If your issue is consistent, reproducible and deleted nodes are retained in the index longer than the default 5-15 seconds between indexer runs, it would be worth looking into your use case and your configuration.

Generally speaking, which version of Alfresco are you using / does your issue occur on?

Regards
Axel

Re: searchService finds deleted content

iblanco — Mon, 04 Feb 2013 08:25:19 GMT

Thank you AFaust for you comments.

I'm using Alfresco Community 4.0.d and Lucene, not SOLR. The nodes remain in this state for quite longer thant 15-20 seconds, for hours, well in fact I haven't seen them going back to a consistent state until I stopped and did a full reindex. In fact not even restarting the repository solved the problem if there wasn't a full reindex.

Those "ghost nodes" usually appear when I delete a folder where they are, not if I directly delete them. So it seems to me like I'm having some trouble with the logic in Alfresco that should crawl the descendants of a deleted folder. Those folders are created programatically so I might have some kind of error in the creation process that makes those folders different from regular ones.

If having deleted nodes persist longer thant 15-20 seconds is not an expected behaviour I'll have to check it more thoroughly with the debugger to see what's happening while deleting.

Thanks.

Re: searchService finds deleted content

iblanco — Thu, 07 Feb 2013 09:07:04 GMT

Well, I'm still fighting the issue. I've managed to reproduce it in a quite easy way and I've reported it as a bug: https://issues.alfresco.com/jira/browse/ALF-17860

I suspect that this might be a misunderstanding of the process of index updating in alfresco and maybe not a real bug but I don't know how to manage it in a reasonable way and I expect that the answer to the bug might seed some light into what I'm doing wrong. We will see.

Re: searchService finds deleted content

andy — Thu, 07 Feb 2013 10:37:39 GMT

Can you reproduce this on 4.2?

Andy

Re: searchService finds deleted content

iblanco — Thu, 07 Feb 2013 11:40:11 GMT

It doesn't happen in 4.2, Derek Hulley paid attention to the bug report and asked the same question. It seems like something similar used to happen with 3.4.6 but it was fixed in 3.4.9 .