topic Re: Add an aspect to large number of nodes in Alfresco Forum

Add an aspect to large number of nodes

kuliado — Thu, 11 Apr 2019 13:11:28 GMT

Hello,I have a little issue I don't know how to tackle properly and concerns performance.I need to process ~200k documents that are missing an aspect. First, I identified these documents with a mysql query to evaluate how many there are. These nodes have aspect X but are missing aspect Y, so I need

Re: Add an aspect to large number of nodes

angelborroy — Thu, 11 Apr 2019 14:14:16 GMT

IMO the best approach is to use REST API with pagination. So you can patch documents by blocks.

Re: Add an aspect to large number of nodes

kuliado — Fri, 12 Apr 2019 06:06:14 GMT

Thanks for your answer Angel.

Can I ask you to be more specific on your approach ? How would you get these nodes, /search endpoint ? And how would you patch them, /nodes/{nodeid} PUT ?

I need to prevent changing the modifier/modified properties while doing this and prevent all behaviour for performance could be a good idea.

Re: Add an aspect to large number of nodes

angelborroy — Fri, 12 Apr 2019 07:24:40 GMT

This is mainly the idea, get the nodes with "/search" pages and add the aspect with "/nodes/{nodeid}".

You can disable AUDITABLE Behaviour to avoid the change of the modification properties.

Re: Add an aspect to large number of nodes

kuliado — Fri, 12 Apr 2019 10:21:11 GMT

Hello,

Thanks again for your help. My solution is working now just I have to decide on the number of nodes to fix per loop performance wise. It takes around 7s for the transaction that fixes 20 nodes to finish.

One thing I can't prevent and is fundamental to approve my code is the change in modification properties. In my transaction I do a behaviourFilter.disableBehaviour(); then reenable at the end, but the nodes still show "Modified by System".

I see in the logs that as soon as I reenable the behaviours a few other custom behaviours trigger on these nodes and modifiy them, I suppose if they use current user context then this must be why modified & modifier change to System ?

Any idea how to solve this if my supposition is right ?

Re: Add an aspect to large number of nodes

angelborroy — Fri, 12 Apr 2019 10:41:45 GMT

You have to use a behaviour to control that.

Hope this helps: Change values of properties included in ‘cm:auditable’ aspect: cm:creator, cm:modifier, cm:created, cm:modified, cm:acce…

Re: Add an aspect to large number of nodes

kuliado — Fri, 12 Apr 2019 14:02:12 GMT

Thank you,

I implemented that behaviour and binded to EVERY_EVENT the onUpdateProperties to catch any changes where the new modifier prop is "System", the catch works, and I put old values back, all this inside disableBehaviour too to be sure.

Unfortunately the end result is still modifier = System. It seems a behaviour binded on onUpdateProperties TRANSACTION_COMMIT is always the last one to be executed and modifies the node, I know wich one it is since it shows in the logs, is there no way to order behaviour execution ?

Re: Add an aspect to large number of nodes

angelborroy — Fri, 12 Apr 2019 14:29:35 GMT

I don't know how are you doing the adding of the aspect. But this seudo-code should work...

policyBehaviourFilter.disableBehaviour(nodeRef, ContentModel.ASPECT_AUDITABLE);
try 
{
    nodeService.addAspect(nodeRef, YOUR_NEW_ASPECT, props);
}
finally
{
    policyBehaviourFilter.enableBehaviour(nodeRef, ContentModel.ASPECT_AUDITABLE);
}‍‍‍‍‍‍‍‍‍

Re: Add an aspect to large number of nodes

kuliado — Wed, 17 Apr 2019 11:31:59 GMT

Thanks Angel,

Yes that's somewhat how I'm adding the aspect. The problem being :

- I'm doing all that in a transaction.

- As soon as I enable behaviours again during this transaction then there's multiple behaviours that trigger and modify the node. I don't know how to enable AUDITABLE AFTER these behaviours finished triggering their changes in the same transaction. (Your code suggestion by disabling auditable only and letting the other behaviours trigger should fix this maybe ? I don't know when the line policyBehaviourFilter.enableBehaviour(nodeRef,ContentModel.ASPECT_AUDITABLE); is executed compared to the behaviours that modify the node)

- Again, when the transaction is committed, another behaviour comes in and modifies the node, changing auditable again.

This behaviour is binded on TRANSACTION_COMMIT, I should enable AUDITABLE after this behaviour did it's thing.

Re: Add an aspect to large number of nodes

angelborroy — Wed, 17 Apr 2019 13:07:08 GMT

I've create a sample project available at:

GitHub - aborroy/auditable-aspect-disable: Alfresco Repository module to disable AUDITABLE ASPECT behaviour

Include the QName of the aspect you are adding in alfresco-global.properties to test the module.

Let me know if this works for you.

Re: Add an aspect to large number of nodes

kuliado — Thu, 18 Apr 2019 13:52:42 GMT

Wow, that is amazing from your part. I never asked for so much.

I will test this as soon as I can implement it with my code.

I already learned how to listen and execute code after the transaction is completed thanks to you with TransactionListenerAdapter.

A million thanks.