topic Re: Does Alfresco provide checksum for managed content to aid detecting duplicates? in Alfresco Forum

Does Alfresco provide checksum for managed content to aid detecting duplicates?

kbala — Fri, 12 Oct 2018 18:48:48 GMT

I am looking to save a checksum for managed content. We have multiple sources that save images to alfresco and unfortunately, we end up housing a lot of duplicates. Looking into ways that will alleviate the problem.

Re: Does Alfresco provide checksum for managed content to aid detecting duplicates?

jpotts — Fri, 12 Oct 2018 20:07:44 GMT

Not out of the box, but you can add it easily. I did something similar for another client. You can create a behavior that computes a hash on the content stream every time it is updated, and store that hash as a property on the content. Then, finding duplicates is just a matter of running a search for all documents that have that same hash value.

I think I saw that version 6.x added something related to checksums but I have not investigated to see if it is similar to what I describe above.

Re: Does Alfresco provide checksum for managed content to aid detecting duplicates?

mehe — Sat, 13 Oct 2018 16:34:17 GMT

Jeff is right when he mentions „something related“ in the newer versions you have document fingerprinting.

Document Fingerprints | Alfresco Documentation

You can also find related documents with fingerprinting.

I saw it first in a tech Talk live - and - again - an excellent article from Andy Hind‌ about document fingerprints.

https://community.alfresco.com/people/andy1/blog/2017/05/12/document-fingerprints

Maybe this helps...

Re: Does Alfresco provide checksum for managed content to aid detecting duplicates?

kbala — Mon, 15 Oct 2018 20:42:07 GMT

Thank you. Before we implemented something ourselves that will save the hashes, I wanted to see if Alfresco had something to offer before we tried to reinvent the wheel. Looks like we have v5.2 and I am not sure if an upgrade is pending and we might not be able to use the Document Fingerprint option yet.

Re: Does Alfresco provide checksum for managed content to aid detecting duplicates?

kbala — Mon, 15 Oct 2018 21:09:03 GMT

I am not finding much documentation on fingerprinting of image and other media content. Any idea if this has been designed to cater toward text content?

Re: Does Alfresco provide checksum for managed content to aid detecting duplicates?

andy1 — Wed, 14 Nov 2018 13:55:17 GMT

Fingerprinting was designed for text only.

If you can turn your image into a text representation than you can use it.

Andy