topic Re: What is the best way to selectively re-index certain properties for an install with SOLR? in Alfresco Archive

What is the best way to selectively re-index certain properties for an install with SOLR?

binduwavell — Fri, 13 Dec 2013 17:47:15 GMT

This is hypothetical and open-ended question, we have run into this quite a few times though so is a real issue.Imagine I have a property in my data model that has a certain indexing configuration (tokenization, etc) and for some reason we need to change that configuration in a live system. What too

Re: What is the best way to selectively re-index certain properties for an install with SOLR?

andy — Wed, 18 Dec 2013 15:28:46 GMT

Hi

At the moment there is no easy way.
You could find the ids of all affected nodes and ask SOLR to reindex those nodes (you can index one node over the URL)

http://localhost:8080/solr/admin/cores?action=REINDEX&nodeid=3

At some point we will make this take a a list.
Reindexing a node is just the node. It assumes you know what you are doing, only the node specified is re-indexed.
It will not change anything else in the transaction/index.
It is possible the node has been updated in an as yet un-indexed transaction but that is unlikely to a an issue.

For the generic case we intend to add re-index by type or property - using a generic re-index by query
So "at some point" we will have

http://localhost:8080/solr/admin/cores?action=REINDEX&query=TYPE:'my:type"

to support a limited rebuild of the index.

The query approach would be very flexible.

There is SOLR support for deleting by query which you could use for one of your use cases.

We always sync models at the start of tracking, but they may not update if there is a clash with an existing definition that would require a reindex.
Currently you have to delete the conflicting cached model by hand to get the updated model.
We need an API to force this too.

Hope this helps

Andy

Re: What is the best way to selectively re-index certain properties for an install with SOLR?

andy — Wed, 18 Dec 2013 15:31:00 GMT

Hi

Just noticed the last bit again ….

When we upgrade SOLR we will (most likely) split content out from properties (as we did with lucene).
So we can track content and metadata on their own. We can then support reindex for either or both.

Andy

Re: What is the best way to selectively re-index certain properties for an install with SOLR?

binduwavell — Fri, 17 Jan 2014 18:17:54 GMT

Andy,

As usual, a great detailed response, thanks a ton!

Re: What is the best way to selectively re-index certain properties for an install with SOLR?

sunnrunner — Thu, 31 Jul 2014 22:31:00 GMT

using alfresco 4.0d I'm trying to use

http://localhost:8080/solr/admin/cores?action=REINDEX&query=TYPE:'my:type"

in which nodeId is from the column id in the node table for alfresco?

It is either not working or not working as expected.

I make a change to the object using cmis. I then hit the above url with the assumed appropriate id and then get this response.


<?xml version="1.0" encoding="UTF-8" ?>
<response>
 <lst name="responseHeader">
<int name="status">0</int>
<int name="QTime">0</int>
 </lst>
</response>
‍‍‍‍‍‍‍‍‍

So, did the index actually update or should i see something else? When I try to run a cmis query i am still getting the old value of the object until the indexer runs again. I am looking for an immediate update solution. Is this possible?

Thanks ahead

Re: What is the best way to selectively re-index certain properties for an install with SOLR?

sunnrunner — Mon, 04 Aug 2014 16:12:00 GMT

I have also tried switching to lucene to see if that would give us what we were looking for. However, our custom fields are not being indexed. I've tried adding the index = true with no luck.

I can do a select * from i3b:batchFolder and i see the documents but, when I try to select * from i3b:batchFolder where i3b:batchFolder:queue = 'somestring'; I don't get anything.


        <type name="i3b:batchFolder">
            <title>Batch</title>
            <parent>cm:folder</parent>
            <properties>
                <property name="i3b:batchFolder:pageCount">
                    <title>Page Count</title>
                    <type>d:text</type>
                </property>
                <property name="i3b:batchFolder:status">
                    <title>Status</title>
                    <type>d:text</type>
                    <default>new</default>
                </property>
                <property name="i3b:batchFolder:queue">
                    <title>Queue</title>
                    <type>d:text</type>
                    <default>Unidentified</default>
                    <index enabled="true">
                        <atomic>true</atomic>
                        <stored>true</stored>
                        <tokenised>true</tokenised>
                    </index>
                </property>
            </properties>
        </type>
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍