cluster_nodes table missing from PostgreSQL database

[Caley_Goff]

Greetings-

I'm exploring deploying Nuxeo Platform v 8.10 in AWS. I've recently set it up using a shared RDS Postgres Instance in AWS amongst other nodes in AWS.

Anytime it Nuxeo boots according https://doc.nuxeo.com/nxdoc/nuxeo-clustering-configuration/ there will be a table created in the SQL store called cluster_nodes if repository.clustering.enabled is set to true.

Below is the redis cache being shared between the nodes, you can see clearly each node has a unique id and is showing the redis cache. You can see the nuxeo.conf settings from all the nodes in the nuxeo cluster. You can also see the tables in the mongos cluster, as well as the tables in the PostgreSQL cluster. There is no cluster_nodes table.

Thoughts?

##-----------------------------------------------------------------------------
## Database configuration
##-----------------------------------------------------------------------------
nuxeo.mongodb.server=mongodb://primarydb01.companydomain.internal,secondarydb01.companydomain.internal,secondarydb02.companydomain.internal/?maxPoolSize=200
nuxeo.db.user=<someuser>
nuxeo.db.password=<somepass>
nuxeo.db.name=nuxeo
nuxeo.db.host=primarydb.companydomain.internal
#nuxeo.db.jdbc.url=
#nuxeo.db.driver=
## Pools
#nuxeo.db.min-pool-size=
#nuxeo.db.max-pool-size=
#nuxeo.vcs.min-pool-size=
#nuxeo.vcs.max-pool-size=
## Database transaction timeout in seconds (tomcat only)
#nuxeo.db.transactiontimeout=300
##-----------------------------------------------------------------------------
## Clustering settings
##-----------------------------------------------------------------------------
repository.clustering.enabled=true
repository.clustering.id=167773623
repository.clustering.delay=1000
nuxeo.db.validationQuery=SELECT 1
repository.clustering.invalidation=redis
### If clustering is activated, set
repository.binary.store=/opt/nuxeo/binaries

##-----------------------------------------------------------------------------
## Redis Settings
##-----------------------------------------------------------------------------
nuxeo.redis.enabled=true
nuxeo.redis.host=rediscluster.companydomain.internal
nuxeo.redis.port=6379
nuxeo.redis.prefix=nuxeo:
nuxeo.redis.password=
nuxeo.redis.database=0
nuxeo.redis.timeout=2000
nuxeo.redis.maxTotal=16
nuxeo.redis.maxIdle=8
nuxeo.work.queuing=redis

nuxeo=> \d
                         List of relations
 Schema |              Name              |   Type   |    Owner
--------+--------------------------------+----------+--------------
 public | aceinfo                        | table    | <someuser>
 public | auth_tokens                    | table    | <someuser>
 public | continent                      | table    | <someuser>
 public | country                        | table    | <someuser>
 public | digestauth                     | table    | <someuser>
 public | documentsLists                 | table    | <someuser>
 public | ecp-note-type                  | table    | <someuser>
 public | eventCategories                | table    | <someuser>
 public | eventTypes                     | table    | <someuser>
 public | group2group                    | table    | <someuser>
 public | groups                         | table    | <someuser>
 public | hibernate_sequence             | sequence | <someuser>
 public | l10ncoverage                   | table    | <someuser>
 public | l10nsubjects                   | table    | <someuser>
 public | language                       | table    | <someuser>
 public | locale                         | table    | <someuser>
 public | nature                         | table    | <someuser>
 public | nxp_logs                       | table    | <someuser>
 public | nxp_logs_extinfo               | table    | <someuser>
 public | nxp_logs_mapextinfos           | table    | <someuser>
 public | nxp_uidseq                     | table    | <someuser>
 public | oauth2Clients                  | table    | <someuser>
 public | oauth2Clients_id_seq           | sequence | <someuser>
 public | oauth2ServiceProviders         | table    | <someuser>
 public | oauth2ServiceProviders_id_seq  | sequence | <someuser>
 public | oauth2Tokens                   | table    | <someuser>
 public | oauth2Tokens_id_seq            | sequence | <someuser>
 public | oauthConsumers                 | table    | <someuser>
 public | oauthServiceProviders          | table    | <someuser>
 public | oauthServiceProviders_id_seq   | sequence | <someuser>
 public | oauthTokens                    | table    | <someuser>
 public | relation_inverse_predicates    | table    | <someuser>
 public | relation_predicates            | table    | <someuser>
 public | search_operators               | table    | <someuser>
 public | studio_vocabulary_WorkflowType | table    | <someuser>
 public | subject                        | table    | <someuser>
 public | subtopic                       | table    | <someuser>
 public | topic                          | table    | <someuser>
 public | user2group                     | table    | <someuser>
 public | users                          | table    | <someuser>
(40 rows)

nuxeo=>

 switched to db nuxeo
 mongos> show tables
 default
 default.fs.chunks
 default.fs.files
 quartz_calendars
 quartz_jobs
 quartz_locks
 quartz_schedulers
 quartz_triggers
 mongos>

somerediscluster.w2wioh.ng.0001.usw2.cache.amazonaws.com:6379> KEYS *nuxeo*
1) "nuxeo:inval:default:nodes:167773860"
2) "nuxeo:inval:default:nodes:167773594"
3) "nuxeo:work:count:collections"
4) "nuxeo:work:count:default"
5) "nuxeo:lock:default:ab77adaf-6ee5-4540-8d73-e0349e574305"
6) "nuxeo:cache:sql-user-entry-cache:someUserName"
7) "nuxeo:lock:default:41c454a2-511f-4dd9-b7a8-93534c4850a7"
8) "nuxeo:lock:default:c3408a79-f352-44f6-ab39-0965febd8557"
9) "nuxeo:lock:default:810f3597-d3b1-45a1-b0aa-05598e62a633"
10) "nuxeo:work:count:updateACEStatus"
11) "nuxeo:work:count:permissionsPurge"
12) "nuxeo:cache:default-cache:someUserName"
13) "nuxeo:lock:default:ca3e6469-3218-479b-ae21-83f4398307b0"
14) "nuxeo:lock:default:db73c463-cd8e-46fb-a432-c446cbdc77cd"
15) "nuxeo:cache:sql-group-entry-cache:someUserGroup"
16) "nuxeo:work:count:fulltextUpdater"
17) "nuxeo:inval:default:nodes:167773365"
18) "nuxeo:inval:default:nodes:167773730"
19) "nuxeo:lock:default:7ee1c526-1b8e-47db-bc55-911bdc763244"
20) "nuxeo:work:count:escalation"
21) "nuxeo:work:count:renditionBuilder"
22) "nuxeo:lock:default:fa3e86c1-aa67-4768-b787-abf54313f1d5"
23) "nuxeo:lock:default:9fe8b7bd-07b8-4010-be23-08e2ad2dcda8"
24) "nuxeo:inval:default:nodes:167773487"
25) "nuxeo:transientStore:default:size"
26) "nuxeo:work:count:elasticSearchIndexing"
27) "nuxeo:lock:default:d5e7bade-ae08-4ae8-aab7-fe3a18108340"
28) "nuxeo:inval:default:nodes:167773231"
29) "nuxeo:lock:default:6a11a17d-d7ee-4896-a01b-3ebdddb3981f"
30) "nuxeo:lock:default:de796c14-594c-4eb2-9452-61424045619e"
somerediscluster.w2wioh.ng.0001.usw2.cache.amazonaws.com:6379>

[Florent_Guillau · Accepted solution]

The cluster_nodes and cluster_invals table only apply if you don't use Redis invalidations.As you have specified repository.clustering.invalidation=redis then cluster invalidations go through Redis, and the tables are not created.

[Caley_Goff]

Thanks!