topic Re: Problem starting Template Rendering Listener and fetching documents in Nuxeo Forum

Problem starting Template Rendering Listener and fetching documents

Victor_Sánchez — Fri, 09 Aug 2019 12:04:09 GMT

Hi team,

I have detected a problem starting Nuxeo. With a 100M documents instance, the deployment is very slow, and looking for the problem, I found this source code into https://github.com/nuxeo/nuxeo/blob/master/addons/nuxeo-template-rendering/nuxeo-template-rendering-core/src/main/java/org/nuxeo/template/service/TemplateMappingFetcher.java

It runs after TemplateInitListener.java listening for aboutToCreate event.

@Override
public void run() {
   StringBuilder sb = new StringBuilder("select * from Document where ");
   sb.append(TemplateSourceDocumentAdapterImpl.TEMPLATE_FORCED_TYPES_ITEM_PROP);
   sb.append(" <> 'none'");
   DocumentModelList docs = session.query(sb.toString());
   for (DocumentModel doc : docs) {
      TemplateSourceDocument tmpl = doc.getAdapter(TemplateSourceDocument.class);
      if (tmpl != null) {
         for (String type : tmpl.getForcedTypes()) {
             if (mapping.containsKey(type)) {
              ...

This NXQL against MongoDB has a serious problem, even having indexes:

select * from Document where tmpl:forcedTypes/* <> 'none'

Regards, VS!

Re: Problem starting Template Rendering Listener and fetching documents

Gregory_Carlin — Thu, 22 Aug 2019 13:02:25 GMT

Hello,

Performances are really related to the architecture you've set up. I encourage you to watch https://university.nuxeo.com/learn/course/external/view/elearning/201/NuxeoReferenceArchitecture to check your Nuxeo infrastructure, and in particuly:

Tune your MongoDB DB
Dedicate some workers and/or Nuxeo Stream to handle bulk rendering

Regards

Re: Problem starting Template Rendering Listener and fetching documents

Victor_Sánchez — Thu, 22 Aug 2019 13:33:57 GMT

Hi Gregory,

thanks for your answer, but it is not the problem. Still MongoDB is tuned, the query:

select * from Document where tmpl:forcedTypes/* <> 'none'

return all documents because it is not transformed fine by MongoDBQueryBuilder. After query execution, you can find the "bucle" for all returned docs. This is the problem. The best solution for that is change the query to:

select * from Document where tmpl:forcedTypes is not null and tmpl:forcedTypes/* <> 'none'

Regards, VS!