Hyland Connect

ludoADV · ‎08-05-2021

Hello,

From standard installation and configuration, files imported via GUI are correctly indexed but not imported files.

Any solution ?

Regards,

ludoADV · ‎08-06-2021

where I can edit configuration file ?

Note import works, but not files are not indexed

abhinavmishra14 · ‎08-06-2021

@ludoADV wrote:

where I can edit configuration file ?

Note import works, but not files are not indexed

If you mean by configuration as in configuring logs then , there are couple ways you can enable the logs in dockerised environment.

1- Connect to alfresco docker container and add the debug logs to dev-log4j.properties

a. Connect:
    docker exec -t -i <containerName/Id> /bin/bash
    e.g.:
    docker exec -t -i default_alfresco_1 /bin/bash

    Here, 'default_alfresco_1' is the name of container. You can find list of launched containers by executing "docker ps" command.

b. Navigate to the extensions directory, find the dev-log4j.properties file and add the above given debug logs

   $ cd ./shared/classes/alfresco/extension
   $ vim dev-log4j.properties # Add logs and save the file.
   $ exit

c.  Restart container:
    docker container restart default_alfresco_1

Same way do for solr (search service, logs can be found under .\logs directory).

Note that, with above approach if you terminate the containers all your changes would be lost.

2- Use the DockerFile in combination with docker-compose.yml to build custom alfresco image with updated log4j. This is recommended approach as all your customizations are packed with custom alfresco image even if you terminate all the containers. Next time you launch the containers, you would again have all the setup.

Follow these steps:

a- Create a folder named build-config in same folder where you have kept your docker-compose.yml file
b- Create a folder named, 'alfresco' within build-config folder
c- Create a folder named extensions in 'alfresco' folder.
d- Copy your repo layer custom or third party amps in the build-config/alfresco/extensions folder. Optional step if you are using just out of the box setup with no customizations.

e- Create a file named 'custom-log4j.properties' under 'build-config/alfresco' and add the log setting shared in previeous reply above

f- Create a file named 'DockerFile' under 'build-config/alfresco' which will be used for building alfresco image
g- Copy following instructions in the DockerFile (build-config/alfresco), e.g.:

        FROM alfresco/alfresco-content-repository-community:7.0.0
	ARG TOMCAT_DIR=/usr/local/tomcat

	#Change to root
	USER root

	# Copy extensions jar module if there are any
	COPY Dockerfile extensions/*.jar $TOMCAT_DIR/webapps/alfresco/WEB-INF/lib/

	# Copy and apply amp extensions
	COPY Dockerfile extensions/*.amp $TOMCAT_DIR/amps/
	RUN java -jar $TOMCAT_DIR/alfresco-mmt/alfresco-mmt*.jar install \
				  $TOMCAT_DIR/amps $TOMCAT_DIR/webapps/alfresco -directory -nobackup -force

	#Change back to alfresco
	USER alfresco

        #Copy the custom log file
        COPY custom-log4j.properties $TOMCAT_DIR/shared/classes/alfresco/extension/custom-log4j.properties

h- Update the docker-compose.yml for 'alfresco' service as e.g.:

alfresco:
	build:
          dockerfile: ./Dockerfile
          context: ./build-config/alfresco
        mem_limit: 1500m
        environment:
            JAVA_TOOL_OPTIONS: "
                -Dencryption.keystore.type=JCEKS
                -Dencryption.cipherAlgorithm=DESede/CBC/PKCS5Padding
                -Dencryption.keyAlgorithm=DESede
                -Dencryption.keystore.location=/usr/local/tomcat/shared/classes/alfresco/extension/keystore/keystore
                -Dmetadata-keystore.password=mp6yc0UD9e
                -Dmetadata-keystore.aliases=metadata
                -Dmetadata-keystore.metadata.password=oKIWzVdEdA
                -Dmetadata-keystore.metadata.algorithm=DESede
                "
            JAVA_OPTS: "
                -Ddb.driver=org.postgresql.Driver
                -Ddb.username=alfresco
                -Ddb.password=alfresco
                -Ddb.url=jdbc:postgresql://postgres:5432/alfresco
                -Dsolr.host=solr6
                -Dsolr.port=8983
                -Dsolr.http.connection.timeout=1000
                -Dsolr.secureComms=none
                -Dsolr.base.url=/solr
                -Dindex.subsystem.name=solr6
                -Dshare.host=127.0.0.1
                -Dshare.port=8080
                -Dalfresco.host=localhost
                -Dalfresco.port=8080
                -Daos.baseUrlOverwrite=http://localhost:8080/alfresco/aos
                -Dmessaging.broker.url=\"failover:(nio://activemq:61616)?timeout=3000&jms.useCompression=true\"
                -Ddeployment.method=DOCKER_COMPOSE
                -DlocalTransform.core-aio.url=http://transform-core-aio:8090/
                -Dcsrf.filter.enabled=false
                -XX:MinRAMPercentage=50 -XX:MaxRAMPercentage=80
                "

i- Same way configure the logs for solr service with help of DockerFile. Create a folder named, 'solr' within build-config folder

j- Create a file named 'DockerFile' under 'build-config/solr' which will be used for building solr image

k- Create a file named "log4j.properties" under 'build-config/solr' and copy the contents from here into the file. https://github.com/Alfresco/SearchServices/blob/master/search-services/packaging/src/main/resources/...

l- Add the logs settings shared in above thread at the end of the log4j.properties file

m- Copy following content in 'DockerFile' created under 'build-config/solr'

FROM alfresco/alfresco-search-services:2.0.1.1

#Copy modified log4j.properties to logs directory in solr container
COPY log4j.properties ./logs/log4j.properties

n- Update the solr service as:

   solr6:
        build:
          dockerfile: ./Dockerfile
          context: ./build-config/solr
        mem_limit: 2g
        environment:
            #Solr needs to know how to register itself with Alfresco
            - SOLR_ALFRESCO_HOST=alfresco
            - SOLR_ALFRESCO_PORT=8080
            #Alfresco needs to know how to call solr
            - SOLR_SOLR_HOST=solr6
            - SOLR_SOLR_PORT=8983
            #Create the default alfresco and archive cores
            - SOLR_CREATE_ALFRESCO_DEFAULTS=alfresco,archive
            #HTTP by default
            - ALFRESCO_SECURE_COMMS=none
        ports:
            - 8083:8983 #Browser port

o- Launch the containers again, use following command:

docker-compose -f ./docker-compose.yml up --build

or alternatively you can tail the logs :

docker-compose logs --tail="all"

Hopefully with additional logs you can figure out the issue with indexing.

~Abhinav
(ACSCE, AWS SAA, Azure Admin)

ludoADV · ‎08-09-2021

Hello,

- log4j.properties does not exist in docker container alfresco (from extension subfolder)

- When trying using build container, it failed when trying to connect to http://<SERVER>:8080 "Cannot find Alfresco Repository on this server. (Does this application have access to alfresco-global.properties? Does this application have cross-context permissions?)" even if there is no error message from docker-compose -f community-docker-compose.yml up --build

abhinavmishra14 · ‎08-09-2021

@ludoADV wrote:

Hello,

- log4j.properties does not exist in docker container alfresco (from extension subfolder)

- When trying using build container, it failed when trying to connect to http://<SERVER>:8080 "Cannot find Alfresco Repository on this server. (Does this application have access to alfresco-global.properties? Does this application have cross-context permissions?)" even if there is no error message from docker-compose -f community-docker-compose.yml up --build

When reporting errors, please also share the steps you followed from the previous reply. If you see "e- Create a file named 'custom-log4j.properties' under 'build-config/alfresco' and add the log setting shared in previeous reply above", it says you need to create the file.

Please share the docker-compose.yml , DockerFile etc that you had created.

For more info, you can also refer to this project:

https://github.com/abhinavmishra14/change-acs-share-port-demo/blob/master/docker-compose.yml#L15

https://github.com/abhinavmishra14/change-acs-share-port-demo/tree/master/configs-to-override/alfres...

https://github.com/abhinavmishra14/change-acs-share-port-demo/blob/master/docker-compose.yml#L103

https://github.com/abhinavmishra14/change-acs-share-port-demo/tree/master/configs-to-override/solr

~Abhinav
(ACSCE, AWS SAA, Azure Admin)

ludoADV · ‎08-10-2021

Hello,

After reinstalled ACS instance using your docker-compose.yml ( https://raw.githubusercontent.com/abhinavmishra14/change-acs-share-port-demo/master/docker-compose.y... ), I performed bulk import to check if file content is indexed (no).

Logs:

proxy_1               | 172.16.199.1 - admin [10/Aug/2021:07:23:04 +0000] "POST /alfresco/service/bulkfsimport/initiate HTTP/1.1" 302 1708 "http://dms2:7080/alfresco/service/bulkfsimport" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/14.1.2 Safari/605.1.15"
proxy_1               | 172.16.199.1 - admin [10/Aug/2021:07:23:04 +0000] "GET /alfresco/service/bulkfsimport/status HTTP/1.1" 200 4961 "http://dms2:7080/alfresco/service/bulkfsimport" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/14.1.2 Safari/605.1.15"
solr6_1               | 2021-08-10 07:23:10.007 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-16) [   ] o.a.s.t.AclTracker 40-[CORE archive] <init> Tracking ACLs
solr6_1               | 2021-08-10 07:23:10.007 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-30) [   ] o.a.s.t.MetadataTracker 54-[CORE archive] Starting metadata tracker execution
solr6_1               | 2021-08-10 07:23:10.007 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-29) [   ] o.a.s.t.AclTracker 53-[CORE alfresco] <init> Tracking ACLs
solr6_1               | 2021-08-10 07:23:10.010 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-36) [   ] o.a.s.t.MetadataTracker 60-[CORE alfresco] Starting metadata tracker execution
solr6_1               | 2021-08-10 07:23:10.013 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-25) [   ] o.a.s.t.ContentTracker 49-[CORE archive] Total number of docs with content updated: 0 
solr6_1               | 2021-08-10 07:23:10.019 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-7) [   ] o.a.s.t.ContentTracker 31-[CORE alfresco] Total number of docs with content updated: 0 
solr6_1               | 2021-08-10 07:23:10.146 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-29) [   ] o.a.s.t.AclTracker 53-[CORE alfresco] Found 1 ACL change sets after lastTxCommitTime 1628579506871, ACL Change Sets from AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3] to AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3]
solr6_1               | 2021-08-10 07:23:10.149 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-30) [   ] o.a.s.t.MetadataTracker 54:1628580190149-[CORE archive] Found 2 transactions after lastTxCommitTime 1628579917750, transactions from Transaction [id=26, commitTimeMs=1628579917750, updates=1, deletes=0] to Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0]
solr6_1               | 2021-08-10 07:23:10.152 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-36) [   ] o.a.s.t.MetadataTracker 60:1628580190152-[CORE alfresco] Found 2 transactions after lastTxCommitTime 1628579917750, transactions from Transaction [id=26, commitTimeMs=1628579917750, updates=1, deletes=0] to Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0]
solr6_1               | 2021-08-10 07:23:10.167 DEBUG (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-36) [   ] o.a.s.t.MetadataTracker 60:1628580190152:1628580190153-[CORE alfresco] Indexing 1 Nodes from Transactions: [27]
solr6_1               | 2021-08-10 07:23:10.168 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-16) [   ] o.a.s.t.AclTracker 40-[CORE archive] Found 1 ACL change sets after lastTxCommitTime 1628579506871, ACL Change Sets from AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3] to AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3]
solr6_1               | 2021-08-10 07:23:10.176 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-29) [   ] o.a.s.t.AclTracker 53-[CORE alfresco] No ACL change set found after lastTxCommitTime 1628579506871
solr6_1               | 2021-08-10 07:23:10.176 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-29) [   ] o.a.s.t.AclTracker 53-[CORE alfresco] <end> Tracked 0 ACLs
solr6_1               | 2021-08-10 07:23:10.177 DEBUG (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-30) [   ] o.a.s.t.MetadataTracker 54:1628580190149:1628580190149-[CORE archive] Indexing 0 Nodes from Transactions: [27]
solr6_1               | 2021-08-10 07:23:10.213 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-16) [   ] o.a.s.t.AclTracker 40-[CORE archive] No ACL change set found after lastTxCommitTime 1628579506871
solr6_1               | 2021-08-10 07:23:10.214 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-16) [   ] o.a.s.t.AclTracker 40-[CORE archive] <end> Tracked 0 ACLs
solr6_1               | 2021-08-10 07:23:10.255 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-30) [   ] o.a.s.t.MetadataTracker 54:1628580190255-[CORE archive] No transaction found after lastTxCommitTime 1628580184673
solr6_1               | 2021-08-10 07:23:10.256 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-30) [   ] o.a.s.t.MetadataTracker 54-[CORE archive] Tracked 0 DOCs
solr6_1               | 2021-08-10 07:23:10.325 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-36) [   ] o.a.s.t.MetadataTracker 60:1628580190325-[CORE alfresco] No transaction found after lastTxCommitTime 1628580184673
solr6_1               | 2021-08-10 07:23:10.326 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-36) [   ] o.a.s.t.MetadataTracker 60-[CORE alfresco] Tracked 1 DOCs
solr6_1               | 2021-08-10 07:23:20.001 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-13) [   ] o.a.s.t.AclTracker 37-[CORE alfresco] <init> Tracking ACLs
solr6_1               | 2021-08-10 07:23:20.002 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-11) [   ] o.a.s.t.AclTracker 35-[CORE archive] <init> Tracking ACLs
solr6_1               | 2021-08-10 07:23:20.005 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-35) [   ] o.a.s.t.MetadataTracker 59-[CORE alfresco] Starting metadata tracker execution
solr6_1               | 2021-08-10 07:23:20.007 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-28) [   ] o.a.s.t.MetadataTracker 52-[CORE archive] Starting metadata tracker execution
solr6_1               | 2021-08-10 07:23:20.005 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-17) [   ] o.a.s.t.ContentTracker 41-[CORE alfresco] Total number of docs with content updated: 0 
solr6_1               | 2021-08-10 07:23:20.010 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-20) [   ] o.a.s.t.ContentTracker 44-[CORE archive] Total number of docs with content updated: 0 
solr6_1               | 2021-08-10 07:23:20.113 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-11) [   ] o.a.s.t.AclTracker 35-[CORE archive] Found 1 ACL change sets after lastTxCommitTime 1628579506871, ACL Change Sets from AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3] to AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3]
solr6_1               | 2021-08-10 07:23:20.133 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-13) [   ] o.a.s.t.AclTracker 37-[CORE alfresco] Found 1 ACL change sets after lastTxCommitTime 1628579506871, ACL Change Sets from AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3] to AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3]
solr6_1               | 2021-08-10 07:23:20.157 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-28) [   ] o.a.s.t.MetadataTracker 52:1628580200157-[CORE archive] Found 1 transactions after lastTxCommitTime 1628580184673, transactions from Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0] to Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0]
solr6_1               | 2021-08-10 07:23:20.202 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-28) [   ] o.a.s.t.MetadataTracker 52:1628580200202-[CORE archive] No transaction found after lastTxCommitTime 1628580184673
solr6_1               | 2021-08-10 07:23:20.204 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-28) [   ] o.a.s.t.MetadataTracker 52-[CORE archive] Tracked 0 DOCs
solr6_1               | 2021-08-10 07:23:20.206 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-11) [   ] o.a.s.t.AclTracker 35-[CORE archive] No ACL change set found after lastTxCommitTime 1628579506871
solr6_1               | 2021-08-10 07:23:20.207 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-11) [   ] o.a.s.t.AclTracker 35-[CORE archive] <end> Tracked 0 ACLs
solr6_1               | 2021-08-10 07:23:20.272 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-35) [   ] o.a.s.t.MetadataTracker 59:1628580200272-[CORE alfresco] Found 1 transactions after lastTxCommitTime 1628580184673, transactions from Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0] to Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0]
solr6_1               | 2021-08-10 07:23:20.280 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-13) [   ] o.a.s.t.AclTracker 37-[CORE alfresco] No ACL change set found after lastTxCommitTime 1628579506871
solr6_1               | 2021-08-10 07:23:20.280 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-13) [   ] o.a.s.t.AclTracker 37-[CORE alfresco] <end> Tracked 0 ACLs
solr6_1               | 2021-08-10 07:23:20.295 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-35) [   ] o.a.s.t.MetadataTracker 59:1628580200295-[CORE alfresco] No transaction found after lastTxCommitTime 1628580184673
solr6_1               | 2021-08-10 07:23:20.296 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-35) [   ] o.a.s.t.MetadataTracker 59-[CORE alfresco] Tracked 0 DOCs
solr6_1               | 2021-08-10 07:23:30.002 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-24) [   ] o.a.s.t.AclTracker 48-[CORE alfresco] <init> Tracking ACLs
solr6_1               | 2021-08-10 07:23:30.003 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-33) [   ] o.a.s.t.AclTracker 57-[CORE archive] <init> Tracking ACLs
solr6_1               | 2021-08-10 07:23:30.018 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-4) [   ] o.a.s.t.MetadataTracker 28-[CORE archive] Starting metadata tracker execution
solr6_1               | 2021-08-10 07:23:30.018 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-8) [   ] o.a.s.t.MetadataTracker 32-[CORE alfresco] Starting metadata tracker execution
solr6_1               | 2021-08-10 07:23:30.037 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-32) [   ] o.a.s.t.ContentTracker 56-[CORE archive] Total number of docs with content updated: 0 
alfresco_1            |  2021-08-10 07:23:30,092  INFO  [management.subsystems.ChildApplicationContextFactory] [http-nio-7080-exec-8] Starting 'Transformers' subsystem, ID: [Transformers, default]
solr6_1               | 2021-08-10 07:23:30.181 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-33) [   ] o.a.s.t.AclTracker 57-[CORE archive] Found 1 ACL change sets after lastTxCommitTime 1628579506871, ACL Change Sets from AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3] to AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3]
solr6_1               | 2021-08-10 07:23:30.188 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-24) [   ] o.a.s.t.AclTracker 48-[CORE alfresco] Found 1 ACL change sets after lastTxCommitTime 1628579506871, ACL Change Sets from AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3] to AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3]
solr6_1               | 2021-08-10 07:23:30.259 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-4) [   ] o.a.s.t.MetadataTracker 28:1628580210259-[CORE archive] Found 1 transactions after lastTxCommitTime 1628580184673, transactions from Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0] to Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0]
solr6_1               | 2021-08-10 07:23:30.304 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-33) [   ] o.a.s.t.AclTracker 57-[CORE archive] No ACL change set found after lastTxCommitTime 1628579506871
solr6_1               | 2021-08-10 07:23:30.305 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-33) [   ] o.a.s.t.AclTracker 57-[CORE archive] <end> Tracked 0 ACLs
solr6_1               | 2021-08-10 07:23:30.324 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-8) [   ] o.a.s.t.MetadataTracker 32:1628580210323-[CORE alfresco] Found 1 transactions after lastTxCommitTime 1628580184673, transactions from Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0] to Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0]
solr6_1               | 2021-08-10 07:23:30.339 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-24) [   ] o.a.s.t.AclTracker 48-[CORE alfresco] No ACL change set found after lastTxCommitTime 1628579506871
solr6_1               | 2021-08-10 07:23:30.339 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-24) [   ] o.a.s.t.AclTracker 48-[CORE alfresco] <end> Tracked 0 ACLs
solr6_1               | 2021-08-10 07:23:30.346 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-4) [   ] o.a.s.t.MetadataTracker 28:1628580210346-[CORE archive] No transaction found after lastTxCommitTime 1628580184673
solr6_1               | 2021-08-10 07:23:30.347 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-4) [   ] o.a.s.t.MetadataTracker 28-[CORE archive] Tracked 0 DOCs
solr6_1               | 2021-08-10 07:23:30.384 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-8) [   ] o.a.s.t.MetadataTracker 32:1628580210384-[CORE alfresco] No transaction found after lastTxCommitTime 1628580184673
solr6_1               | 2021-08-10 07:23:30.384 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-8) [   ] o.a.s.t.MetadataTracker 32-[CORE alfresco] Tracked 0 DOCs
alfresco_1            |  2021-08-10 07:23:30,429  INFO  [management.subsystems.ChildApplicationContextFactory] [http-nio-7080-exec-8] Startup of 'Transformers' subsystem, ID: [Transformers, default] complete
solr6_1               | 2021-08-10 07:23:30.654 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-19) [   ] o.a.s.t.ContentTracker 43-[CORE alfresco] Total number of docs with content updated: 1 
solr6_1               | 2021-08-10 07:23:40.003 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-21) [   ] o.a.s.t.AclTracker 45-[CORE alfresco] <init> Tracking ACLs
solr6_1               | 2021-08-10 07:23:40.008 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-7) [   ] o.a.s.t.ContentTracker 31-[CORE alfresco] Total number of docs with content updated: 0 
solr6_1               | 2021-08-10 07:23:40.009 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-15) [   ] o.a.s.t.AclTracker 39-[CORE archive] <init> Tracking ACLs
solr6_1               | 2021-08-10 07:23:40.010 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-34) [   ] o.a.s.t.ContentTracker 58-[CORE archive] Total number of docs with content updated: 0 
solr6_1               | 2021-08-10 07:23:40.011 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-2) [   ] o.a.s.t.MetadataTracker 26-[CORE alfresco] Starting metadata tracker execution
solr6_1               | 2021-08-10 07:23:40.013 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-14) [   ] o.a.s.t.MetadataTracker 38-[CORE archive] Starting metadata tracker execution
solr6_1               | 2021-08-10 07:23:40.126 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-21) [   ] o.a.s.t.AclTracker 45-[CORE alfresco] Found 1 ACL change sets after lastTxCommitTime 1628579506871, ACL Change Sets from AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3] to AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3]
solr6_1               | 2021-08-10 07:23:40.136 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-15) [   ] o.a.s.t.AclTracker 39-[CORE archive] Found 1 ACL change sets after lastTxCommitTime 1628579506871, ACL Change Sets from AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3] to AclChangeSet [id=9, commitTimeMs=1628579506871, aclCount=3]
solr6_1               | 2021-08-10 07:23:40.141 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-14) [   ] o.a.s.t.MetadataTracker 38:1628580220141-[CORE archive] Found 1 transactions after lastTxCommitTime 1628580184673, transactions from Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0] to Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0]
solr6_1               | 2021-08-10 07:23:40.189 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-15) [   ] o.a.s.t.AclTracker 39-[CORE archive] No ACL change set found after lastTxCommitTime 1628579506871
solr6_1               | 2021-08-10 07:23:40.194 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-15) [   ] o.a.s.t.AclTracker 39-[CORE archive] <end> Tracked 0 ACLs
solr6_1               | 2021-08-10 07:23:40.211 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-14) [   ] o.a.s.t.MetadataTracker 38:1628580220211-[CORE archive] No transaction found after lastTxCommitTime 1628580184673
solr6_1               | 2021-08-10 07:23:40.212 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-14) [   ] o.a.s.t.MetadataTracker 38-[CORE archive] Tracked 0 DOCs
solr6_1               | 2021-08-10 07:23:40.303 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-2) [   ] o.a.s.t.MetadataTracker 26:1628580220303-[CORE alfresco] Found 1 transactions after lastTxCommitTime 1628580184673, transactions from Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0] to Transaction [id=27, commitTimeMs=1628580184673, updates=1, deletes=0]
solr6_1               | 2021-08-10 07:23:40.332 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-21) [   ] o.a.s.t.AclTracker 45-[CORE alfresco] No ACL change set found after lastTxCommitTime 1628579506871
solr6_1               | 2021-08-10 07:23:40.337 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-21) [   ] o.a.s.t.AclTracker 45-[CORE alfresco] <end> Tracked 0 ACLs
solr6_1               | 2021-08-10 07:23:40.349 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-2) [   ] o.a.s.t.MetadataTracker 26:1628580220349-[CORE alfresco] No transaction found after lastTxCommitTime 1628580184673
solr6_1               | 2021-08-10 07:23:40.353 INFO  (org.alfresco.solr.AlfrescoCoreAdminHandler@648ee871_Worker-2) [   ] o.a.s.t.MetadataTracker 26-[CORE alfresco] Tracked 0 DOCs

cristinamr · ‎08-10-2021

Hi!

If you can upload a document, edit its metadata and search by them, then your problem is not on Solr face.

Could you please try to use bulk import via curl? Just upload 1 example to see if its properties are indexed and you are able to search by them.

If this solution works, means you have an error in the steps you perform with the traditional bulk import tool.

Cheers,

Cristina.

--
VenziaIT: helping companies since 2005! Our ECM products: AQuA & Seidoc

ludoADV · ‎08-10-2021

I used curl command to upload 1 txt file (with metadata):

curl 'http://localhost:7080/alfresco/service/bulkfsimport/initiate' \
-H 'Authorization: Basic VElDS0VUX2QyMGVlMzMyZWViMjhkOTU4MjRjY2IyODNiNGI5OTIzMGI3NzExZjk=' \
-L POST --url "http://localhost:7080/alfresco/s/bulkfsimport/initiate" \
--data "targetPath=/Company%20Home/Sites/reports/documentLibrary&sourceDirectory=/reports"

It works fine.

Logs: https://pastebin.com/pDUcFsDf

But my issue is still here: content of the document (here : 'Blabla') cannot be search (not indexed). And, I need to perform automatic import of documents (every 30 minutes) having index of content of document (same feature than manual import).

Regards,

cristinamr · ‎08-10-2021

@ludoADV wrote:

I used curl command to upload 1 txt file (with metadata):

curl 'http://localhost:7080/alfresco/service/bulkfsimport/initiate' \
-H 'Authorization: Basic VElDS0VUX2QyMGVlMzMyZWViMjhkOTU4MjRjY2IyODNiNGI5OTIzMGI3NzExZjk=' \
-L POST --url "http://localhost:7080/alfresco/s/bulkfsimport/initiate" \
--data "targetPath=/Company%20Home/Sites/reports/documentLibrary&sourceDirectory=/reports"

It works fine.

This is quite interesting. So we can discard Solr (and your server) as a problem.

@ludoADV wrote:
..
But my issue is still here: content of the document (here : 'Blabla') cannot be search (not indexed). And, I need to perform automatic import of documents (every 30 minutes) having index of content of document (same feature than manual import).

Could you please give us step by step what are you doing? If you can attach photos, logs, etc.. can be very useful. I have the feeling we are very close to know the problem (and its solution).

Cheers,

Cris.

--
VenziaIT: helping companies since 2005! Our ECM products: AQuA & Seidoc

ludoADV · ‎08-10-2021

- From docker instance 'change-acs-share-port-demo_alfresco_1', /reports directory is binded to /opt/reports from Ubuntu Linux host server.

[alfresco@50db55c3e805 tomcat]$ df -h
Filesystem                         Size  Used Avail Use% Mounted on
[...]
/dev/mapper/ubuntu--vg-ubuntu--lv   24G   12G   12G  50% /reports
[...]

- From /opt/reports, lot of PDF files are stored (in /opt/reports and subfolders). Only PDF files will be uploaded.

root@dms2:/opt/reports# ll */*
-rw-rw-rw- 1 root root 2293516 Aug 10 13:39 Folder2/Predictions-2018_Costin-Raiu.pdf

Folder1/subA:
total 1028
drwxr-xr-x 2 root root    4096 Aug 10 13:39  ./
drwxr-xr-x 4 root root    4096 Aug 10 13:38  ../
-rw-rw-rw- 1 root root 1042217 Aug 10 13:39 'April 2021 Monthly Intelligence Dispatch - EN.pdf'

Folder1/subB:
total 2612
drwxr-xr-x 2 root root    4096 Aug 10 13:39 ./
drwxr-xr-x 4 root root    4096 Aug 10 13:38 ../
-rw-rw-rw- 1 root root 2662581 Aug 10 13:39 The-cold-cyberwar_Vicente-Diaz.pdf

- I crhttps://pastebin.com/myTchQgR eated 'reports' PUBLIC site

- Now, I would like to upload PDF files and create automatically, when needed, subfolders in /Company Home/Sites/reports/documentLibrary. I use cURL command to try it:

- Get ticket:

curl --header 'Content-Type: application/json' --request POST --data '{"userId":"admin","password":"admin"}' http://localhost:7080/alfresco/api/-default-/public/authentication/versions/1/tickets

- Upload PDF files:

curl 'http://localhost:7080/alfresco/service/bulkfsimport/initiate' \
          -H 'Authorization: Basic VElDS0VUXzQ3M2Q3OWY4OTdjZWFkYjFkYjZkODFjODJiZTY3YzY4Y2ZhN2E4NzM=' \
          -L POST --url "http://localhost:7080/alfresco/s/bulkfsimport/initiate" --data "targetPath=/Company%20Home/Sites/reports/documentLibrary&sourceDirectory=/reports"

Logs:

Hyland Connect

Imported files are not indexed