topic Re: Indexing only works if I upload the file using Share GUI in Alfresco Forum

Indexing only works if I upload the file using Share GUI

Jhousyfran — Tue, 03 Mar 2020 18:53:46 GMT

When uploading a file, I expect the content to be indexed so that I am able to search it. This works when I upload the file to the Alfresco Share interface.

However, when I use the CMIS import tool, webdav, or the bulk filing system, the metadata is indexed, but the content isn't.

All the metadata looks the same. And even when I delete data from Solr to force a reindexing, the only content that is indexed is the content of the files I uploaded with Share GUI.

When I increase the Solr debug logging level (like this: https://docs.alfresco.com/5.2/tasks/set-solr-log4j.html), the logs of the files that were sent through the interface and indexed are the same as the logs of the files that were sent via WebDav and not indexed.

File indexed by the interface:

2020-02-21 21:36:40.251 DEBUG (org.alfresco.solr.AlfrescoCoreAdminHandler@548d708a_Worker-22) [ ] o.a.s.t.MetadataTracker Node [id=879, nodeRef=workspace://SpacesStore/a6ffb77b-7690-4f3f-8a73-074dc406bc46, txnId=27, status=UPDATED, tenant=, aclId=11, shardPropertyValue=null]

File sent via WebDav:

2020-02-21 21:39:10.113 DEBUG (org.alfresco.solr.AlfrescoCoreAdminHandler@548d708a_Worker-36) [ ] o.a.s.t.MetadataTracker Node [id=885, nodeRef=workspace://SpacesStore/f2510e59-43ca-41e2-899f-a574bea41222, txnId=33, status=UPDATED, tenant=, aclId=11, shardPropertyValue=null]

I couldn't find a solution to this issue.

This is easy to replicate with the docker community deployment in version 6.2.0-ga.

The log files also do not report any errors.

Re: Indexing only works if I upload the file using Share GUI

marcoslessa — Mon, 09 Mar 2020 18:45:14 GMT

I have the same problem.

Can anyone help ?

Re: Indexing only works if I upload the file using Share GUI

EddieMay — Wed, 11 Mar 2020 10:31:05 GMT

Hi @marcoslessa & @Jhousyfran,

Could you tell us a little more about your environments please? This might help us determine if it's a bug or a configuration issue - or something else entirely!

Thanks,

Re: Indexing only works if I upload the file using Share GUI

Jhousyfran — Wed, 11 Mar 2020 14:25:57 GMT

Operating System: Ubuntu 18.04

I'm using the container docker:
- Alfresco 5.2 Platform
- Alfresco Share 5.2
- Solr 6
- Postgres 9.4

###############################
## Common Alfresco Properties #
###############################

#
# Sample custom content and index data location
#
dir.root=/usr/local/alfresco/alf_data

alfresco.context=alfresco
alfresco.host=127.0.0.1
alfresco.port=8080
alfresco.protocol=http

share.context=share
share.host=127.0.0.1
share.port=8080
share.protocol=http

### database connection properties ###
db.driver=org.postgresql.Driver
db.username=alfresco
db.password=alfresco
db.name=alfresco
db.url=jdbc: postgresql://db:5432/${db.name}
db.pool.max=275
db.pool.validate.query=SELECT 1

# The server mode. Set value here
# UNKNOWN | TEST | BACKUP | PRODUCTION
system.serverMode=UNKNOWN

### FTP Server Configuration ###
ftp.enabled=false
ftp.port=2121

### CIFS Server Configuration ###
cifs.enabled=false

### RMI registry port for JMX ###
alfresco.rmi.services.port=50500

### External executable locations ###
ooo.exe=soffice.bin
ooo.host=libreoffice
ooo.enabled=true
ooo.port=8100
img.exe=/usr/bin/convert
alfresco-pdf-renderer.root=/usr/local/alfresco/alfresco-pdf-renderer
alfresco-pdf-renderer.exe=${alfresco-pdf-renderer.root}/alfresco-pdf-renderer
jodconverter.enabled=false
jodconverter.officeHome=/opt/libreoffice
jodconverter.portNumbers=8100

### E-mail site invitation setting ###
notification.email.siteinvite=false

### License location ###
dir.license.external=/usr/local/alfresco

### Allow extended ResultSet processing
security.anyDenyDenies=false

### Smart Folders Config Properties ###
smart.folders.enabled=false

### Remote JMX (Default: disabled) ###
alfresco.jmx.connector.enabled=false

### IMAP Server Configuration ###
imap.server.enabled=false

alfresco.rmi.services.host=0.0.0.0

#Smart Folders Config Properties
smart.folders.enabled=false
smart.folders.model=alfresco/model/smartfolder-model.xml
smart.folders.model.labels=alfresco/messages/smartfolder-model

### Solr indexing ###
index.subsystem.name=solr6
solr.host=solr6
solr.port=8983
solr.port.ssl=8443
solr.secureComms=none

## OCR
ocr.command=/usr/local/alfresco/ocr.sh
ocr.output.verbose=true
ocr.output.file.prefix.command=
ocr.extra.commands=
ocr.server.os=linux

## Audit Log
audit.enabled=true
audit.alfresco-access.enabled=true
audit.alfresco-access.sub-actions.enabled=false

## Aggregate Content Store
dir.contentstore1=${dir.root}/tier1
dir.contentstore2=${dir.root}/tier2
dir.contentstore3=${dir.root}/tier3

## S3 Store
# s3.bucketName=alfresco
# s3.bucketLocation=
# s3.accessKey=
# s3.secretKey=

## IMAP
imap.server.enabled=true
imap.server.port=9143
imap.server.attachments.extraction.enabled=true
# imap.server.host=mydomain.com.br
alfresco.protocol=https
alfresco.host=mydomain.com.br
alfresco.port=443

## FTP
ftp.enabled=true
ftp.port=9021

## CIFS
cifs.enabled=true
cifs.serverName=cifs
cifs.domain=mydomain.com.br
cifs.tcpipSMB.port=9445
cifs.netBIOSSMB.namePort=9137
cifs.netBIOSSMB.datagramPort=9138
cifs.netBIOSSMB.sessionPort=9139

Re: Indexing only works if I upload the file using Share GUI

EddieMay — Thu, 12 Mar 2020 10:46:36 GMT

Hi @Jhousyfran,

Thanks for the info update - I'll see if this helps us figure out what's going on.

Re: Indexing only works if I upload the file using Share GUI

angelborroy — Fri, 13 Mar 2020 15:05:51 GMT

The component tracking the content from Alfresco Repository is named Content Tracker. You can find details on the behaviour in https://hub.alfresco.com/t5/alfresco-content-services-blog/the-alfresco-content-tracker/ba-p/288185

Can you add DEBUG log for org.alfresco.solr.tracker.ContentTracker class to have additional information on this problem?

Re: Indexing only works if I upload the file using Share GUI

Jhousyfran — Mon, 16 Mar 2020 15:45:24 GMT

Hello guys,

After hours of trying to make Webdav indexing work, I decided to install Alfresco on my personal computer, and to my surprise, it worked on there. And I didn't do anything differently from what I did on the server.

My personal computer's operating system is ubuntu 18.04, and the server I'm having a problem with is an image of the ubuntu 18.04 Server on AWS, I also started up a server with Ubuntu 18.04 Server on Digital Ocean and Webdav indexing didn't work.

Does anyone have any idea of what could be going on? The logs are the same, there are no errors.

Re: Indexing only works if I upload the file using Share GUI

marcoslessa — Wed, 18 Mar 2020 13:17:07 GMT

Re: Indexing only works if I upload the file using Share GUI

marcoslessa — Tue, 28 Apr 2020 19:36:24 GMT

Can anyone help us ?

Re: Indexing only works if I upload the file using Share GUI

EddieMay — Wed, 29 Apr 2020 09:46:49 GMT

Hi @marcoslessa & @Jhousyfran,

I'm asking around to see if we can progress this.

Cheers,

Re: Indexing only works if I upload the file using Share GUI

Zozo — Sat, 19 Dec 2020 13:15:53 GMT

Hi,

Any solution regarding this issue? I have the same issue with my installation, the contents of documents is only indexed if I upload them through the user GUI. Same issue for documents uploaded with IMAP.

Thanks,

Re: Indexing only works if I upload the file using Share GUI

ludoADV — Fri, 06 Aug 2021 08:13:25 GMT

Hi,

Same issue. Any idea to fix it ?

Regards,

Re: Indexing only works if I upload the file using Share GUI

ulrichj — Tue, 16 Nov 2021 20:11:24 GMT

hello,

I have the same issue with webDav or CMIS

Ubuntu 18.04.5 LTS

alfresco 6.2 with Docker-compose

I have the same issue with Alfresco 7.0

search query : a word in the content.

Object indexed (with Share)

Thanks

Re: Indexing only works if I upload the file using Share GUI

vchiarello — Sun, 28 Nov 2021 20:07:42 GMT

Hi all,

have anyone a solution for this issue?

I have the same problem on a Community - 7.1.0 (re109bcda-blocal) installation in a docker container on a windows 10 PC.

If I upload a text file from alfresco share and I search for content all works well.

If I upload the same file from REST api I'm not able to search its content.

Thanks in advance for any contribution

Vito

Re: Indexing only works if I upload the file using Share GUI

dgarcie — Thu, 16 Dec 2021 16:12:04 GMT

Hi,

We are having the same problem. If documents are uploaded through Share and properties set there, we can find the file through the advanced search with no problems.

However, documents uploaded through the REST API with their properties set can't be found using specific custom fields in the custom forms in advanced search, although using a query (eg. cg:customType:NiceCompany) in the simple search bar manages to find the file. The thing that is more interesting though is that if the properties of the file uploaded throught the REST API are modified throught the Share UI then the file CAN be found using advanced search, but not before.

I'm really confused with this. It seems that the REST API uploaded file is indexed but advanced search only manages to find it through custom forms if any property is modified latter through Share.

We are using a Docker deployment with Alfresco 6.2 version.

Re: Indexing only works if I upload the file using Share GUI

scarrasco85 — Wed, 09 Feb 2022 11:45:43 GMT

Hello everyone, I have the same problem using Alfresco 6.1 with docker. Someone was able to solve it.
Thank you very much in any case

Re: Indexing only works if I upload the file using Share GUI

gkeuss — Thu, 10 Feb 2022 15:32:16 GMT

Hello,

We have the same issue using Alfresco 6.2 with docker.

Content is indexed when importing a document, but not when imported with bulk import.

Re: Indexing only works if I upload the file using Share GUI

scarrasco85 — Mon, 14 Feb 2022 15:37:13 GMT

Hi, Did you find any solution?

Regards

Re: Indexing only works if I upload the file using Share GUI

gkeuss — Wed, 16 Feb 2022 13:18:49 GMT

Hello,

I can reproduce the Issue with Alfreco Content Services 7.2

Re: Indexing only works if I upload the file using Share GUI

angelborroy — Wed, 16 Feb 2022 14:22:38 GMT

I made a local test.

Docker Compose deployment with https://github.com/alfresco/alfresco-docker-installer (choosing 7.1 version).

Upload a new file with following command (not accesing Share or any other app)

curl -u admin:admin -X POST http://127.0.0.1:8080/
alfresco/api/-default-/public/alfresco/versions/1/nodes/-my-/children -F filedata=@test.txt
{"entry":{"isFile":true,"createdByUser":{"id":"admin","displayName":"Administrator"},"modifiedAt":"2022-02-16T14:17:58.567+0000","nodeType":"cm:content","content":{"mimeType":"text/plain","mimeTypeName":"Plain Text","sizeInBytes":10,"encoding":"UTF-8"},"parentId":"f3871c51-de56-436e-8001-062086af88f5","aspectNames":["cm:versionable","cm:auditable"],"createdAt":"2022-02-16T14:17:58.567+0000","isFolder":false,"modifiedByUser":{"id":"admin","displayName":"Administrator"},"name":"test.txt","id":"5d16aa61-2f8f-4744-afb9-d892a5566343","properties":{"cm:versionLabel":"1.0","cm:versionType":"MAJOR"}}}

Waited 10 seconds (to be sure the content is indexed) and performing the query directly in SOLR (my file included "quidditch" on the content):

http://127.0.0.1:8983/solr/alfresco/select?indent=on&q=TEXT:%22quidditch%22&wt=json

  "response":{"numFound":1,"start":0,"docs":[
      {
        "DBID":864,
        "id":"_DEFAULT_!8000000000000360"}]
  }

Do you have additional instructions on how to reproduce the issue?