topic Re: Imported files are not indexed in Alfresco Forum

Imported files are not indexed

ludoADV — Thu, 05 Aug 2021 13:04:34 GMT

Hello,

From standard installation and configuration, files imported via GUI are correctly indexed but not imported files.

Any solution ?

Regards,

Re: Imported files are not indexed

cristinamr — Thu, 05 Aug 2021 13:44:01 GMT

Hi! Could you please attach your logs? Looks like you have a problem with Solr, but we need to know if there are errors.

Cheers,

Cris.

Re: Imported files are not indexed

ludoADV — Thu, 05 Aug 2021 14:04:41 GMT

Can you give me instructions to get log file(s) you desire ? (sorry, I'm newbie on this solution).

Re: Imported files are not indexed

cristinamr — Thu, 05 Aug 2021 14:26:07 GMT

Sure. Which Alfresco version are you using?

Re: Imported files are not indexed

ludoADV — Thu, 05 Aug 2021 14:31:15 GMT

Latest Alfresco ACS Community Edition release available : 7.1

Deployed with docker-compose

Re: Imported files are not indexed

cristinamr — Thu, 05 Aug 2021 14:39:19 GMT

Go to your installation root path, e.g. /opt/alfresco, then launch this query:

sudo docker-compose logs -f --tail 500 docker-compose_solr6_1

Where "docker-compose_solr6_1" is the container name you want to check

In order to know the names, launch this query:

sudo docker-compose ps

This is what I recommend you:

- Stop you alfresco.

- Start it.

- Check the logs.

- Try to reproduce the problem.

- Check again the logs and let us know.

Cheers!

Re: Imported files are not indexed

ludoADV — Thu, 05 Aug 2021 14:43:57 GMT

No logs found ?!?

root@dms:/home/ludo# docker ps
CONTAINER ID   IMAGE                                                     COMMAND                  CREATED       STATUS          PORTS                                                                                                                                                                                NAMES
60dcc9c8c7db   alfresco/alfresco-acs-nginx:3.1.1                         "/entrypoint.sh"         4 hours ago   Up 13 seconds   80/tcp, 0.0.0.0:8080->8080/tcp, :::8080->8080/tcp                                                                                                                                    docker-compose_proxy_1
2ed5fd33f711   alfresco/alfresco-activemq:5.16.1                         "/bin/sh -c './init.…"   4 hours ago   Up 14 seconds   0.0.0.0:5672->5672/tcp, :::5672->5672/tcp, 0.0.0.0:8161->8161/tcp, :::8161->8161/tcp, 0.0.0.0:61613->61613/tcp, :::61613->61613/tcp, 0.0.0.0:61616->61616/tcp, :::61616->61616/tcp   docker-compose_activemq_1
1bdb20d77fc2   alfresco/alfresco-search-services:2.0.2                   "/bin/sh -c '$DIST_D…"   4 hours ago   Up 14 seconds   10001/tcp, 0.0.0.0:8083->8983/tcp, :::8083->8983/tcp                                                                                                                                 docker-compose_solr6_1
e27a8c0ac49e   postgres:13.1                                             "docker-entrypoint.s…"   4 hours ago   Up 14 seconds   0.0.0.0:5432->5432/tcp, :::5432->5432/tcp                                                                                                                                            docker-compose_postgres_1
9db0d9b42269   alfresco/alfresco-transform-core-aio:2.5.2                "/bin/sh -c 'java $J…"   4 hours ago   Up 14 seconds   0.0.0.0:8090->8090/tcp, :::8090->8090/tcp                                                                                                                                            docker-compose_transform-core-aio_1
df6eb4503293   alfresco/alfresco-content-repository-community:7.1.0-A9   "catalina.sh run -se…"   4 hours ago   Up 14 seconds   8000/tcp, 8080/tcp, 10001/tcp                                                                                                                                                        docker-compose_alfresco_1
a86becfd8167   alfresco/alfresco-share:7.1.0-M2                          "/usr/local/tomcat/s…"   4 hours ago   Up 14 seconds   8000/tcp, 8080/tcp                                                                                                                                                                   docker-compose_share_1
root@dms:/home/ludo# sudo docker-compose logs -f --tail 500 docker-compose_solr6_1
ERROR: No such service: docker-compose_solr6_1

Re: Imported files are not indexed

ludoADV — Thu, 05 Aug 2021 14:56:20 GMT

Logs not found !?

root@dms:/home/ludo# docker ps
CONTAINER ID   IMAGE                                                     COMMAND                  CREATED       STATUS          PORTS                                                                                                                                                                                NAMES
60dcc9c8c7db   alfresco/alfresco-acs-nginx:3.1.1                         "/entrypoint.sh"         4 hours ago   Up 13 seconds   80/tcp, 0.0.0.0:8080->8080/tcp, :::8080->8080/tcp                                                                                                                                    docker-compose_proxy_1
2ed5fd33f711   alfresco/alfresco-activemq:5.16.1                         "/bin/sh -c './init.…"   4 hours ago   Up 14 seconds   0.0.0.0:5672->5672/tcp, :::5672->5672/tcp, 0.0.0.0:8161->8161/tcp, :::8161->8161/tcp, 0.0.0.0:61613->61613/tcp, :::61613->61613/tcp, 0.0.0.0:61616->61616/tcp, :::61616->61616/tcp   docker-compose_activemq_1
1bdb20d77fc2   alfresco/alfresco-search-services:2.0.2                   "/bin/sh -c '$DIST_D…"   4 hours ago   Up 14 seconds   10001/tcp, 0.0.0.0:8083->8983/tcp, :::8083->8983/tcp                                                                                                                                 docker-compose_solr6_1
e27a8c0ac49e   postgres:13.1                                             "docker-entrypoint.s…"   4 hours ago   Up 14 seconds   0.0.0.0:5432->5432/tcp, :::5432->5432/tcp                                                                                                                                            docker-compose_postgres_1
9db0d9b42269   alfresco/alfresco-transform-core-aio:2.5.2                "/bin/sh -c 'java $J…"   4 hours ago   Up 14 seconds   0.0.0.0:8090->8090/tcp, :::8090->8090/tcp                                                                                                                                            docker-compose_transform-core-aio_1
df6eb4503293   alfresco/alfresco-content-repository-community:7.1.0-A9   "catalina.sh run -se…"   4 hours ago   Up 14 seconds   8000/tcp, 8080/tcp, 10001/tcp                                                                                                                                                        docker-compose_alfresco_1
a86becfd8167   alfresco/alfresco-share:7.1.0-M2                          "/usr/local/tomcat/s…"   4 hours ago   Up 14 seconds   8000/tcp, 8080/tcp                                                                                                                                                                   docker-compose_share_1
root@dms:/home/ludo# sudo docker-compose logs -f --tail 500 docker-compose_solr6_1
ERROR: No such service: docker-compose_solr6_1

Re: Imported files are not indexed

ludoADV — Thu, 05 Aug 2021 15:15:53 GMT

Logs after restarted and reimported files: https://pastebin.com/JjmMPM1s

Re: Imported files are not indexed

cristinamr — Fri, 06 Aug 2021 09:08:30 GMT

Hi, @ludoADV !

solr6_1               | 2021-08-05 15:06:11.913 ERROR (org.alfresco.solr.AlfrescoCoreAdminHandler@22ee2d0_Worker-8) [   ] o.a.s.t.AbstractTracker [alfresco / ACL@788992700 / IT #1628175970000] Tracking failure. See the stacktrace below for further details.
solr6_1               | java.net.SocketException: Connection reset

Your installation is the one by default? In case yes, there is a bug recognized and fixed with Search Service 2.0.

Could you please attach too Alfresco log, please? I want to see if the problem is Solr itself or it's something becoming from Alfresco server side.

Cheers,

Cris.

Cheers.

P.S.: Maybe @angelborroy can help you with this issue.

Re: Imported files are not indexed

ludoADV — Fri, 06 Aug 2021 09:14:44 GMT

I confirm I used community-docker-compose.yml

See logs: https://pastebin.com/1jyzkAxZ

Re: Imported files are not indexed

ludoADV — Fri, 06 Aug 2021 09:15:13 GMT

Also, where is stored status.xml ?

Re: Imported files are not indexed

cristinamr — Fri, 06 Aug 2021 09:31:11 GMT

@ludoADV wrote:
I confirm I used community-docker-compose.yml

This is not an Alfresco version. In your log I can see it:

alfresco_1            | 2021-08-06 07:43:20,185  INFO  [service.descriptor.DescriptorService] [main] Alfresco Content Services started (Community). Current version: 7.0.0 (rdf924796-blocal) schema 14,002. Originally installed version: 7.0.0 (rdf924796-blocal) schema 14,002.

You are using Current version: 7.0.0 (rdf924796-blocal) schema 14,002.

In your log, I cannot see any error related to Solr (is it working today the indexation?) but, this morning you have a failure with your database:

alfresco_1            | 2021-08-06 07:41:10,226  ERROR [repo.transaction.RetryingTransactionHelper] [http-nio-8080-exec-8] Rollback failure.  Normal retry behaviour will resume.
alfresco_1            | org.springframework.transaction.TransactionSystemException: JDBC rollback failed; nested exception is org.postgresql.util.PSQLException: This connection has been closed.

Then I can see your alfresco restarted, I can see the following error:

alfresco_1            | 2021-08-06 09:05:51,333  ERROR [extensions.webscripts.AbstractRuntime] [http-nio-8080-exec-8] Exception from executeScript: 07060004 Script url /bulkfsimport/initiate does not support the method GET
alfresco_1            | org.springframework.extensions.webscripts.WebScriptException: 07060004 Script url /bulkfsimport/initiate does not support the method GET

But this issue is caused by bulk import tool, nothing to see with the original error.

The problem I can see is that you have provided me a solr log from yesterday with a concrete error and today you have provided me an Alfresco log in a diferent day with nothing related to the original error (logs are getting from different days and time!).

When you want to see a concrete error the best option is stop your alfresco, start it, reproduce the problem and paste Alfresco and Solr logs during this preiod of time. So if you are having troubles, it's provably the technical erro will appear on these lines. Could you please do this?

Also, where is stored status.xml ?

What is it related? Bulk import tool?

Cheers,

Cristina.

Re: Imported files are not indexed

ludoADV — Fri, 06 Aug 2021 09:45:06 GMT

alfresco logs: https://pastebin.com/PMekdh39

solr logs: https://pastebin.com/R6jYfMHR

Re: Imported files are not indexed

cristinamr — Fri, 06 Aug 2021 10:19:07 GMT

Nothing related to Solr but you have several errors related to Bulk Import:

[36malfresco_1            |[0m 2021-08-06 09:41:47,319  ERROR [extensions.webscripts.AbstractRuntime] [http-nio-8080-exec-4] Exception from executeScript: 07060000 Script url /bulkfsimport/initiate does not support the method GET
[36malfresco_1            |[0m org.springframework.extensions.webscripts.WebScriptException: 07060000 Script url /bulkfsimport/initiate does not support the method GET

Your issue is related with those documents you are trying to import and is getting this error.

Which steps are you performing in order to use Bulk Import?

Re: Imported files are not indexed

ludoADV — Fri, 06 Aug 2021 11:08:15 GMT

I followed official doc using http://dms:8080/alfresco/service/bulkfsimport

Docs have been correctly imported, I can see and open them. But cannot search pattern in file content.

Re: Imported files are not indexed

cristinamr — Fri, 06 Aug 2021 11:43:56 GMT

If you are using the console, there must be something wrong with the steps your are performing because you have several errors related to bulk import (and most provably that's why those documents are not indexed). Could you please try with curl command? An example.

Docs have been correctly imported, I can see and open them. But cannot search pattern in file content.

Maybe you have a problem with status.xml file. BTW, http://dms:8080/alfresco/service/bulk/import/filesystem/status.xml there you have the status.xml file (or similar to that path). If you want an indexation of the properties you'll need to prepare the xml in order to be injected with those documents.

Re: Imported files are not indexed

ludoADV — Fri, 06 Aug 2021 12:26:28 GMT

root@dms:/opt/reports# curl -v -u admin:admin -X POST "http://dms:8080/alfresco/service/bilkfsimport/initiate" --url "http://dms:8080/alfresco/s/bulkfsimport/initiate" --data "targetPath=/Sites/reports/documentLibrary/&sourceDirectory=/opt/reports/CERTs/Avatars-copycats_Felix-Aime_Ronan-Mouchoux.pdf&existingFileMode=REPLACE"

Note: Unnecessary use of -X or --request, POST is already inferred.

* Trying 127.0.1.1:8080...

* TCP_NODELAY set

* Connected to dms (127.0.1.1) port 8080 (#0)

* Server auth using Basic with user 'admin'

> POST /alfresco/service/bilkfsimport/initiate HTTP/1.1

> Host: dms:8080

> Authorization: Basic YWRtaW46YWRtaW4=

> User-Agent: curl/7.68.0

> Accept: */*

> Content-Length: 149

> Content-Type: application/x-www-form-urlencoded

* upload completely sent off: 149 out of 149 bytes

* Mark bundle as not supporting multiuse

< HTTP/1.1 404

< Server: nginx/1.18.0

< Date: Fri, 06 Aug 2021 12:25:25 GMT

< Content-Type: text/html;charset=UTF-8

< Transfer-Encoding: chunked

< Connection: keep-alive

< X-Frame-Options: SAMEORIGIN

< Cache-Control: no-cache

< Expires: Thu, 01 Jan 1970 00:00:00 GMT

< Pragma: no-cache

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">

<head>

<title>Web Script Status 404 - Not Found</title>

</head>

<body>

<div>

<table>

<tr>

<td><span class="title">Web Script Status 404 - Not Found</span></td>

</tr>

</table>

<br/>

<table>

<tr><td>The Web Script <a href="%2Falfresco%2Fservice%2Fbilkfsimport%2Finitiate">/alfresco/service/bilkfsimport/initiate</a> has responded with a status of 404 - Not Found.</td></tr>

</table>

<br/>

<table>

<tr><td><b>404 Description:</b></td><td> Requested resource is not available.</td></tr>

<tr><td><b>Message:</b></td><td>07060004 Script url /bilkfsimport/initiate does not map to a Web Script.</td></tr>

<tr><td><b>Server</b>:</td><td>Community v7.0.0 (rdf924796-blocal) schema 14,002</td></tr>

</table>

</div>

</body>

</html>

* Connection #0 to host dms left intact

Note: Unnecessary use of -X or --request, POST is already inferred.

* Found bundle for host dms: 0x5626c5c97c70 [serially]

* Can not multiplex, even if we wanted to!

* Re-using existing connection! (#0) with host dms

* Connected to dms (127.0.1.1) port 8080 (#0)

* Server auth using Basic with user 'admin'

> POST /alfresco/s/bulkfsimport/initiate HTTP/1.1

> Host: dms:8080

> Authorization: Basic YWRtaW46YWRtaW4=

> User-Agent: curl/7.68.0

> Accept: */*

> Content-Length: 149

> Content-Type: application/x-www-form-urlencoded

* upload completely sent off: 149 out of 149 bytes

* Mark bundle as not supporting multiuse

< HTTP/1.1 302

< Server: nginx/1.18.0

< Date: Fri, 06 Aug 2021 12:25:26 GMT

< Content-Type: text/html;charset=UTF-8

< Transfer-Encoding: chunked

< Connection: keep-alive

< Cache-Control: no-cache

< Expires: Thu, 01 Jan 1970 00:00:00 GMT

< Pragma: no-cache

< Location: /alfresco/s/bulkfsimport/status

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">

<head>

<title>Web Script Status 302 - Moved Temporarily</title>

</head>

<body>

<div>

<table>

<tr>

<td><span class="title">Web Script Status 302 - Moved Temporarily</span></td>

</tr>

</table>

<br/>

<table>

<tr><td>The Web Script <a href="%2Falfresco%2Fs%2Fbulkfsimport%2Finitiate">/alfresco/s/bulkfsimport/initiate</a> has responded with a status of 302 - Moved Temporarily.</td></tr>

</table>

<br/>

<table>

<tr><td><b>302 Description:</b></td><td> The resource has temporarily moved to another location, but that future references should still use the original URI to access the resource.</td></tr>

<tr><td><b>Message:</b></td><td></td></tr>

<tr><td><b>Server</b>:</td><td>Community v7.0.0 (rdf924796-blocal) schema 14,002</td></tr>

<tr><td><b>Diagnostics</b>:</td><td><a href="/alfresco/s/script/org/alfresco/repository/bulkfilesystemimport/initiate.post">Inspect Web Script (org/alfresco/repository/bulkfilesystemimport/initiate.post)</a></td></tr>

</table>

</div>

</body>

</html>

* Connection #0 to host dms left intact

Re: Imported files are not indexed

ludoADV — Fri, 06 Aug 2021 12:27:20 GMT

About status.xml:

http://dms:8080/alfresco/service/bulk/import/filesystem/status.xml returns error 404 - File not found

Re: Imported files are not indexed

abhinavmishra14 — Fri, 06 Aug 2021 12:34:03 GMT

@ludoADV wrote:

Can you give me instructions to get log file(s) you desire ? (sorry, I'm newbie on this solution).

In additon try enabling these logs as debug and then share the logs as @cristinamr mentioned there is nothing specific to solr. The below logs would intercept all solr httpcalls and trackers

Log settings on alfresco layer:

#Solr query and httpclient logs
log4j.logger.org.alfresco.solr.query.AbstractQParser=DEBUG
log4j.logger.org.alfresco.repo.search.impl.solr.SolrQueryHTTPClient=DEBUG

Logs settings on search service layer:

#Indexing tracker logs
log4j.logger.org.alfresco.solr.tracker.AclTracker=DEBUG
log4j.logger.org.alfresco.solr.tracker.ContentTracker=DEBUG
log4j.logger.org.alfresco.solr.tracker.MetadataTracker=DEBUG
log4j.logger.org.alfresco.solr.tracker.ModelTracker=DEBUG

The above logs may give some insights.