topic Re: Advanced search SLOW! in Alfresco Archive

Advanced search SLOW!

lmoulin — Fri, 02 Mar 2007 11:09:29 GMT

Hello,I have a large number of documents in the Alfresco repository (~100 000 documents).The advanced search takes lots of time to return the results (~more than 60 seconds)I use only the custom criteria to perform the advanced search.I donâ€™t use the google like search and the full text search.I h

Re: Advanced search SLOW!

lmoulin — Fri, 02 Mar 2007 15:12:35 GMT

See the log of Alfresco system:
16:08:43,754 DEBUG [org.alfresco.web.bean.BrowseBean] Invalidating browse components…
16:09:02,916 DEBUG [org.alfresco.web.bean.BrowseBean] Invalidating browse components…
16:10:55,302 DEBUG [org.alfresco.web.bean.BrowseBean] Search results returned: 100
16:10:55,595 DEBUG [org.alfresco.web.bean.BrowseBean] Time to query and build map nodes: 112381ms

Re: Advanced search SLOW!

andy — Fri, 02 Mar 2007 15:30:47 GMT

Hi

Exactly what query options are you selecting?

Andy

Re: Advanced search SLOW!

lmoulin — Mon, 05 Mar 2007 13:39:23 GMT

The query is:
DEBUG [org.alfresco.web.bean.SearchContext] Query: +@\{my.new.model\}erd_commercialisateur:"GAZ ELECTRICITE DE GRENOBLE" AND (( TYPE:"{my.new.model}custom_root_type" OR TYPE:"{http://www.alfresco.org/model/content/1.0}folder" ))

DEBUG [org.alfresco.repo.search.impl.lucene.LuceneQueryParser] Using Alfresco Lucene Query Parser for query: +@\{my.new.model\}erd_commercialisateur:"GAZ ELECTRICITE DE GRENOBLE" AND (( TYPE:"{my.new.model}custom_root_type" OR TYPE:"{http://www.alfresco.org/model/content/1.0}folder" ))

I have created a new type 'custom_root_type' and a sub type 'erd'. I send you the full declaration of these customs types:
<types>
   <!– Super type for all custom types –>
   <type name="my:custom_root_type">
      <title>Custom Root Type</title>
      <parent>cm:content</parent>
      <properties>
         <property name="my:archive_id">
            <type>d:text</type>
         </property>
      </properties>
   </type>
   <type name="my:erd">
      <title>xxxx</title>
      <parent>my:custom_root_type</parent>
      <properties>
         <property name="my:erd_commercialisateur">
            <type>d:text</type>
         </property>
         <property name="my:erd_num_bordereau">
            <type>d:text</type>
         </property>
         <property name="my:erd_num_facture">
            <type>d:text</type>
         </property>
         <property name="my:erd_date_facture">
            <type>d:date</type>
         </property>
         <property name="my:erd_numero_pdl">
            <type>d:text</type>
         </property>
      </properties>
   </type>
</types>

Thanks a lot for your help,
Luc

Re: Advanced search SLOW!

andy — Mon, 05 Mar 2007 16:23:39 GMT

Hi

Can you tell us which version of Alfresco you are using, what Database, what version you started with and what upgrades you have done (if any)?

Is the performance the same for the search "cold" and then run again?
Is the serach also slow for an admin user?

Cheers

Andy

Re: Advanced search SLOW!

lmoulin — Mon, 05 Mar 2007 16:43:40 GMT

Hi,
I use Alfresco 1.4. It is a native version.
I have a PostGreSQL 8.1.3 database (postgresql-8.1-408.jdbc3.jar client):
hibernate.dialect=org.hibernate.dialect.PostgreSQLDialect

The â€˜coldâ€™ search takes around 100 seconds but if I run again the same query, the search takes 5 seconds !!!
If I am connected as admin user or a standard user, the search takes the same time.

My OS is MacPowerPC.

Regards,
Luc 😉

Re: Advanced search SLOW!

derek — Tue, 06 Mar 2007 08:43:45 GMT

Hi,

We only covered testing Oracle and MySQL for the early 1.4. This was extended to SQL Server and now includes PostgreSQL for Enterprise customers. If you run on MySQL you won't have the same issues.

Regards

Re: Advanced search SLOW!

lmoulin — Tue, 06 Mar 2007 09:32:11 GMT

Thanks a lot but for maintenances reasons I must use Alfresco with PostGreSQL.
But when Tomcat starts, the followings errors appears.
Do these errors have a link with my performance issue?

09:38:49,410 INFO [org.alfresco.service.descriptor.DescriptorService] Alfresco JVM - v1.5.0_06-112; maximum heap size 1012,625MB
09:38:49,411 INFO [org.alfresco.service.descriptor.DescriptorService] Alfresco started (Community Network): Current version 1.4.0 (build-105) schema 21 - Installed version 1.4.0 (build-105) schema 21
09:51:04,859 ERROR [org.alfresco.repo.content.transform.magick.AbstractImageMagickContentTransformer] ImageMagickContentTransformer not available: Failed to execute command: convert /opt/local/share/java/tomcat5/temp/Alfresco/ImageMagickContentTransformer_init_source_45594.gif /opt/local/share/java/tomcat5/temp/Alfresco/ImageMagickContentTransformer_init_target_45595.png
09:51:20,992 INFO [org.alfresco.repo.admin.patch.PatchExecuter] Vrification des correctifs appliquer …
09:51:21,040 INFO [org.alfresco.repo.admin.patch.PatchExecuter] Aucun correctif requis.
09:51:22,633 ERROR [org.alfresco.smb.protocol] Failed to get local domain/workgroup name, using default of WORKGROUP
09:51:22,634 ERROR [org.alfresco.smb.protocol] (This may be due to firewall settings or incorrect <broadcast> setting)
09:51:22,722 ERROR [org.alfresco.smb.protocol.netbios] NetBIOSNameServer setup error:
java.net.BindException: Permission denied
        at java.net.PlainDatagramSocketImpl.bind0(Native Method)
        at java.net.PlainDatagramSocketImpl.bind(PlainDatagramSocketImpl.java:82)
        at java.net.DatagramSocket.bind(DatagramSocket.java:368)
        at java.net.DatagramSocket.<init>(DatagramSocket.java:210)
        at java.net.DatagramSocket.<init>(DatagramSocket.java:261)
        at java.net.DatagramSocket.<init>(DatagramSocket.java:234)
        at org.alfresco.filesys.netbios.server.NetBIOSNameServer.openSocket(NetBIOSNameServer.java:1076)
        at org.alfresco.filesys.netbios.server.NetBIOSNameServer.run(NetBIOSNameServer.java:1548)
        at java.lang.Thread.run(Thread.java:613)
09:51:22,729 ERROR [org.alfresco.ftp.protocol] FTP Socket error
java.net.BindException: Permission denied
        at java.net.PlainSocketImpl.socketBind(Native Method)
        at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:359)
        at java.net.ServerSocket.bind(ServerSocket.java:319)
        at java.net.ServerSocket.<init>(ServerSocket.java:185)
        at java.net.ServerSocket.<init>(ServerSocket.java:141)
        at org.alfresco.filesys.ftp.FTPNetworkServer.run(FTPNetworkServer.java:372)
        at java.lang.Thread.run(Thread.java:613)
09:51:23,514 INFO [org.alfresco.service.descriptor.DescriptorService] Alfresco JVM - v1.5.0_06-112; maximum heap size 1012,625MB
09:51:23,515 INFO [org.alfresco.service.descriptor.DescriptorService] Alfresco started (Community Network): Current version 1.4.0 (build-105) schema 21 - Installed version 1.4.0 (build-105) schema 21
09:51:23,520 ERROR [org.alfresco.smb.protocol] Server error :
java.net.BindException: Permission denied
        at java.net.PlainSocketImpl.socketBind(Native Method)
        at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:359)
        at java.net.ServerSocket.bind(ServerSocket.java:319)
        at java.net.ServerSocket.<init>(ServerSocket.java:185)
        at java.net.ServerSocket.<init>(ServerSocket.java:141)
        at org.alfresco.filesys.smb.server.SessionSocketHandler.initialize(SessionSocketHandler.java:249)
        at org.alfresco.filesys.smb.server.NetBIOSSessionSocketHandler.createSessionHandlers(NetBIOSSessionSocketHandler.java:158)
        at org.alfresco.filesys.smb.server.SMBServer.run(SMBServer.java:487)
        at java.lang.Thread.run(Thread.java:613)

Luc

Re: Advanced search SLOW!

alexander — Tue, 06 Mar 2007 10:44:17 GMT

Most of the errors are based on the fact that user, under which process is started, does not have to required ports for FTP, SMB etc.

First error is due to the fact, that system can not find "convert" shell command - part of ImageMagic package.

It should not have any link to performance issues.

Thanks
Alexadner

Re: Advanced search SLOW!

lmoulin — Tue, 06 Mar 2007 10:53:53 GMT

Thanks,
I have a other information about my webapp.
Its name is 'erd' and not 'alfresco'.
Does this name have a link with my performance issue?

Luc

Re: Advanced search SLOW!

lmoulin — Tue, 06 Mar 2007 16:17:43 GMT

Theoretically,
The query '+@\{my.new.model\}erd_commercialisateur:"GAZ ELECTRICITE DE GRENOBLE" AND (( TYPE:"{my.new.model}custom_root_type" OR TYPE:"{http://www.alfresco.org/model/content/1.0}folder" )) ' returns 100 000 documents.

But, when I execute a query which returns only 10 documents, it is very faster (~10 seconds).

Why this big variation?

Thanks a lot
Luc

Re: Advanced search SLOW!

lmoulin — Tue, 06 Mar 2007 16:37:02 GMT

My database has the following properties:
CREATE DATABASE "ERD1.0"
WITH OWNER = erd
ENCODING = 'LATIN1'
TABLESPACE = pg_default;

Re: Advanced search SLOW!

andy — Tue, 06 Mar 2007 16:49:57 GMT

Hi

As Derek says, Postgress was not supported or tested on V1.4 community. Issues with its use - mainly performance have been fixed in the enterprise code. You can get these fixes by paying for support or you will have to wait until the fixes are in a later community release.

None of the other issues have anything to do with your performance problem.

Regards

Andy

Re: Advanced search SLOW!

lmoulin — Fri, 09 Mar 2007 13:26:01 GMT

I have installed my application on Oracle and the advanced search runs well.
Thanks a lot.

Re: Advanced search SLOW!

lmoulin — Tue, 03 Apr 2007 15:23:43 GMT

Has this PostGre bug been fixed in the latest version?

Thanks a lot,
Luc

Re: Advanced search SLOW!

kevinr — Wed, 04 Apr 2007 09:30:27 GMT

I believe this was an Enterprise fix and made it into 2.0E and 1.4.2E (i think) the fix should be in HEAD now so will be in the 2.1 Community release.

Thanks,

Kevin