Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for
- Hyland Connect
- Enterprise Platforms
- Alfresco
- Alfresco Archive
- Re: very slow importing via cifs
Options
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
very slow importing via cifs
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-02-2013 07:21 AM
hi,
i upgraded an Alfresco Commuity 3.4b to 4.0e, still with lucene index.
The machine is a Ubuntu 10.04 with Mysql database.
i have to import about 20000PDF documents (each aboul 200kb).
This should (and is currently) run via cifs.
in the last 3hours it imported about 20files.
I already defined background indexing:
but after importing the load of mysql grows up and stays at 199% CPU usage and aboud 2GB VirtMemory usage.
But i assume there must be some Mysql performancetuning i forgot. here are some parts from my.cnf.
hopefully somebody can point me to my error.
thomas
i upgraded an Alfresco Commuity 3.4b to 4.0e, still with lucene index.
The machine is a Ubuntu 10.04 with Mysql database.
i have to import about 20000PDF documents (each aboul 200kb).
This should (and is currently) run via cifs.
in the last 3hours it imported about 20files.
I already defined background indexing:
#
# Index Recovery Mode
#————-
index.recovery.mode=AUTO
#index.recovery.mode=FULL
### Solr indexing ###
#index.subsystem.name=solr
#dir.keystore=${dir.root}/keystore
#solr.port.ssl=8443
index.subsystem.name=lucene
dir.keystore=${dir.root}/keystore
# scaleup Bulkload, see: http://de.slideshare.net/alfresco/scale-your-alfresco-solutions
index.tracking.disableInTransactionIndexing=true
lucene.maxAtomicTransformationTime=0
index.tracking.cronExpression=0/5 * * * * ?
system.enableTimestampPropagation=false
but after importing the load of mysql grows up and stays at 199% CPU usage and aboud 2GB VirtMemory usage.
But i assume there must be some Mysql performancetuning i forgot. here are some parts from my.cnf.
key_buffer = 1024M
max_allowed_packet = 32M
thread_stack = 256K
thread_cache_size = 8
# This replaces the startup script and checks MyISAM tables if needed
# the first time they are touched
myisam-recover = BACKUP
#max_connections = 100
#table_cache = 64
#thread_concurrency = 10
#
# * Query Cache Configuration
#
query_cache_limit = 192M
query_cache_size = 768M
hopefully somebody can point me to my error.
thomas
Labels:
- Labels:
-
Archive
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-02-2013 09:46 AM
also monitoring the system with top
only one process is running (mysqld), also java is sleeping,
when running mysqladmin processlist -p i get
only one process is running (mysqld), also java is sleeping,
when running mysqladmin processlist -p i get
mysqladmin processlist -p
Enter password:
+—–+———-+—————–+——————+———+——+————–+——————————————————————————————————+
| Id | User | Host | db | Command | Time | State | Info |
+—–+———-+—————–+——————+———+——+————–+——————————————————————————————————+
| 82 | alfresco | localhost:42514 | alfresco40e_lat1 | Query | 646 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 83 | alfresco | localhost:42515 | alfresco40e_lat1 | Query | 768 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 84 | alfresco | localhost:42516 | alfresco40e_lat1 | Query | 970 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 85 | alfresco | localhost:42517 | alfresco40e_lat1 | Query | 869 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 86 | alfresco | localhost:42518 | alfresco40e_lat1 | Query | 21 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 87 | alfresco | localhost:42519 | alfresco40e_lat1 | Query | 263 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 88 | alfresco | localhost:42520 | alfresco40e_lat1 | Query | 528 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 89 | alfresco | localhost:42521 | alfresco40e_lat1 | Query | 190 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 90 | alfresco | localhost:42522 | alfresco40e_lat1 | Query | 994 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 92 | alfresco | localhost:42547 | alfresco40e_lat1 | Query | 587 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 93 | alfresco | localhost:42552 | alfresco40e_lat1 | Query | 475 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 94 | alfresco | localhost:42555 | alfresco40e_lat1 | Sleep | 4 | | |
| 95 | alfresco | localhost:42556 | alfresco40e_lat1 | Query | 354 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 96 | alfresco | localhost:42558 | alfresco40e_lat1 | Query | 1015 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 97 | alfresco | localhost:42559 | alfresco40e_lat1 | Query | 302 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 98 | alfresco | localhost:42560 | alfresco40e_lat1 | Sleep | 64 | | |
| 99 | alfresco | localhost:42561 | alfresco40e_lat1 | Query | 226 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 100 | alfresco | localhost:42567 | alfresco40e_lat1 | Query | 163 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 101 | alfresco | localhost:42568 | alfresco40e_lat1 | Query | 133 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 103 | alfresco | localhost:42574 | alfresco40e_lat1 | Query | 104 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 104 | alfresco | localhost:42577 | alfresco40e_lat1 | Query | 72 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 105 | alfresco | localhost:42578 | alfresco40e_lat1 | Query | 45 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 106 | alfresco | localhost:42582 | alfresco40e_lat1 | Query | 939 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 107 | alfresco | localhost:42584 | alfresco40e_lat1 | Sleep | 64 | | |
| 108 | alfresco | localhost:42587 | alfresco40e_lat1 | Query | 916 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 109 | alfresco | localhost:42589 | alfresco40e_lat1 | Sleep | 1264 | | |
| 110 | alfresco | localhost:42591 | alfresco40e_lat1 | Sleep | 3 | | |
| 111 | alfresco | localhost:42599 | alfresco40e_lat1 | Sleep | 7878 | | |
| 114 | alfresco | localhost:42654 | alfresco40e_lat1 | Query | 695 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 115 | alfresco | localhost:42655 | alfresco40e_lat1 | Sleep | 7878 | | |
| 116 | alfresco | localhost:42656 | alfresco40e_lat1 | Query | 375 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 117 | alfresco | localhost:42657 | alfresco40e_lat1 | Query | 332 | Sending data | select
assoc.id as id,
parentNode.id as par |
| 118 | alfresco | localhost:42663 | alfresco40e_lat1 | Sleep | 7878 | | |
| 119 | alfresco | localhost:42664 | alfresco40e_lat1 | Sleep | 7878 | | |
| 120 | alfresco | localhost:42665 | alfresco40e_lat1 | Sleep | 7878 | | |
| 121 | alfresco | localhost:42666 | alfresco40e_lat1 | Sleep | 7878 | | |
| 122 | alfresco | localhost:42667 | alfresco40e_lat1 | Sleep | 7878 | | |
| 123 | alfresco | localhost:42668 | alfresco40e_lat1 | Sleep | 7878 | | |
| 124 | alfresco | localhost:42669 | alfresco40e_lat1 | Sleep | 7878 | | |
| 127 | root | localhost | | Query | 0 | | show processlist |
+—–+———-+—————–+——————+———+——+————–+——————————————————————————————————+
Getting started
Tags
Find what you came for
We want to make your experience in Hyland Connect as valuable as possible, so we put together some helpful links.
