topic Re: UTF-8 Character encoding issue in Alfresco Archive

UTF-8 Character encoding issue

sbalasubramania — Thu, 03 Jan 2008 10:30:17 GMT

Hello,I am very new to Alfresco and have some basic questions related to UTF-8 character set.I am trying to create a folder/discussion topic using "Tamil" language. It is showing ????" marks after creation of the folder.Following things where done by me:————————————————-Installed community version o

Re: UTF-8 Character encoding issue

kevinr — Thu, 17 Jan 2008 15:45:28 GMT

Have you ensured your database is using utf-8 character set? The search will work because we index using Lucene which stores its indexes separately from the database - so it sounds like the database character set.

Kevin

Re: UTF-8 Character encoding issue

sbalasubramania — Thu, 17 Jan 2008 16:21:21 GMT

Thanks for the information. I will check the database and will get back to you. Can you please let me know, which table contains "space name", so that I can verify the table data.

I appreciate your response

Re: UTF-8 Character encoding issue

kevinr — Thu, 17 Jan 2008 17:09:42 GMT

alf_node_properties contains all node properties including cm:name etc.

Kevin

Re: UTF-8 Character encoding issue

sbalasubramania — Tue, 22 Jan 2008 11:29:40 GMT

I checked mysql database (alfresco schema). I looked into the table you have mentioned alf_node_properties; the table fields Collation property for varchar, strings are showing as "utf8_bin" . I remember setting the collation property with "utf8_bin" when I created the alfresco database.

Is there anything I need to do. I can try out from start, if required ( meaning setting up the database etc),

Can you please point me to any URL link (if you have) for setting up the database to handle UTF8 character set ?

You can reach me by mail at " sbalasubramanian@spikesource.com "
I took the snapshot of the table structure, but not able to attach the file

Thanks
Sriram[/img]

Re: UTF-8 Character encoding issue

sbalasubramania — Tue, 22 Jan 2008 11:53:30 GMT

while browsing the table data, I came across one table called " alf_child_assoc " having qname and child_node_name with "????" marks. ({http://www.alfresco.org/model/content/1.0}???????…)

I think problem is during the data insertion.

Any help is appreciated.
thanks
sriram

Re: UTF-8 Character encoding issue

kevinr — Mon, 04 Feb 2008 11:29:00 GMT

UTF-8 is good for Tamil. So try using UTF-8 (plain) for the DB upon creation.

Thanks,

Kevin

Re: UTF-8 Character encoding issue

ismail_sidiya — Thu, 21 Feb 2008 01:58:58 GMT

You may try editing the jdbc url:

db.url=jdbc:mysql://localhost/alfresco?useUnicode=true&characterEncoding=utf-8‍

Hope this help

Re: UTF-8 Character encoding issue

musper — Sun, 02 Mar 2008 18:28:06 GMT

True:

You may try editing the jdbc url:
db.url=jdbc:mysql://localhost/alfresco?useUnicode=true&characterEncoding=utf-8‍
Hope this help

This helped me when tried to migrate from Linux/HSQLDB…I just wasn+t able to get my users and spaces names to show certain unicode characters in Croatian language.

Many thanks!

Re: UTF-8 Character encoding issue

iblazev — Thu, 13 Mar 2008 13:47:17 GMT

Hello!
I have a similar problem with Croatian characters but given solution doesn't work since I'm working on Linux server. Transition to Windows is not an option. Is there a way to correct this? To use ISO 8859-2 or cp1250?

Re: UTF-8 Character encoding issue

anya — Fri, 28 Aug 2009 12:11:24 GMT

I'm using Russian language and i have the same problem. The described methods didn't help (

Re: UTF-8 Character encoding issue

anya — Mon, 31 Aug 2009 12:50:27 GMT

Deleting completely database and installing it again with default-character-set=utf8 im my.ini helped.

Re: UTF-8 Character encoding issue

jriker1 — Tue, 01 Sep 2009 13:32:33 GMT

Deleting completely database and installing it again with default-character-set=utf8 im my.ini helped.

Is anyone actually using Alfresco for production use? Seems I see a lot of responses like the above which to me would elude to having no data that they care about. Or is there a way to recreate the schema in it's entirety and import the data back in?

Thanks.

JR

Re: UTF-8 Character encoding issue

anya — Wed, 02 Sep 2009 06:35:36 GMT

Or is there a way to recreate the schema in it's entirety and import the data back in?
JR

I think this is a question for MySQL forum :wink: I think that of course you can save your data and import it back. But anyway you should re-install database. I tried all things, but only this really helped.

Re: UTF-8 Character encoding issue

dgildeh — Thu, 18 Mar 2010 01:47:26 GMT

Here is step-by-step instructions on how to recover a production environment with this issue so you don't lose any data:

1. Stop Alfresco
2. Run the PHP Script below to convert the database into UTF-8:

<?php
$db = mysql_connect('localhost','root','root_password');
if(!$db) echo "Cannot connect to the database - incorrect details";
mysql_select_db('alfresco');
mysql_query('ALTER DATABASE CHARACTER SET utf8');
$result=mysql_query('show tables');
while($tables = mysql_fetch_array($result)) {
foreach ($tables as $key => $value) {
mysql_query("ALTER TABLE $value CONVERT TO CHARACTER SET utf8 COLLATE utf8_general_ci");
}}
echo "The collation of your database has been successfully changed!";
?>

3. Delete the lucene-indexes directory under the Alfresco data directory
4. Edit alfresco-global.properties in tomcat/shared/classes directory for the following:

CHANGE: index.recovery.mode=AUTO -> index.recovery.mode=FULL
CHANGE: db.url=jdbc:mysql://${db.host}:${db.port}/${db.name}?useUnicode=true&characterEncoding=utf-8

5. Restart Alfresco
6. Remember to change index.recover.mode back to AUTO.

Re: UTF-8 Character encoding issue

marcin — Thu, 01 Jul 2010 10:00:43 GMT

My database and tables where already set to utf-8.
All I needed to do is make the one change to alfresco-global.properties file, e.i.: db.url=jdbc:mysql://${db.host}:${db.port}/${db.name}?useUnicode=true&characterEncoding=utf-8 and restart alfresco.

Re: UTF-8 Character encoding issue

hkır — Mon, 02 Aug 2010 11:46:02 GMT

I have a page redirection problem caused by character encoding. I can give Turkish names to my folders and view them without any problem. But the problematic scenario is:
1- I create a folder named "klasör" (folder in turkish) and there is no displaying problems.
2- I view the details of the "klasör"
3- In folder details page I try to go back to documentlist page via breadcrumb (which writes "Location: Documents Documents > klasör", I click klasör link). This directs me to the page "http://localhost:8080/share/page/site/epdk/documentlibrary?path=klas%F6r", from here I automatically redirected to another page "http://localhost:8080/share/page/site/epdk/documentlibrary#filter=path|%2Fklasör" and get "Path not found: 'klasÃ¶r'" error.

When I tried second path as "http://localhost:8080/share/page/site/epdk/documentlibrary#filter=path|%2Fklas%F6r" I access to the expected page.

Thank you very much.

note: I use Community Edition 3.3

Re: UTF-8 Character encoding issue

mikeh — Mon, 02 Aug 2010 12:13:56 GMT

I believe this is fixed on 3.3G or latest HEAD.

Thanks,
Mike

Re: UTF-8 Character encoding issue

munkashif — Fri, 17 Feb 2012 06:21:13 GMT

Hi,

i want to make the special characters like ?, \, *, /,",: allownle for the name of the content in create content wizard.

Thanks

Re: UTF-8 Character encoding issue

nick_l — Fri, 28 Jun 2013 05:00:17 GMT

any update of this issue?