topic Charset & encoding through CIFS / Webdav / FTP... in Alfresco Archive

Charset & encoding through CIFS / Webdav / FTP...

jgoffinet — Mon, 28 Nov 2005 13:51:47 GMT

Hi,I've made some tests through several protocols. Here is the config I used:- server: linux (debian) / mysql / tomcat bundle (1.0.0 release) - no special config- client: WinXP Pro SP2 with : * Windows Explorer to access CIFS share * Windows Explorer with network places to access Webdav * Wind

Re: Charset & encoding through CIFS / Webdav / FTP...

gary_spencer — Wed, 07 Dec 2005 17:17:48 GMT

Hi Jean,

I'll have to do some tests with accents in names to see what is going on here.

CIFS should be ok as it supports Unicode file/folder names. FTP doesn't currently support Unicode, I'll need to look at the spec for how that is supported. WebDAV looks like it may be a conversion problem.

Cheers

Gary

Re: Charset & encoding through CIFS / Webdav / FTP...

gary_spencer — Wed, 07 Dec 2005 17:45:26 GMT

Hi Jean,

Just did some quick tests here using the latest v1.1 code.

WebDAV via Network Places seems ok at creating and viewing folders with accents in the name. Folders were created with CIFS and web-client.

CIFS and web-client seem ok at creating/viewing folders. FTP via Network Places was also able to view the folders created by CIFS, WebDAV and web-client which I was suprised at as I expected it to fail.

Could you try your tests again using the latest v1.1 code.

Cheers

Gary

Re: Charset & encoding through CIFS / Webdav / FTP...

jgoffinet — Thu, 08 Dec 2005 13:57:08 GMT

Thank you Gary for your response.

> Could you try your tests again using the latest v1.1 code.

Do you mean the latest stable 1.1 version or the latest nightly build ?

Jean

Re: Charset & encoding through CIFS / Webdav / FTP...

gary_spencer — Thu, 08 Dec 2005 14:02:18 GMT

Hi Jean,

I would try the stable v1.1.

Cheers

Gary

Re: Charset & encoding through CIFS / Webdav / FTP...

jgoffinet — Mon, 12 Dec 2005 12:12:36 GMT

With 1.1 release (linux tomcat bundle), I made this very simple test:
- open a webdav network place pointing to the repository
- add a folder named "webdav-ÃƒÂ©" via Webdav
First the folder name is correctly displayed, but if I refresh the screen I get "webdav-ÃƒÆ’Ã‚Â©" instead of "webdav-ÃƒÂ©" in the folders tree. Note that I can still access this directory.

Now another test:
- create a space named "web-ÃƒÂ©" through the web client
- refresh the folders tree in the Webdav Network Place: the "web-ÃƒÂ©" directory is correctly displayed
- click on that directory
An error message pops up, saying that the folder is unavailable, and the content of the folder isn't displayed…

I don't know if this could be linked to my Windows configuration, but I don't remember having done anything special… I use a french version of Win XP Pro SP2. Is there a way to configure which encoding the Network Places must use ?

Thanks,

Jean

Re: Charset & encoding through CIFS / Webdav / FTP...

gary_spencer — Wed, 14 Dec 2005 16:50:55 GMT

Hi,

I've managed to reproduce this problem now, not sure why I wasn't seeing t before. I'm looking into it at the moment.

Cheers

Gary

Re: Charset & encoding through CIFS / Webdav / FTP...

unknown-user — Wed, 17 May 2006 19:29:10 GMT

My previous issues about 1.2.1 and 1.3dev versions of alfresco seems related to those charset problems.

I experience the exact same behaviour of broken accents using webdav.

I agree with the fact that it must be a conversion problem : using WebClient, everything is fine, though my debian and mysql are using UTF8 and the client (windows XP) is using latin9 aka iso8859-15.

Crashes, and slow operation were surely related to this (windows explorer is almost hanging when meets an accent, which sadly happens every 5 minutes with french repository 😃 )

Where could we specify client charset? (for example webdav client or cifs client) Isnt the header supposed to announce content encoding? Windows XP bug? How could i analyse this up?

Thank you!

Re: Charset & encoding through CIFS / Webdav / FTP...

lgr — Fri, 24 Nov 2006 12:15:37 GMT

Hi,

Testing with v1.4, it seems that accents are not understood in FTP.
Webdav and cifs work well.
(using postgresql, i presume no utf8 configuration because cifs and webdav both work well)

Some Jira issues deals with accents and ftp, but are resolved as of october, 26, the day after 1.4 release.

Does it means that ftp will be working well with UTF8 in the next version ?

Laurent.

Re: Charset & encoding through CIFS / Webdav / FTP...

kevinr — Fri, 24 Nov 2006 16:58:58 GMT

The UTF-8 support in FTP fixes problems with accents/umlauts etc. in 1.4 community - but it depends on the FTP client enabling it.

Thanks,

Kevin

Re: Charset & encoding through CIFS / Webdav / FTP...

lgr — Mon, 27 Nov 2006 07:37:47 GMT

The UTF-8 support in FTP fixes problems with accents/umlauts etc. in 1.4 community - but it depends on the FTP client enabling it.

Ok.

Actually, i tested with 3 ftp clients, i was not sure of utf8 support of two of them (ftp through windows explorer network places and windows command prompt ftp client, both winxp sp2 FR), but the third one, filezilla 2.2.29 under windows, has different behaviours while forcing or not utf-8 enabling. And these 2 behaviours don't create correctly the accented filenames.

Can you tell me which ftp client to use, to have a correct utf-8 support ?

Laurent.

Re: Charset & encoding through CIFS / Webdav / FTP...

lgr — Mon, 27 Nov 2006 08:49:50 GMT

Just another information, i've checked with smartftp 2.0.1, and it didn't work either.

but something pointed out : when issuing FEAT command, only "SIZE" is answered, none "UTF8" or anything else.

Is there something to configure so that Alfresco answers UTF8 when asking for ftp features ?

Laurent.

Re: Charset & encoding through CIFS / Webdav / FTP...

lgr — Fri, 01 Dec 2006 12:13:21 GMT

Kevin,

Do you have any more information about UTF8 support ?

I don't see any feat UTF8 in the repository source :
in java/org/alfresco/filesys/ftp/FTPSrvSession.java :

   protected final void procFeatures(FTPRequest req) throws IOException
    {
        // Check if the user is logged in

        if (isLoggedOn() == false)
        {
            sendFTPResponse(500, "");
            return;
        }

        // Send back the list of features supported by this FTP server

        sendFTPResponse( 211, "Features");
        sendFTPResponse( "SIZE");
        sendFTPResponse( 211, "End");
    }
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Did i miss something or http://issues.alfresco.com/browse/AR-628 does not match the released source ? (included in alfresco-sdk-1.4.0)

Laurent.

Re: Charset & encoding through CIFS / Webdav / FTP...

paulhh — Fri, 01 Dec 2006 15:46:53 GMT

Hi Laurent

That issue was fixed after the Community release was made, in the extended QA phase for the Enterprise release. Like another fixes that were made in this phase, they will get folded into the HEAD code before the next release. We've just merged in the WCM code, so these other fixes will arrive over the next few weeks.

Cheers
Paul.

Re: Charset & encoding through CIFS / Webdav / FTP...

lgr — Fri, 01 Dec 2006 15:58:28 GMT

Ok, all is clear now

Thanks Paul,

Laurent.

Re: Charset & encoding through CIFS / Webdav / FTP...

tarkadu — Mon, 25 Dec 2006 20:23:04 GMT

Please look at Webdav as well - I cannot make a connection using Windows Explorer and Webdav to folders with German Umlauts in their names - for all other folders it's all right.

If it is a settings problem please inform me!

Thanks,

Tarkadu

Re: Charset & encoding through CIFS / Webdav / FTP...

lgr — Thu, 29 Mar 2007 09:23:49 GMT

Hi Laurent

That issue was fixed after the Community release was made, in the extended QA phase for the Enterprise release. Like another fixes that were made in this phase, they will get folded into the HEAD code before the next release. We've just merged in the WCM code, so these other fixes will arrive over the next few weeks.

Hi Paul,

I think the issue is not really closed.
Uploading of accented files works well, that is fixed.
But working with accented folders does not seem to work well.
When i try to upload a file which is located in a folder which name is accented, my favorite filezilla dialogs with the FTP server :

OPTS UTF8 ON
200 OPTS UTF8 ON
PWD
257 "/"
CWD /Alfresco/Clients/Sch\303\251ma/20060922/
250 Requested file action OK
PWD
257 "/Alfresco/Clients/Sch?ma/20060922/"
‍‍‍‍‍‍‍‍‍

When uploading the file in the accented folder, my also favorite ftp under Windows explorer also says (the accent is missing) :

550 Invalid Path /Alfresco/Clients/Schma/20060922/‍

Laurent.

Re: Charset & encoding through CIFS / Webdav / FTP...

lgr — Thu, 29 Mar 2007 09:24:29 GMT

oops, i forgot to tell that i didn't find any jira issue on this subject.

Laurent.

Re: Charset & encoding through CIFS / Webdav / FTP...

alexandra — Sun, 06 May 2007 17:11:56 GMT

I have the same issues for folder names with Swedish characters Ã¥Ã¤Ã¶ and Ã…Ã„Ã–. I have tried several different ftp clients and the same result. ISO-8859-1 removes the characters and with UTF-8 I only get questionmarks…

I think support for international characters is crucial for a platform like this. Especially since language localization is built-in for the GUI.

Any hints of this issue is fixed in Alfresco 2.0?

Re: Charset & encoding through CIFS / Webdav / FTP...

gary_spencer — Tue, 08 May 2007 13:54:06 GMT

Hi,

There is a <charSet> configuration tag for the FTP server to change the character set used for UTF-8 conversions rather than using the JVM default.

When running the server on a Mac with Windows FTP clients I had to use a setting of <charet>Cp1252</charSet> to get the correct conversions.

Cheers

Gary