topic character encoding problem with processTemplate? in Alfresco Archive

character encoding problem with processTemplate?

alrice — Fri, 12 Oct 2007 15:38:52 GMT

All, I am getting very productive with the webscripts environment. It's great. But i ran into an urgent and puzzing character encoding issue. Any suggestions greatly appreciated- thanks in advance. We have lots of foreign names in this application, so it's important to be able to support accented ch

Re: character encoding problem with processTemplate?

kevinr — Fri, 19 Oct 2007 16:09:54 GMT

I'll assume you are using 2.1.

I haven't tried this myself (i will do) but I think you may need to override the FreeMarkerProcessor bean definition in the Spring config thus:


    <bean id="freeMarkerProcessor" parent="baseTemplateProcessor" class="org.alfresco.repo.template.FreeMarkerProcessor">
        <property name="name">
            <value>freemarker</value>
        </property>
        <property name="extension">
            <value>ftl</value>
        </property>
        <property name="defaultEncoding">
            <value>UTF-8</value>
        </property>
    </bean>
‍‍‍‍‍‍‍‍‍‍‍‍‍

As the JavaScript API is going direct to the template processor, it does not know the encoding of the source webscript page that is executing within. I'll take a look as it should be possible to fix this for a future version.

Thanks,

Kevin

Re: character encoding problem with processTemplate?

alrice — Tue, 23 Oct 2007 20:02:29 GMT

Kevin, thanks but i am unable to get this fix to work. I added your bean definition to web-client-config-custom.xml in /opt/tomcat/shared/classes/alfresco/extension and then restarted tomcat.
I get the same result when I enter UTF8 characters into my form and save it.

Re: character encoding problem with processTemplate?

alrice — Tue, 23 Oct 2007 20:57:49 GMT

Also yes: Alfresco Enterprise Network v2.1.0 (112)

Re: character encoding problem with processTemplate?

kevinr — Wed, 24 Oct 2007 07:24:08 GMT

Sorry the bean config i sent is not web-client config. It is repository config and therefore will go in your custom-db-and-data-context.xml or similar.

Thanks,

Kevin

Re: character encoding problem with processTemplate?

alrice — Wed, 24 Oct 2007 16:50:41 GMT

Kevin, i tried putting it in /opt/tomcat/shared/classes/alfresco/extension/custom-db-and-data-context.xml
but the same problem still.

Re: character encoding problem with processTemplate?

alrice — Wed, 24 Oct 2007 16:51:24 GMT

Also i opened a support incident on this yesterday- just wanted to let you know so efforts are not duplicated.

Re: character encoding problem with processTemplate?

kevinr — Mon, 29 Oct 2007 21:04:57 GMT

Thanks. I have opened a JIRA item to track the bug investigation and fix: http://issues.alfresco.com/browse/AR-1829

Kevin

Re: character encoding problem with processTemplate?

kevinr — Tue, 30 Oct 2007 11:04:38 GMT

The issue has been investigated and fixed.

For your testing purposes, I have provided the modified .class file here. You can patch it into your alfresco-web-client.jar inside the alfresco.war file and check it works for you. I think the config change I posted above should fix any issues with processTemplate() - but that doesn't look like it was the issue anyway.

Thanks,

Kevin

Re: character encoding problem with processTemplate?

alrice — Tue, 30 Oct 2007 17:01:55 GMT

Kevin, thanks i will test and reply as soon as I am able. what is the best method of testing actually? i am not sure how to "patch it into your alfresco-web-client.jar inside the alfresco.war file"
I am not that familiar with how tomcat expands these files.

Re: character encoding problem with processTemplate?

kevinr — Tue, 30 Oct 2007 17:36:34 GMT

Tomcat expands the WAR into a folder called 'alfresco' in the webapps folder. Inside you will find WEB-INF/lib/alfresco-webclient.jar. You can expand that JAR file (it is just a ZIP archive) using any ZIP tool, overrwite the class file that i provide (keeping the folder structure intact!) and then repack up the jar file archive and overwrite it in the WEB-INF/lib folder.

Once that is done (and you've restarted the server of course) you can try the Upload example or your example and it should work ok with upload UTF-8 characters.

Obviously don't do this on your production server etc. etc.

Kevin

Re: character encoding problem with processTemplate?

alrice — Tue, 30 Oct 2007 23:29:38 GMT

Thanks that makes sense Kevin. Alright, I tested it out but am not seeing any different behavior. I added a new comment to the JIRA issue.

Re: character encoding problem with processTemplate?

kevinr — Thu, 01 Nov 2007 08:59:52 GMT

My investigations have found a further issue when webscripts using the /service path do not have the character encoding set correctly on the request. This is why the fix isn't working for you, I am using the /wcservice path (using the webclientauthenticator) which is correctly setting the encoding on the request.

Please see my further comments on the jira bug report.

I will provide a new fix for this shortly.

Kevin

Re: character encoding problem with processTemplate?

kevinr — Thu, 01 Nov 2007 10:58:44 GMT

Please find an updated patch here (contains 3 updated .class files for the alfresco-web-client.jar). It should work correctly with /service based webscripts.

Thanks,

Kevin

Re: character encoding problem with processTemplate?

kevinr — Fri, 09 Nov 2007 16:06:13 GMT

A further issue was found (with the patch itself doh), updated files available on the JIRA issue.

Thanks,

Kevin