Hello,
MaxPermSize is way too high for what Alfresco really needs. I usually get by with 256m and rarely have to use something higher (most of the time, when customers insist on not separating the Alfresco components into separate Tomcat instances). Your Xms and Xmx are rather low - the Xms alone would not be too bad, but the Xmx limits how much working memory Alfresco can use. Depending on what functionality / interfaces of Alfresco you are using and any extension modules you've installed, you might want to think about raising Xmx. 1536m is a value I would consider the minimum for a regular installation - only for mini-installations as part of a transferrable demo system would I consider using less, and then only with configuration / optimisations on Alfresco to make it use the least amount of memory as possible.
Regarding your 15s refresh: What exactly do you need to wait 15 seconds for? The refresh of the details page or refresh of the document preview / renditions? You should keep in mind that the latter are re-generated asynchronously and may take some time depending on the size of the document. Since these conversions are not handled by Alfresco directly, changing the configuration of Alfresco won't improve the speed of the conversion. This usually requires some CPU / IO scaling, i.e. more CPU power, less memory swapping, faster disk access.
Do you have your database installed on the same server or any other applications that need to be considered? If not, you could scale up Xmx to 40 - 50 % of the total available RAM and leave the rest for IO caching as well as conversion processes. Otherwise it might be worth spending some of the RAM on your database caches as well and use less for Alfresco.
Regards
Axel