topic Re: Cannot upload a file larger than 4MB using CMIS in Alfresco Archive

Cannot upload a file larger than 4MB using CMIS

ardamose123 — Fri, 21 Mar 2014 15:23:51 GMT

Alfresco versions: 4.2.d (community), 4.2.0 (enterprise).Operating system: Ubuntu 12.04 to Ubuntu 13.10Java major version: 7I'm developing a web service that (among other things) uploads documents in a running Alf

Re: Cannot upload a file larger than 4MB using CMIS

kaynezhang — Fri, 21 Mar 2014 15:48:39 GMT

I have many documents larger than 4M,they were all uploaded correctly using Apache Chemistry with AtomPub bingding.
There must be something wrong with your code or environment

Re: Cannot upload a file larger than 4MB using CMIS

ardamose123 — Fri, 21 Mar 2014 18:22:37 GMT

Yes, there 'is' something wrong. The problem is 'what' is wrong. I've already discarded any proxy, permissions, and request size limits issues.

The exception is thrown from inside the mentioned Alfresco webscript. So, I'd like to know if there is something that webscript assumes about the environment, or if there's some other way to upload the contents of a document, even if it's not through CMIS, that bypasses that webscript.

Concerning the code, this is how the file is uploaded using CMIS:
<java>
contentStream = session.getObjectFactory().createContentStream(name, size, mime, newContent);
document.setContentStream(contentStream, true, true);
</java>

Concerning the environment, it's Ubuntu (from 12.04 to 13.10), with Alfresco installed from its installer into /opt using sudo. It's started using

sudo service alfresco start‍

. Nothing out of the ordinary.

Re: Cannot upload a file larger than 4MB using CMIS

kaynezhang — Sat, 22 Mar 2014 02:04:04 GMT

Following test code works fine in my environment,you can try it.


      String serverUrl = "http://localhost:8080/alfresco/api/-default-/public/cmis/versions/1.1/atom";
      String userName = "admin";
      String password = "admin";
      
      SessionFactory sessionFactory = SessionFactoryImpl.newInstance();
      Map<String, String> params = new HashMap<String, String>();
      params.put(SessionParameter.USER, userName);
      params.put(SessionParameter.PASSWORD, password);
      params.put(SessionParameter.ATOMPUB_URL, serverUrl);
      params.put(SessionParameter.BINDING_TYPE, BindingType.ATOMPUB.value());
      params.put(SessionParameter.OBJECT_FACTORY_CLASS,
            "org.alfresco.cmis.client.impl.AlfrescoObjectFactoryImpl");
      List<Repository> repos = sessionFactory.getRepositories(params);
      if (repos.isEmpty()) {
         throw new RuntimeException("Server has no repositories!");
      }
      Session session = repos.get(0).createSession();

      Map<String, Object> properties = new HashMap<String, Object>();
      properties.put(PropertyIds.OBJECT_TYPE_ID, "cmis:document,P:cm:titled");
      properties.put(PropertyIds.NAME, "test8");
      properties.put(PropertyIds.CREATED_BY, "admin");
      properties.put("cm:title", "Title8");
      properties.put("cm:description", "description8");


         AlfrescoFolder folder1 = (AlfrescoFolder) session.getObjectByPath("/folder1");
         File file = new File("C:\\filetoupload.pdf");
         InputStream fis = new FileInputStream(file);
         VersioningState vs = VersioningState.MAJOR;
         DataInputStream dis = new DataInputStream(fis);
         byte[] bytes = new byte[(int) file.length()];
         dis.readFully(bytes);
         ContentStream contentStream = new ContentStreamImpl(file
               .getAbsolutePath(), null, "application/pdf",
               new ByteArrayInputStream(bytes));
         
         AlfrescoDocument newDocument = (AlfrescoDocument) folder1
               .createDocument(properties, contentStream, vs);

‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

Re: Cannot upload a file larger than 4MB using CMIS

ardamose123 — Mon, 24 Mar 2014 18:30:02 GMT

Thanks! I tried to use your code, but I cannot install the alfresco-opencmis-extension from Maven repository (there's something about the stax-ex artifact).

I tried with a local Alfresco Community 4.2.c installation and my code works fine there. Maybe it's something about 4.2.d. I'll report more findings on this issue.

Re: Cannot upload a file larger than 4MB using CMIS

ardamose123 — Mon, 24 Mar 2014 20:51:01 GMT

I tested my content upload code in fresh installations of the following Alfresco versions:
<ul>
<li>Community 4.2.c: it works</li>
<li>Community 4.2.d: it doesn't work</li>
<li>Community 4.2.f: it doesn't work</li>
</ul>

It makes me believe something changed between those versions about the way the content.put webscript works between 4.2.c and 4.2.d.

Re: Cannot upload a file larger than 4MB using CMIS

kaynezhang — Tue, 25 Mar 2014 02:03:08 GMT

You can try with Community 4.3.a to test if it works.You can download 4.3 from this address

http://dev.alfresco.com/downloads/nightly/dist/

Re: Cannot upload a file larger than 4MB using CMIS

marco_pancioni — Wed, 02 Apr 2014 08:55:13 GMT

Hello Ariel,

I've found the same problem on 4.2.f Community Edition when i try to upload via webscript a file larger than 4 MB.

After some hours of search i've found that Alfresco use a temp directory for manage file larger than a threshold (default value is 4 MB), in standard installation the Temp Directory is '/opt/alfresco-4.2.f/tomcat/temp/Alfresco'. In this directory the only one user that have the write permissions is the creator. You can try to change this permission to allow some other users to write inside.

In my case this change was not enough to solve the problem because after other inspection of Alfresco Source Code i've discover that for WebScripts ( and i think also for CMIS because the class used is the same), Alfresco use a subdirectory inside standard Temp Dir for store Temp File, this subdirectory is named "WebScripts".
I've created manually this subdirectory and than I've solved my problem.

In the file repository.properties (under WEB-INF/classes/) you can change three properties:


webscripts.tempDirectoryName=WebScripts
# 4mb
webscripts.memoryThreshold=4194304
# 4gb
webscripts.setMaxContentSize=4294967296
‍‍‍‍‍‍‍

The first property webscripts.tempDirectoryName specify the name of subdirectory inside default Temp Dir where Webscript and CMIS will create the temp file when necessary.

The second property webscripts.memoryThreshold specify the threshold value after that Webscript and CMIS use a Temp File to store the content upload instead use of memory buffer.

The third property webscripts.setMaxContentSize specify the maximum size allowed in Alfresco Webscript to manage content file.

I hope this is usefull to solve your problem.