Are instructions/scripts available for running the Funkload Nuxeo Navigation on large-scale storage Benchmark?

[rg1_]

Are instructions/scripts available for running Nuxeo Navigation on large-scale storage Benchmark? How were the Funkload scripts configured? Also, was nuxeo-platform-importer used to load the data or was it loaded via SQL scripts? If nuxeo-platform-importer was used, how was it configured?

[ben_]

Hi,

Yes import was done using the nuxeo-platform-importer with file of 100k, you can find some more information on this report Navigation on large-scale storage.

The database was tuned for doing mass import and the import was done around 50 docs/s.

Using SQL injection you can do that much faster ~2000 docs/s, you can find some example of python script in my github gist.

Also all those numbers refer to old hardware (2006) and software, I bet that with PG 9.2 using SSD drive you can get at least one order of magnitude faster.

[rg1_]

Specifically, how was the nuxeo-platform-importer configured/driven to accomplish the mass importation of 3m/10m documents?