Benchmark Framework
The set up and configuration of specific tests will be covered in detail but deployment and and environment setup details can be found in page Benchmark Framework 2.0.
The benchmark lab configuration can be found on the internal Wiki page.
Compatibility Matrix
Table 1: Benchmark Project List| Name | Description | Artifact Releases | Artifact Snapshots | Source | Prerequisites |
|---|
| Benchmark Server | Benchmark controller application and framework code | Releases | Snapshots | Source | |
| Alfresco Sign Up | Create users in Alfresco as a prerequisite for Alfresco testing | Releases | Snapshots | Source |
Alfresco instance with /alfresco exposed |
| Alfresco Data Load | Create shared, common data in Alfresco: Sites, site members, site-based files and folders | Releases | Snapshots | Source |
Alfresco instance with /alfresco exposed
User collection mirror in MongoDB (Alfresco Sign Up) |
| Alfresco Workflow | Create and progress through Activiti workflows in Alfresco | Releases | Snapshots | Source |
Alfresco instance with /alfresco exposed
User collection mirror in MongoDB (Alfresco Sign Up) |
| CMIS | Pure CMIS test | Releases | Snapshots | Source |
Any CMIS server
User collection mirror in MongoDB (Alfresco Sign Up) |
| Share | Selenium-based testing using Share page objects | Releases | Snapshots | Source |
Alfresco instance with /share exposed
User collection mirror in MongoDB (Alfresco Sign Up)
Selenium grid running local to each instance of the test (ideally) |
Table 1 gives the names of the Alfresco Benchmark projects and where to find artifacts and source code.
Click on the test name to get more detailed instructions on how to run the application.
Table 2: Benchmark Software Compatibility| Product Version | Benchmark Test(s) |
|---|
| CMIS 1.1 Server |
Benchmark Server 2.1.1 or later
CMIS 1.4 |
| Alfresco 5.2.0 |
Benchmark Server 2.1.1 or later
Sign Up 2.3 or later
Data Load 2.6 or later
CMIS 1.4
Workflow 1.1
Public API 1.0-SNAPSHOT
Share 5.2.0-SNAPSHOT (trunk) |
| Alfresco 5.1.0 |
Benchmark Server 2.1.1 or later
Sign Up 2.3 or later
Data Load 2.6 or later
CMIS 1.4
Workflow 1.1
Public API 1.0-SNAPSHOT
Share 5.1.0 |
| Alfresco 5.0.N |
Benchmark Server 2.1.1 or later
Sign Up 2.3 or later
Data Load 2.6 or later
CMIS 1.4
Workflow 1.1
Public API 1.0-SNAPSHOT
Share 5.0.0 / 5.0.1 / 5.0.x-SNAPSHOT |
| Alfresco 4.2.5 |
Benchmark Server 2.1.1 or later
Sign Up 2.3 or later
Data Load 2.6 or later
Workflow 1.1
Share 4.2.x-SNAPSHOT |
| Alfresco 4.2.3 |
Benchmark Server 2.1.1 or later
Sign Up 2.3 or later
Data Load 2.6 or later
Workflow 1.1
Share 4.2.4.x-SNAPSHOT |
| Alfresco 4.1.5 |
Benchmark Server 2.1.1 or later
Sign Up 2.3 or later
Data Load 2.6 or later
Workflow 1.1
Share 4.1.x-SNAPSHOT |
Table 2 shows the test version compatibility with specific product versions.
Where a specific Product Version is not listed, use the most recent version listed. For example, if you are using Alfresco 4.2.4 and only Alfresco 4.1.3 and Alfresco 5.0.0 are listed, then the tests to use will be those of the latest prior release; in this example: Alfresco 4.1.3.
