R2 Performance Testing

As we get closer to Release 2 go-live, last week saw some performance testing of new solutions components – Nuance Recognizer ASR and Kofax inbound correspondence. For R2 we are taking a predominantly risk based approach which means testing some of the new solution components in isolation.

During each test we monitor the CPU and RAM utilisation on each of the servers which host the relevant components.

Nuance Recognizer

For Nuance ASR testing we created a test application in order to simulate the recognition load on a single ASR server. To analyse the results I created a Nuance log file analyser which exports the raw data to Microsoft Excel for further analysis.

Here is the raw data:

Image

Analysis showing recognition latency as a function of time:

Image

Analysis showing recognition concurrency as a function of time:

Image

Kofax

The approach for Kofax was to create a test harness and then bulk inject emails. The harness monitors the underlying filesystem so that content processing can be tracked from the point of capture until it is released for further processing into SAP via Ceyoniq.

Here is the raw data:

Image

 

 

Share