Peformance inconsistencies

Ask general questions here.
Posts: 81
Joined: Tue Feb 07, 2012 5:25 am

Peformance inconsistencies

Post by bsing » Tue Oct 02, 2012 2:08 am


I have a test suite that I have run 4 times in a row and logged the durations for each run.

1. Duration = 8.1 min
2. Duration = 8.1 min
3. Duration = 6.5 min
4. Duration = 8.2 min

Is there any reason I would be getting such a difference in time when running the same suite of tests over and over?


User avatar
Posts: 207
Joined: Mon Jul 19, 2010 6:55 am
Location: Copenhagen, Denmark

Re: Peformance inconsistencies

Post by artur_gadomski » Tue Oct 02, 2012 8:01 am

From only 4 tests it seems that only one was faster than others. Are you sure that all steps were executed correctly? We have tests that take say 5 minutes if everything works fine but 30 minutes if AUT is unresponsive and we need to click again on some buttons. Maybe something was running in the background hogging up cpu or memory? Maybe you had extra windows open leaving Ranorex to search through more elements?