Iterations counted as testcases in total tally
Posted: Mon Apr 03, 2017 12:16 pm
When Data-Binding has been employed, each iteration appears in the Automation Report as a separate test case, and is counted in the total tally.
So if you have 3 testcases, and each run with 30 iterations, then the total count will be 3x30=90 instead of 3.
If one of them fails, then you will have 1 fail out of 90, instead of 1testcase out of 3.
This is pretty inconvenient for us, because we don't always consider an iteration as a separate testcase; for example, a test case with 30 iterations can really just be one testcase with 30 steps.
To have 3 testcases suddenly become 90 makes the reports unreliable for us, because it heavily skews the numbers.
Is there a way to not have the iterations not get counted in the total tally (other than manipulating the ranorex report xml file)?
So if you have 3 testcases, and each run with 30 iterations, then the total count will be 3x30=90 instead of 3.
If one of them fails, then you will have 1 fail out of 90, instead of 1testcase out of 3.
This is pretty inconvenient for us, because we don't always consider an iteration as a separate testcase; for example, a test case with 30 iterations can really just be one testcase with 30 steps.
To have 3 testcases suddenly become 90 makes the reports unreliable for us, because it heavily skews the numbers.
Is there a way to not have the iterations not get counted in the total tally (other than manipulating the ranorex report xml file)?