Display Total Test Cases in Test suites Integrated in Azure Pipeline

Ask general questions here.
puniar
Posts: 26
Joined: Thu Jan 24, 2019 12:51 pm

Display Total Test Cases in Test suites Integrated in Azure Pipeline

Post by puniar » Mon Oct 25, 2021 9:30 am

Hello,

Currently all our test suites are integrated in Azure and execution are performed and the Tests tab displays the summary of execution. i.e, Total Test cases executed, Passed, Failed and Not Executed.

Here the Total number is only of those executed and it doesn't give the total test cases that were put up for execution. The test cases might have failed to run or the test suite got cancelled, in this case the number do not add up to the total.

Is there a way to display the total test cases across all the test suites integrated in the azure pipeline?

Sample screen capture attached.
In the screen capture we see the total test cases as 507, but there are 600 Test Cases in total which are not displayed here.
You do not have the required permissions to view the files attached to this post.
Regards,
Punith

User avatar
odklizec
Ranorex Guru
Ranorex Guru
Posts: 7470
Joined: Mon Aug 13, 2012 9:54 am
Location: Zilina, Slovakia

Re: Display Total Test Cases in Test suites Integrated in Azure Pipeline

Post by odklizec » Tue Oct 26, 2021 7:45 am

Hi,

Are you sure that if you run the solution in Studio, the report produced by Ranorex displays 600 test cases? Or even better, how many test cases shows the Ranorex report created during DevOps run? It sounds to me that DevOps, from whatever reasons, does not recognize these extra test cases? But it's hard to tell why, without seeing the solution and/or Ranorex report (ideally, post both report and junit file). Thanks.
Pavel Kudrys
Ranorex explorer at Descartes Systems

Please add these details to your questions:
  • Ranorex Snapshot. Learn how to create one >here<
  • Ranorex xPath of problematic element(s)
  • Ranorex version
  • OS version
  • HW configuration

puniar
Posts: 26
Joined: Thu Jan 24, 2019 12:51 pm

Re: Display Total Test Cases in Test suites Integrated in Azure Pipeline

Post by puniar » Tue Oct 26, 2021 2:31 pm

Hello odklizec,

1. Yes, the Test Cases while generated from Studio is the exact number of Test Cases.

My problem is, do we have a way to list out all the Test Case numbers in hand before the execution.
Is there a way similar to VS Tests which displays total Test Cases in the project even before execution. (With [Test] attribute)

The reason I cannot see the missing Test Cases count, are that the Execution of these test suites got cancelled midway and there is not Junit report available to get the total test cases number. For other Scenarios (Passed/Failed/Not Run/Not Executed) the count exists as the report exists.
Regards,
Punith