Ranorex Consolidated Test Report

Ask general questions here.
Locked
atom
Posts: 357
Joined: Sun Dec 07, 2008 11:14 pm
Location: Dublin, Ireland

Re: Ranorex Consolidated Test Report

Post by atom » Tue Aug 31, 2010 5:12 pm

If your really savvy - then you can create a MSWord template that generates a report direct from the results database, that can be then saved to PDF, and emailed to managers :-)
Top
User avatar
Ciege
Posts: 1336
Joined: Thu Oct 16, 2008 6:46 pm
Location: Arizona, USA

Re: Ranorex Consolidated Test Report

Post by Ciege » Tue Aug 31, 2010 8:18 pm

ranoman wrote:Thanks Ciege!!! This is just wonderful :)
Thank you.
If this or any response has helped you, please reply to the thread stating that it worked so other people with a similar issue will know how you fixed your issue!

Ciege...
Top
User avatar
Ciege
Posts: 1336
Joined: Thu Oct 16, 2008 6:46 pm
Location: Arizona, USA

Re: Ranorex Consolidated Test Report

Post by Ciege » Wed Sep 01, 2010 11:18 pm

atom wrote:If your really savvy - then you can create a MSWord template that generates a report direct from the results database, that can be then saved to PDF, and emailed to managers :-)
Or you can use the utility that I wrote (v0.10) and click the Export Report button to generate a basic report (saved in the location you pick under the Tools -> Config dialog) based on the information displayed in the tree view.
If this or any response has helped you, please reply to the thread stating that it worked so other people with a similar issue will know how you fixed your issue!

Ciege...
Top
atom
Posts: 357
Joined: Sun Dec 07, 2008 11:14 pm
Location: Dublin, Ireland

Re: Ranorex Consolidated Test Report

Post by atom » Thu Sep 02, 2010 8:56 am

Hiya Ciege,

One nice enhancement to your tool perhaps is to point it to two folders of log files

- Folder1 : Tests executed for version 1.0 say
- Folder2 : Tests executed for version 1.1 say

And then in the report to see "regressions" only
i.e Tests that Fail in v1.1 that passed in 1.0

Cheers
Top
User avatar
Ciege
Posts: 1336
Joined: Thu Oct 16, 2008 6:46 pm
Location: Arizona, USA

Re: Ranorex Consolidated Test Report

Post by Ciege » Thu Sep 02, 2010 4:02 pm

atom wrote:One nice enhancement to your tool
Hey Atom,
Thanks for the request. I will look into it and see what I can do.
If this or any response has helped you, please reply to the thread stating that it worked so other people with a similar issue will know how you fixed your issue!

Ciege...
Top
User avatar
Ciege
Posts: 1336
Joined: Thu Oct 16, 2008 6:46 pm
Location: Arizona, USA

Re: Ranorex Consolidated Test Report

Post by Ciege » Thu Sep 02, 2010 7:35 pm

atom wrote:One nice enhancement to your tool perhaps is to point it to two folders of log files

- Folder1 : Tests executed for version 1.0 say
- Folder2 : Tests executed for version 1.1 say

And then in the report to see "regressions" only
i.e Tests that Fail in v1.1 that passed in 1.0
OK, so this is *mostly* do-able now with the following settings:
1) Have your 1.0 folder and your 1.1 folder in a parent folder.
2) Point the app to the parent folder.
3) Setup the Version Tested String in config.
4) Enable the Display Test Results check box on the main screen.
5) Refresh and Export the report.

With this setup I get the following as an output when I export the report:

Code: Select all

9/2/2010 11:28:21 AM
Results in past 14 days:     Tested: 0  Passed: 0  Failed: 0  Warn: 0  Unknown: 0
  2010_7_6___10_14_48
    Richardson_Regression_Test.xml  7/6/2010 11:51:19 AM   RESULT: WARNING  VERSION TESTED: 10.2.24.0
  2010_7_2___13_4_43
    Richardson_Regression_Test.xml  7/2/2010 2:41:17 PM   RESULT: WARNING  VERSION TESTED: 10.2.23.0
  2010_6_28___10_59_37
    Richardson_Regression_Test.xml  6/28/2010 12:36:38 PM   RESULT: WARNING  VERSION TESTED: 10.2.18.0
  2010_6_24___13_29_11
    Richardson_Regression_Test.xml  6/24/2010 3:05:37 PM   RESULT: WARNING  VERSION TESTED: 10.2.13.0
  2010_4_12___15_31_6
    Richardson_Regression_Test.xml  4/12/2010 6:14:04 PM   RESULT: WARNING  VERSION TESTED: 10.1.47.0
  2010_3_31___15_22_25
    Richardson_Regression_Test.xml  3/31/2010 6:06:30 PM   RESULT: WARNING  VERSION TESTED: 10.1.41.0
  2010_3_16___14_51_19
    Richardson_Regression_Test.xml  3/16/2010 6:36:35 PM   RESULT: WARNING  VERSION TESTED: 10.1.32.0
  2010_2_15___12_10_1
    Richardson_Regression_Test.xml  2/15/2010 2:51:36 PM   RESULT: WARNING  VERSION TESTED: 10.1.16.0
  2009_9_9___13_42_46
    Richardson_2009_Regression_Test.xml  9/9/2009 3:58:41 PM   RESULT: PASS  VERSION TESTED: 10.0.70.0
  2009_12_2___10_47_55
    Richardson_Regression_Test.xml  12/2/2009 1:21:40 PM   RESULT: WARNING  VERSION TESTED: 10.0.138.0
So it will show result status and version tested in the report.
What it does not do is automatically only show a result if the previous version passed and if the new version failed.
Not sure I will have to time to do the logic to compare folders and tests based on version and the change the GUI to be able to display that mode as well as the current operating mode. Considering we do operate that way here and most of this app is based on our operating procedure here. I only have small bits of time to dedicate to this app since its a back burner project behind my current tasks.
I'll see if I can work something out over time though.
If this or any response has helped you, please reply to the thread stating that it worked so other people with a similar issue will know how you fixed your issue!

Ciege...
Top
Locked

Return to “General Questions”