Page 2 of 2

Re: Ranorex Consolidated Test Report

Posted: Tue Aug 31, 2010 5:12 pm
by atom
If your really savvy - then you can create a MSWord template that generates a report direct from the results database, that can be then saved to PDF, and emailed to managers :-)

Re: Ranorex Consolidated Test Report

Posted: Tue Aug 31, 2010 8:18 pm
by Ciege
ranoman wrote:Thanks Ciege!!! This is just wonderful :)
Thank you.

Re: Ranorex Consolidated Test Report

Posted: Wed Sep 01, 2010 11:18 pm
by Ciege
atom wrote:If your really savvy - then you can create a MSWord template that generates a report direct from the results database, that can be then saved to PDF, and emailed to managers :-)
Or you can use the utility that I wrote (v0.10) and click the Export Report button to generate a basic report (saved in the location you pick under the Tools -> Config dialog) based on the information displayed in the tree view.

Re: Ranorex Consolidated Test Report

Posted: Thu Sep 02, 2010 8:56 am
by atom
Hiya Ciege,

One nice enhancement to your tool perhaps is to point it to two folders of log files

- Folder1 : Tests executed for version 1.0 say
- Folder2 : Tests executed for version 1.1 say

And then in the report to see "regressions" only
i.e Tests that Fail in v1.1 that passed in 1.0

Cheers

Re: Ranorex Consolidated Test Report

Posted: Thu Sep 02, 2010 4:02 pm
by Ciege
atom wrote:One nice enhancement to your tool
Hey Atom,
Thanks for the request. I will look into it and see what I can do.

Re: Ranorex Consolidated Test Report

Posted: Thu Sep 02, 2010 7:35 pm
by Ciege
atom wrote:One nice enhancement to your tool perhaps is to point it to two folders of log files

- Folder1 : Tests executed for version 1.0 say
- Folder2 : Tests executed for version 1.1 say

And then in the report to see "regressions" only
i.e Tests that Fail in v1.1 that passed in 1.0
OK, so this is *mostly* do-able now with the following settings:
1) Have your 1.0 folder and your 1.1 folder in a parent folder.
2) Point the app to the parent folder.
3) Setup the Version Tested String in config.
4) Enable the Display Test Results check box on the main screen.
5) Refresh and Export the report.

With this setup I get the following as an output when I export the report:

Code: Select all

9/2/2010 11:28:21 AM
Results in past 14 days:     Tested: 0  Passed: 0  Failed: 0  Warn: 0  Unknown: 0
  2010_7_6___10_14_48
    Richardson_Regression_Test.xml  7/6/2010 11:51:19 AM   RESULT: WARNING  VERSION TESTED: 10.2.24.0
  2010_7_2___13_4_43
    Richardson_Regression_Test.xml  7/2/2010 2:41:17 PM   RESULT: WARNING  VERSION TESTED: 10.2.23.0
  2010_6_28___10_59_37
    Richardson_Regression_Test.xml  6/28/2010 12:36:38 PM   RESULT: WARNING  VERSION TESTED: 10.2.18.0
  2010_6_24___13_29_11
    Richardson_Regression_Test.xml  6/24/2010 3:05:37 PM   RESULT: WARNING  VERSION TESTED: 10.2.13.0
  2010_4_12___15_31_6
    Richardson_Regression_Test.xml  4/12/2010 6:14:04 PM   RESULT: WARNING  VERSION TESTED: 10.1.47.0
  2010_3_31___15_22_25
    Richardson_Regression_Test.xml  3/31/2010 6:06:30 PM   RESULT: WARNING  VERSION TESTED: 10.1.41.0
  2010_3_16___14_51_19
    Richardson_Regression_Test.xml  3/16/2010 6:36:35 PM   RESULT: WARNING  VERSION TESTED: 10.1.32.0
  2010_2_15___12_10_1
    Richardson_Regression_Test.xml  2/15/2010 2:51:36 PM   RESULT: WARNING  VERSION TESTED: 10.1.16.0
  2009_9_9___13_42_46
    Richardson_2009_Regression_Test.xml  9/9/2009 3:58:41 PM   RESULT: PASS  VERSION TESTED: 10.0.70.0
  2009_12_2___10_47_55
    Richardson_Regression_Test.xml  12/2/2009 1:21:40 PM   RESULT: WARNING  VERSION TESTED: 10.0.138.0
So it will show result status and version tested in the report.
What it does not do is automatically only show a result if the previous version passed and if the new version failed.
Not sure I will have to time to do the logic to compare folders and tests based on version and the change the GUI to be able to display that mode as well as the current operating mode. Considering we do operate that way here and most of this app is based on our operating procedure here. I only have small bits of time to dedicate to this app since its a back burner project behind my current tasks.
I'll see if I can work something out over time though.