Hi,
We are currently using Ranorex to test a large scale product and our test suite which we are constantly adding to currently runs for 4.5 hrs. We are planning on splitting this into a few smaller test suites, however the problem I am seeing looking through the forums is that there does not seem to be a solution for combining test reports. Is there any planned fix/feature for this issue as I see there are a few people in the forums experiencing the same issue?
Thank you.
Multiple Test Suites
- Support Team
- Site Admin
- Posts: 12145
- Joined: Fri Jul 07, 2006 4:30 pm
- Location: Houston, Texas, USA
- Contact:
Re: Multiple Test Suites
Hi,
Maybe you can give us an example? How should these combined test reports look like?
Regards,
Markus
Ranorex Support Team
So you want to include one test report into another, or just specific test cases or recordings?does not seem to be a solution for combining test reports.
Maybe you can give us an example? How should these combined test reports look like?
Regards,
Markus
Ranorex Support Team
-
- Posts: 169
- Joined: Thu Jan 13, 2011 2:06 pm
Re: Multiple Test Suites
Hi Markus,
I would like to combine multiple test reports into one so that it looks like one test report. Each test report could just be a a different parent folder.
So as below Test Suite 1 and 2 would be individually generated test reports. The Master Suite level would be the combination and would show the coverage percentage/number and the pie graph.
Master Suite (75%)
Test Report Test Suite 1 (100%)
Test A - Pass
Test B - Pass
Test Report Test Suite 2 (50%)
Test C - Pass
Test D - Fail
Thanks for any help
I would like to combine multiple test reports into one so that it looks like one test report. Each test report could just be a a different parent folder.
So as below Test Suite 1 and 2 would be individually generated test reports. The Master Suite level would be the combination and would show the coverage percentage/number and the pie graph.
Master Suite (75%)
Test Report Test Suite 1 (100%)
Test A - Pass
Test B - Pass
Test Report Test Suite 2 (50%)
Test C - Pass
Test D - Fail
Thanks for any help
- Support Team
- Site Admin
- Posts: 12145
- Joined: Fri Jul 07, 2006 4:30 pm
- Location: Houston, Texas, USA
- Contact:
Re: Multiple Test Suites
Hi,
I will add this to our internal feature request list and we will internally discuss this if we will implement such an feature in a future release.
Thanks for this input!
Regards,
Markus
Ranorex Support Team
I will add this to our internal feature request list and we will internally discuss this if we will implement such an feature in a future release.
Thanks for this input!
Regards,
Markus
Ranorex Support Team
-
- Posts: 169
- Joined: Thu Jan 13, 2011 2:06 pm
Re: Multiple Test Suites
Markus,
No problem. I played around with the XML that was generated by ranorex the other day ( we select to generate an XML file rather than an RXLOG ). It seems as if this could be done fairly easily by combining the 3rd nested activity node in the XMLs. By pulling out this node ( and all it's children ) and adding it to the second generated XML file at the same level the pie graph at the top combines the two reports. The only thing that didn't work was the duration since that is at the 2nd nested activity node level, rather than reading it from the 3rd set of nodes.
Hope this helps!
-Nick
No problem. I played around with the XML that was generated by ranorex the other day ( we select to generate an XML file rather than an RXLOG ). It seems as if this could be done fairly easily by combining the 3rd nested activity node in the XMLs. By pulling out this node ( and all it's children ) and adding it to the second generated XML file at the same level the pie graph at the top combines the two reports. The only thing that didn't work was the duration since that is at the 2nd nested activity node level, rather than reading it from the 3rd set of nodes.
Hope this helps!
-Nick
- Support Team
- Site Admin
- Posts: 12145
- Joined: Fri Jul 07, 2006 4:30 pm
- Location: Houston, Texas, USA
- Contact:
Re: Multiple Test Suites
Hi Nik,
You can of course copy/manipulate the xml code, but this is not supported/recommended as it can cause side effects.
For example if you want that the total duration is shown, you have to manually set the specific duration tag to the new value.
Regards,
Markus
Ranorex Support Team
You can of course copy/manipulate the xml code, but this is not supported/recommended as it can cause side effects.
For example if you want that the total duration is shown, you have to manually set the specific duration tag to the new value.
Regards,
Markus
Ranorex Support Team
-
- Posts: 169
- Joined: Thu Jan 13, 2011 2:06 pm
Re: Multiple Test Suites
Markus,
It was actually fairly easy to do with a Python script. I was able to combine our 4 new test reports into one and show the pie chart and combined run time based on the xml that was generated from Ranorex.
I attached the script I wrote if anyone is interested in using it. Place this python script in the folder where the multiple XML files are generated and run it once to get a singular XML file.
Thanks,
-Nick
It was actually fairly easy to do with a Python script. I was able to combine our 4 new test reports into one and show the pie chart and combined run time based on the xml that was generated from Ranorex.
I attached the script I wrote if anyone is interested in using it. Place this python script in the folder where the multiple XML files are generated and run it once to get a singular XML file.
Thanks,
-Nick
You do not have the required permissions to view the files attached to this post.
-
- Posts: 1
- Joined: Mon Nov 11, 2013 6:14 pm
Re: Multiple Test Suites
I know this is an old thread but I was curious if this was ever implemented or will I have to do something like tallahassee101 to get these reports combined. Do to the size and scale of our application our shop also broke our tests suites out for manageability and multithreading reason.
If anyone has any further information on this and would care to pass it along I would greatly appreciate it.
Thanks,
Jarred
If anyone has any further information on this and would care to pass it along I would greatly appreciate it.
Thanks,
Jarred
- Support Team
- Site Admin
- Posts: 12145
- Joined: Fri Jul 07, 2006 4:30 pm
- Location: Houston, Texas, USA
- Contact:
Re: Multiple Test Suites
Hello Jarred,
We discuss to add a possibility to combine multiple test reports in a future release.
I am sorry but I could not specify a certain release date at the moment.
Regards,
Markus (T)
We discuss to add a possibility to combine multiple test reports in a future release.
I am sorry but I could not specify a certain release date at the moment.
Regards,
Markus (T)
-
- Posts: 1
- Joined: Thu Apr 16, 2015 2:57 pm
Re: Multiple Test Suites
Hello support team ,
i know this is an old thread, i would like to know the following information.
1. The status issue (planning/implemented/obsolete)?
2. Are there any custom solution or work around for this issue?
Regards
Guru
i know this is an old thread, i would like to know the following information.
1. The status issue (planning/implemented/obsolete)?
2. Are there any custom solution or work around for this issue?
Regards
Guru
- Support Team
- Site Admin
- Posts: 12145
- Joined: Fri Jul 07, 2006 4:30 pm
- Location: Houston, Texas, USA
- Contact:
Re: Multiple Test Suites
Hello Guru,
I'm afraid to tell you that the feature is not going to be implemented in the near future.
Unfortunately, we can't provide any workarounds at the moment.
Thank you for your understanding.
Regards,
Johannes
I'm afraid to tell you that the feature is not going to be implemented in the near future.
Unfortunately, we can't provide any workarounds at the moment.
Thank you for your understanding.
Regards,
Johannes
Re: Multiple Test Suites
Instead of creating new suites in existing projects, you could just create new projects under the solution, making sure to select Ranorex Test Suite as the type of project.
I use this method for all of my tests and it works very will.
I have one CORE project that contains all of my modules. When you then place one of those modules in the new test suite, the project automatically updates to include the CORE project as a dependency.
I use this method for all of my tests and it works very will.
I have one CORE project that contains all of my modules. When you then place one of those modules in the new test suite, the project automatically updates to include the CORE project as a dependency.
Shortcuts usually aren't...