Hi,
I've tested ranorex for some days now, created "MyTest", recorded some trivial tests and executed them successfully. I've then used the "MyTest.exe" to execute the tests at night on my Hudson build server. No problems so far.
Now the solution grew into multiple projects with a lot of modules and some user code and I'm facing some problems or have some questions: First of all, there are more than one exe file. I thought there would be one exe file for the whole solution / test suite and dlls for all the child projects, right? Why there are multiple exe files? Which exe should I use to run the tests on the build server? Can I use a single exe to execute the test suite including other projects or do I have to call multiple exe files?
thanks,
Tim
How to execute my test suite on my build server?
Re: How to execute my test suite on my build server?
Hi
We have Ranorex running on Jenkins/Hudson. I would be happy to share some experience.
- We have separate Ranorex solutions which share one project (which holds the repositories, functions & code modules).
- We build the projects in a single Jenkins job using MSBUILD and deploy all the tests to a server as a zip file.
- We have individual jobs to execute the different tasks (although a multi project build could be used for this as well..)
- I use the publish html + xunit test plugin to visualize test results.
- I execute only one exe file for each individual test solution. What exe files to you get as a result?
We have Ranorex running on Jenkins/Hudson. I would be happy to share some experience.
- We have separate Ranorex solutions which share one project (which holds the repositories, functions & code modules).
- We build the projects in a single Jenkins job using MSBUILD and deploy all the tests to a server as a zip file.
- We have individual jobs to execute the different tasks (although a multi project build could be used for this as well..)
- I use the publish html + xunit test plugin to visualize test results.
- I execute only one exe file for each individual test solution. What exe files to you get as a result?
Re: How to execute my test suite on my build server?
Hi,
thanks for sharing your experience.
Could you share your MSBuild file please?
Thanks
Tim
BTW: I normally work with Java, so I know the concepts of build and test tools, I just don't have any experience in the Microsoft world so I have to ask alot of dumb questions, sorry.
thanks for sharing your experience.
Do you mean, you have different .rxsln files and switch between them when using Ranorex Studio?- We have separate Ranorex solutions which share one project (which holds the repositories, functions & code modules).
So you only checked the source files into your the VCS and produced executables inside the build? That's great and surly the way to go. However, since I have no experience with .Net, C# and MSBuild I just commit the .exe and .dll files too, right now.- We build the projects in a single Jenkins job using MSBUILD and deploy all the tests to a server as a zip file.
Could you share your MSBuild file please?
How did you configure this? I guess you choose "Custom Tool", right? How does your "Pattern" look?- I use the publish html + xunit test plugin to visualize test results
Thanks
Tim
BTW: I normally work with Java, so I know the concepts of build and test tools, I just don't have any experience in the Microsoft world so I have to ask alot of dumb questions, sorry.
Re: How to execute my test suite on my build server?
Yes. We have different test scenarios, which cover different areas of our application.Do you mean, you have different .rxsln files and switch between them when using Ranorex Studio?
Its actually quite easy using MSBUILD. I have a simple batch script (which I want to replace by a proper gradle solution) which compiles all the tests and deploys an archive to a server (thats one jenkins job) and a jenkins job per test scenario/Ranorex Solution to run them.So you only checked the source files into your the VCS and produced executables inside the build? That's great and surly the way to go. However, since I have no experience with .Net, C# and MSBuild I just commit the .exe and .dll files too, right now.
I've sent you an PM. Just send me an email and we can share this stuff and maybe put together some documentation on this. What do you think?
Re: How to execute my test suite on my build server?
Sorry I haven't updated my posting, I am some step further now.
My setup is the following now:
1. I only checkin sources into SVN ignoring binaries and reports (*.rxuser, *.jpg, *.rxlog, Reports, bin, obj). See Ranorex & VCS topic.
2. I've written a NAnt build file to compile the projects
3. I set up a Hudson/Jenkins job to compile and execute the tests
My setup is the following now:
1. I only checkin sources into SVN ignoring binaries and reports (*.rxuser, *.jpg, *.rxlog, Reports, bin, obj). See Ranorex & VCS topic.
2. I've written a NAnt build file to compile the projects
3. I set up a Hudson/Jenkins job to compile and execute the tests