Using Excel Files as data sources - very slow behaviour
Using Excel Files as data sources - very slow behaviour
I have a number of data-driven tests which use Excel files as the data sources. Recently I have noticed the performance when binding a source to a test case (and also in the "Manage Data Sources" menu) has become very slow. As an example, yesterday it took me 45 minutes to bind 12 data sources (all were approximately 30 rows * 7 columns).
I have used Task Manager to try and monitor what is happening when Ranorex conducts the bind - neither CPU or memory usage rises by much. However, in the process list it seems to open numerous copies of excel.exe (so many that I lost count). Is this normal?
Although I am reluctant to change the files to another format (I am actually quite fond of Excel!) I am reaching a point where it looks like I have no option, as the performance is far too slow. Does anyone know anything that can be done to improve this?
I have used Task Manager to try and monitor what is happening when Ranorex conducts the bind - neither CPU or memory usage rises by much. However, in the process list it seems to open numerous copies of excel.exe (so many that I lost count). Is this normal?
Although I am reluctant to change the files to another format (I am actually quite fond of Excel!) I am reaching a point where it looks like I have no option, as the performance is far too slow. Does anyone know anything that can be done to improve this?
- Support Team
- Site Admin
- Posts: 12145
- Joined: Fri Jul 07, 2006 4:30 pm
- Location: Houston, Texas, USA
- Contact:
Re: Using Excel Files as data sources - very slow behaviour
Hi,
May I ask you which Ranorex version you are using?
Regards,
Markus
May I ask you which Ranorex version you are using?
Regards,
Markus
Re: Using Excel Files as data sources - very slow behaviour
Sorry for the slow reply: I am using Ranorex version 4.0.2.21666
- Support Team
- Site Admin
- Posts: 12145
- Joined: Fri Jul 07, 2006 4:30 pm
- Location: Houston, Texas, USA
- Contact:
Re: Using Excel Files as data sources - very slow behaviour
Hello,
We had some performance issues which are fixex in our new version (4.0.3)
Please try to update Ranorex to 4.0.3 and let me know if the performance is better.
Please uninstall Ranorex 4.0.2, restart your comupter and install Ranorex 4.0.3.
Please use the setup.exe file or the Ranorex-4.0.3.exe file in order to install Ranorex because if you do this, all prerequisites will be installed automatically.
Regards,
Bernhard
We had some performance issues which are fixex in our new version (4.0.3)
Please try to update Ranorex to 4.0.3 and let me know if the performance is better.
Please uninstall Ranorex 4.0.2, restart your comupter and install Ranorex 4.0.3.
Please use the setup.exe file or the Ranorex-4.0.3.exe file in order to install Ranorex because if you do this, all prerequisites will be installed automatically.
Regards,
Bernhard
Re: Using Excel Files as data sources - very slow behaviour
I have updated to 4.0.3 and there is definitely a performance improvement within the "Manage Data Sources" and "Data Source" menus. However the performance is still pretty dreadful when I exit the "Data Binding" menu:
- I right-click on a test case and choose "Data Sources..."
- I choose the spreadsheet that is my Data Source
- In the Data Binding tab I usually use the 'Auto-Bind' option, as typically the top row of the spreadsheet matches the names of my variables
- I click OK to return to Test Suite: the Data Sources menu vanishes almost immediately but then Ranorex spends between 3 and 5 minutes working (the "working cursor" is visible, and I am unable to interact with anything within Ranorex) before I have control over Ranorex again. It is during this period I can see in Task Manager that multiple excel.exe processes are being created.
In the current test suite I am developing there are close to 50 different spreadsheets I need to bind, so you can understand my frustration when I have to wait up to 5 minutes to bind just one.
- I right-click on a test case and choose "Data Sources..."
- I choose the spreadsheet that is my Data Source
- In the Data Binding tab I usually use the 'Auto-Bind' option, as typically the top row of the spreadsheet matches the names of my variables
- I click OK to return to Test Suite: the Data Sources menu vanishes almost immediately but then Ranorex spends between 3 and 5 minutes working (the "working cursor" is visible, and I am unable to interact with anything within Ranorex) before I have control over Ranorex again. It is during this period I can see in Task Manager that multiple excel.exe processes are being created.
In the current test suite I am developing there are close to 50 different spreadsheets I need to bind, so you can understand my frustration when I have to wait up to 5 minutes to bind just one.
- Support Team
- Site Admin
- Posts: 12145
- Joined: Fri Jul 07, 2006 4:30 pm
- Location: Houston, Texas, USA
- Contact:
Re: Using Excel Files as data sources - very slow behaviour
Hi,
We will analyze in detail what could be the cause for this issue and we will get back to you as soon as we know more about it.
Regards,
Markus
We will analyze in detail what could be the cause for this issue and we will get back to you as soon as we know more about it.
Regards,
Markus
Re: Using Excel Files as data sources - very slow behaviour
Please note: I tried replacing one of the ExcelDataConnector data sources with a SimpleDataConnector data source, but I had the same problem when binding it, i.e. a dozen or so Excel.exe processes opened and it took about 3 minutes to complete the operation.
If it assists your investigation, I am using Windows Vista Business SP2, 3GHz dual-core Intel processor with 4GB RAM (of which typically about 2GB is free when I am testing with Ranorex); for Excel, I use MS Office 2007. I have tried freeing-up more memory to see if it helps, but it has not made a difference.
If it assists your investigation, I am using Windows Vista Business SP2, 3GHz dual-core Intel processor with 4GB RAM (of which typically about 2GB is free when I am testing with Ranorex); for Excel, I use MS Office 2007. I have tried freeing-up more memory to see if it helps, but it has not made a difference.
Re: Using Excel Files as data sources - very slow behaviour
Some extra information regarding this problem: the more data sources I bind, the longer each bind takes. It is approaching 6 minutes per bind for me now 
Below is a picture of my CPU and RAM usage during a bind. By my estimate, the total length of the "Physical Memory Usage History" graph is 4 minutes - that graph is not wide enough to display the memory usage for the duration of a single bind! You can see that my memory and CPU use are moderate throughout, although the CPU usage spikes every 6 seconds.

We have also examined the Resource Monitor while a bind is happening - we noticed there was a large amount of hard-disk I/O, so it has been suggested I defragment my hard-disk tonight (I'll let you know the results tomorrow). What is unusual is that both the Ranorex project and the spreadsheets are on a server, yet I barely see any network usage.

Below is a picture of my CPU and RAM usage during a bind. By my estimate, the total length of the "Physical Memory Usage History" graph is 4 minutes - that graph is not wide enough to display the memory usage for the duration of a single bind! You can see that my memory and CPU use are moderate throughout, although the CPU usage spikes every 6 seconds.

We have also examined the Resource Monitor while a bind is happening - we noticed there was a large amount of hard-disk I/O, so it has been suggested I defragment my hard-disk tonight (I'll let you know the results tomorrow). What is unusual is that both the Ranorex project and the spreadsheets are on a server, yet I barely see any network usage.
Re: Using Excel Files as data sources - very slow behaviour
Just a suggestion, did you try to use the CSV instead of xls? I know, it may not be a perfect solution, but who knows, maybe a lighter and straightforward CSV could help here?
Pavel Kudrys
Ranorex explorer at Descartes Systems
Please add these details to your questions:
Ranorex explorer at Descartes Systems
Please add these details to your questions:
- Ranorex Snapshot. Learn how to create one >here<
- Ranorex xPath of problematic element(s)
- Ranorex version
- OS version
- HW configuration
- Support Team
- Site Admin
- Posts: 12145
- Joined: Fri Jul 07, 2006 4:30 pm
- Location: Houston, Texas, USA
- Contact:
Re: Using Excel Files as data sources - very slow behaviour
Hi,
We analyzed the performance issue with huge Excel files and the slowdown is unfortunately an issue on our site.
This should be solved, the performance should be increased with one of the next Ranorex releases.
Regards,
Markus
We analyzed the performance issue with huge Excel files and the slowdown is unfortunately an issue on our site.
This should be solved, the performance should be increased with one of the next Ranorex releases.
Do you execute the tests via a RDP window? If so is the Task Manager of the screenshot the one of the server or of your client machine? Or are the files located on a "network drive" and you execute them on your machine?What is unusual is that both the Ranorex project and the spreadsheets are on a server, yet I barely see any network usage.
Regards,
Markus
-
- Posts: 1
- Joined: Sat May 04, 2013 8:38 am
- Contact:
Re: Using Excel Files as data sources - very slow behaviour
I think you must uninstall Microsoft office documents all file then reinstall it with a original version.
Re: Using Excel Files as data sources - very slow behaviour
Thanks for replies:

I did try the CSV and it didn't make any noticable difference.Just a suggestion, did you try to use the CSV instead of xls? I know, it may not be a perfect solution, but who knows, maybe a lighter and straightforward CSV could help here?
SweetWe analyzed the performance issue with huge Excel files and the slowdown is unfortunately an issue on our site.
This should be solved, the performance should be increased with one of the next Ranorex releases.

RDP is not used - the files are on the network drive and I execute them on my machine.Do you execute the tests via a RDP window? If so is the Task Manager of the screenshot the one of the server or of your client machine? Or are the files located on a "network drive" and you execute them on your machine?
Having devoted all that time to bind the data sources I don't want to risk anything that could cause them to unbind! I will await the Ranorex update and see how it improves.I think you must uninstall Microsoft office documents all file then reinstall it with a original version.
- Support Team
- Site Admin
- Posts: 12145
- Joined: Fri Jul 07, 2006 4:30 pm
- Location: Houston, Texas, USA
- Contact:
Re: Using Excel Files as data sources - very slow behaviour
Hi,
Just one last question, have you also tried to copy them to a local drive respectively to your project (by checking the "Copy File to Project)?
Regards,
Markus
Just one last question, have you also tried to copy them to a local drive respectively to your project (by checking the "Copy File to Project)?
Regards,
Markus
Re: Using Excel Files as data sources - very slow behaviour
The Ranorex project files are on the network drive while Ranorex Studio is installed on my computer, so I access the project files across our network; this ensures the project files are included within our server's nightly backup routine. Whenever I create a new data source from an Excel spreadsheet, I always use the 'Copy File To Project' option, to ensure the spreadsheets are also backed-up.
- Support Team
- Site Admin
- Posts: 12145
- Joined: Fri Jul 07, 2006 4:30 pm
- Location: Houston, Texas, USA
- Contact:
Re: Using Excel Files as data sources - very slow behaviour
Hi,
Thanks for the information!
In general it is not recommended to run your projects from a network drive, since this could cause several problems.
Regards,
Markus
Thanks for the information!
In general it is not recommended to run your projects from a network drive, since this could cause several problems.
Regards,
Markus