Automation: scope and purpose
Posted: Sat Feb 12, 2011 1:08 am
I was discussing scope of Automation with some of our Software engineers (developers) and we can't come to conclusion... So want to ask colleagues, what do you think?
One opinion: main purpose of Software testing Automation is regression testing. So, that every time we build new version - we test, that all tested functionality continues to work, as expected...
Second opinion: main purpose of Software testing Automation (in addition to regression) is "smart" functionality testing. And "smart" testing is testing, in which execution path in not the same every time.
Take for example application, where i enter data in some forms, and then process and save that data in DB.
Now, as example of "regression" testing (1st case) i would take few sets of data (hard coded or stored in Excel file...) and will verify, that expected data shows up in DB.
Example of "smart" testing (2nd case) would be generating "random" data, which entered to forms and then verifying that we got appropriate data in DB.
Both ways can be done.
My question is hows generally testing is done?
Do you usually work on predefined sets of data?
Does your automated steps repeat every time same way?
One opinion: main purpose of Software testing Automation is regression testing. So, that every time we build new version - we test, that all tested functionality continues to work, as expected...
Second opinion: main purpose of Software testing Automation (in addition to regression) is "smart" functionality testing. And "smart" testing is testing, in which execution path in not the same every time.
Take for example application, where i enter data in some forms, and then process and save that data in DB.
Now, as example of "regression" testing (1st case) i would take few sets of data (hard coded or stored in Excel file...) and will verify, that expected data shows up in DB.
Example of "smart" testing (2nd case) would be generating "random" data, which entered to forms and then verifying that we got appropriate data in DB.
Both ways can be done.
My question is hows generally testing is done?
Do you usually work on predefined sets of data?
Does your automated steps repeat every time same way?