Future of Functional Test Automation

Download Report

Transcript Future of Functional Test Automation

Test Managers Forum – Jan 2008
THE FUTURE OF TEST
AUTOMATION
Q. IS IT OPENSOURCE?
Facilitator - Duncan Brigginshaw
Director, Odin Technology Ltd.
The Rise of OpenSource
Development/Test Tools
CM – CVS,Subversion
IDE – Eclipse
Jboss
Unit Testing – JUnit, NUnit
Applications
34.8% IT managers polled have Jboss - BZ
Research 2006
Middleware
Apache, MySQL
50.8% Webservers Market Share (Netcraft 2007)
Servers
44% RDBMS Market share (EDC 2007)
Linux, FreeBSD
37.6% Servers Market Share (IDC Projection 2008 )
Operating Systems
Build Tools – Ant, Nant
Current Commercial Tools

Current Market Leaders:
HP Mercury, IBM Rational, Compuware, Empirix,
Borland
Others - AutomatedQA, Seapine, Original, Odin

Tool Architecture –



IDE with Language, Recorder, Visual Creation Tools,
Wizards, Mapping tools, Logs, Execution
Open Source Testing Tools


Current Available 70+
Strongest Presence

Watir/Watin/Watij




Selenium




Javascript browser tool – Tests in Tables or .NET, Java, Perl, Python, Ruby
Selenium IDE, Molybdenum, Selenium RC
www.opensourcetesting.org – 100,000+ Registered Users
Others


Web Application Testing In Ruby/.NET/Java
Huge resource of supporting tools – Firewatir, Watir Recorder ++, Wet, Cubictest,
Visual Studio
58,000 Downloads (to 18th Jan 2008)
Sahi, PyWinAuto, Floyd, Frankenstein, AutoIT, Abbot/Costello
Load & Performance 35+

WebLoad (RadView), Jmeter, OpenSTA
Is OpenSource the Future for Test
Automation?
Skills - Resources

Commercial tools have a large base of Experts
How are tools “really” used?
 Table/Data driven Frameworks (Homegrown and
commercial)


Open source tools rely on a “Mainstream” Programming
Language for scripting and development


C#, Java, Ruby, Python
Could a Developer be the Tool Expert?
Support & Maintenance


OpenSource has support facilities
It’s OpenSource!
 Fix


your own issues – contribute
Adapt, extend, contribute new features
Could hiring an OpenSource Developer replace a
commercial support function?
Training

Surprisingly commercial training is available!

Watir and Junit/Nunit training courses:


Other Open Source training



www.trainingpages.com
http://www.opensourcetraining.co.uk/
Training in C#, Ruby, Python, Java readily available
Frameworks tend to be written in house and training
developed (or commercial frameworks)
Supported Environments


Objection – Lack of Environment support and
Integration (Test management, CM)
Who is part of a Web (Browser) or WebService
based development project?
 What


are the others?
Most commercial tools have open APIs.
Build it! – It’s Opensource after all.
Conclusions