Transcript Document

Jan 2015
Spritz
Scriptless Test Automation Platform
© 2015 Cognizant
© 2015 Cognizant
How Scripts pose the bottle-neck to realizing ROI
Increased Script
Maintenance Effort
Complex Scripting
Languages
Frequent UI changes
makes scripts brittle
Majority effort spent on
maintaining scripts
Inability of Business
Users to understand test
scripts
© 2015 Cognizant
Quality Dependent on
individual scripting
knowledge
Programmers are expensive
Specialized staff
Considerable time and
effort involved in
More documentation needed
learning tools
to make scripts
understandable
Scripts are Non Business
User Friendly
1
Increased Script
Development Effort
Different tools have
different scripting
languages
Script based tools involve
Steeper Learning Curve
Higher cost of
Automation & lower
ROI
Go
Script-less
As Scripts are the bottle-neck when it comes to accelerating Automation
2
© 2015 Cognizant
Introducing
Cognizant
© 2015 Cognizant
Users perform actions on objects on the screen with their inputs
Object
Action
Input
Eliminate Scripts
Abstract the user actions with three simple fields
Focus Areas
Ease Of Use
4
© 2015 Cognizant
Scalability
User Friendly
Agile Ready
How Spritz works
1 Design
Start Automation design early before
UI is ready with wireframes
Before GUI is ready
Use inbuilt Action keywords
to build tests with
parameterized test data
Test step design can begin
even before application is
ready.
2 Update
Automate just when UI is ready with
Just-in time Object Mapping
GUI is ready
Update object repository
in Spritz once the UI is
ready
3 Execute
Run tests on multiple browsers
and generate reports
© 2015 Cognizant
Maintain Tests easily with SelfDocumentation feature
Test Execution
Changes in UI
Choose the browser type
and run your tests
Use Object healer to
dynamically update Object
Repository
Spritz engine reads the
keywords, interprets test
cases and executes tests –
supports concurrent
execution
Changes reflected across
relevant test cases to reduce
maintenance effort
Generate intuitive business
friendly reports
5
4 Maintain
Features
CRAFT
Selenium
WebDriver
Ease Of Use
Inbuilt IDE with Recorder for
ease of use
6
© 2015 Cognizant
Sikuli
Appium
Automation
Engine
Underlying
AutomationFramework
Platform














Script-less Model for Business Users
Object Repository & Spy
Object Healing for Agile
Exploratory Testing Support
Customized Reporting
Data Driven Testing
Robust Error Handling
Batch Execution
Mobile Browser Test Automation
Responsive Web Design
Image Based Automation
Multi-Browser Support
Multi-Platform Support
Distributed Execution Support
Scalability
User Friendly
Agile Ready
Best In Class & Flexible
Data Parameterization
Exhaustive & Expandable
Library of Actions
Intelligent & Adaptable
Object Identifier
Mobile Browser Test Automation
Repurpose Spritz tests for mobile
browser test automation
Responsive web design test
automation
Reuse tests across multiple
platforms/devices
Cross Platform
Support
IOS – 6,7,8,8.1
Android – 2.3 and above
7
© 2015 Cognizant
Execute on native
browsers
Chrome on Android
Safari on iOS
Automated tests for RWD sites
Functional, Smoke and Regression testing
Automate both on real devices and
Simulators/emulators
iPhone/ iPad Simulator, Android emulators
iPhone 5, iPhone6, iPad,
Exploratory Testing Support
‘Exploratory testing is a free-form testing with a defined charter’
Exploratory testing is simultaneous learning, test design, and test execution
Support ‘user acceptance’
without constraints scripted
testing
Record unstructured free-form
tests to Spritz
Repurpose tests between
mobile & desktop applications
Integrate defect reporting to
JIRA/QC
Record
every step during manual
execution
8
© 2015 Cognizant
Document
comments and notes on the
fly
Annotate
Screen capture for easy
documentation
Submit defects
directly to defect management
system
Platforms Supported
Operating Systems
IOS – 6,7,8,8.1
Android – 2.3 and above
Mobile Operating Systems
Desktop Browsers
Chrome on Android
Safari on iOS
Mobile Browsers
*As Spritz uses Selenium engine for web application automation, it supports
all versions of OS and browsers supported by Selenium.
9
© 2015 Cognizant
Two Roles, One Platform
Use Wireframe, come up with test cases
Create Business Components
& define flow
Capture Objects &
associate with tests
Inject custom scripts & expand library
10
© 2015 Cognizant
Run test cases in different
environments/platforms
Create Test Data & parameterize
Business User
Technical User
Heal objects in case of updates
Debug, maintain objects & test cases
Case Study
The client is an American electronics retail stores company
Business Challenges
The Objectives
• The web application is an e-commerce website developed and tested using
an Agile methodology with 2 releases /month.
• Additionally, the application needed to be tested across multiple browsers
which further magnified the execution effort involved.
• Selenium was thus being considered. However the complex nature of the
tool that required resources with programming skills and the lack of an out
of the box framework posed a challenge in its adoption.
• Reduce the huge execution time and
effort involved in the manual approach
• Perform multi browser testing through an
automated solution
• Utilize the features of Selenium for
automation
Spritz was implemented resulting in the below tangible benefits
11
Test Design Effort Saved
Execution Effort Saved
Detailed Reporting
50% savings in test design efforts. Scriptless approach and the intuitive UI
simplified automation and enabled rapid
test development
65% reduction in test execution time
achieved through parallel and distributed
execution on multiple browsers using
Spritz.
The detailed test coverage report generated
by Spritz was also received well by the
customers.
Rapid Test Development
Increased Reusability
User friendly IDE with drag-drop and auto
complete features enabled rapid test
development
60-70% reusability achieved using the
component grouping feature in Spritz thus
reducing the test design and maintenance
efforts.
© 2015 Cognizant
Faster Acceptance Tests
Enabled faster acceptance tests of end to
end in 8 hours compared to 50 hours
manually across all browsers
Case Study
The customer is an American retailer of home improvement and construction products and services
Business Challenges
The Objectives
• A highly agile web application with around 425 tests required an
automation solution that aligned to their agility needs.
• The customer was also looking for a tool with simple and rapid script
development capabilities.
• The tools that were considered were Selenium and HP UFT however, the
tools needed programming knowledge and involved high maintenance
effort.
• Develop a hybrid resource pool
consisting of manual testers for
performing automation.
• Identify and use an automated solution to
meet the agile testing needs
• Perform cross browser testing using a
single automation solution
Spritz was implemented resulting in the below tangible benefits
Execution Effort Saved
15% savings in test design efforts when
compared to the scripted approach using
Selenium.
20% savings in test execution effort
achieved through multi-threaded parallel
execution features of Spritz.
Spritz helped Manual & Dev teams to adopt
automation for their testing purposes and has
helped the organization to build a Hybrid
resource pool set.
High Automation Coverage
Faster Acceptance Tests
Spritz enabled automation of 355 Tests out
of the total of 425 test cases thus providing
a high automation coverage of 83%.
Enabled faster acceptance tests of end to
end in 8 hours compared to 50 hours
manually across all browsers
Maintenance Effort Saved
18% savings in test maintenance effort
compared to scripted approach achieved
through object healing and component
grouping features of Spritz.
12
Hybrid resource pool
Test Design Effort Saved
© 2015 Cognizant
Competitive Market – Script-less Automation
“Qualitia’s script
supportive as it
frameworks by
users/enterprises
Gartner
less test automation platform is extremely
removes challenges around custom built
eliminating programming and enabling
to build reliable functional test automation.” –
Odin Technology's Axe is a ground-breaking test automation
platform for the enterprise. It uses a simple spreadsheet
interface allowing non-technical testers to build effective test
scenarios faster, automatically generating code and
documentation for a wide range of both commercial and open
source Test Automation and ALM toolsets.
Reduce total time to automate tests by 50% to 70%.
Reduce total cost of ownership by 45% to 60%. No
programming required.
Increase ROI – Reliable & Scalable (Custom Object support)
• Sample vendor of Gartner’s Hype Cycle, 2012.
13
© 2015 Cognizant
Script-less Automation -What does the industry say?
Cost Effective
45% Reduction in Overall Cost Of Automation
Script-less automation helps reduce the cost of resources by 54.7%, reduce the cost of training by 60% and the overall
cost of automation decreases by 45%
- Qualitia Software
Effective Early Defect Detection
80% Reduction in Production Defect Rates
Script-less automation with object based design strategy results in earlier defect discovery and production defect rates
dropping by as much as 80%.
- Worksoft Certify
Enhanced Productivity
40% Reduction in Time to Automate
Time-to-automate shortens by almost 40% .Going script-less ensures your testing team(s) can automate large test
suites 1.6 times faster than ever before
- Qualitia Software
Reduced Project Cycle Times
55%
Reduction in Project Cycle Times
Greater Stakeholder involvement reduces project cycle time - IBM report on Worksoft Certify
Flatter the Learning Curve
50%
Reduction in Training Duration
The training duration reduces by 50% when compared to standard test automation approach. It can reduce your cost of
training by up to 60%
- Qualitia Software
14
© 2015 Cognizant
Script-less Testing Tools Comparison
Cognizant
Qualitiasoft
Odintech
Automation
Anywhere
TOSCA
Spritz
Qualitia
Axe
Testing Anywhere
Tricentis
IDE





Platform Independent





Integration with CI tools





Object Repository / Spy





Data Driven





Intelligent Object Healer





Distributed Execution





Image Based Automation





Recorder





Exploratory Testing support





Independent executable test suite





Mobile RWD support





Licensing / Pricing
Value-add
Commercial
($1200/month)
Commercial
(Not Available)
Commercial
($7000/year)
Commercial
(€16,780)
Features
15
Tools
© 2015 Cognizant
*This is a generic comparison based on our experience. However its required that Cognizant perform tools and accelerator suitability
assessment prior to commencement of the engagement and the implementation if found suitable
All Prices are indicative
Spritz Vs Market leading tools
Note: Feature comparison of Spritz with some other tools is provided in the attachment. This is a generic comparison based on
our experience. However its required that Cognizant perform tools and accelerator suitability assessment prior to commencement
of the engagement and the implementation if found suitable.
16
© 2015 Cognizant
Thank you
© 2015 Cognizant