Transcript Test Automation on Steroids / What is it and why is it

Accelerated Testing in a
continuous delivery process
Steven Brown
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Agenda
The Evolution of Testing
Vision for Test Automation Acceleration
Test Center of Excellence
STCA
2
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
The Evolution of Testing
3
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Paradigm Shift
Focus changing from Technology to Business Driven
Business Oriented
Technology Oriented
Process optimization
driven with the focus on:
 EFFECTIVENESS
 EFFICIENCY
20%
80%
Do More with the same or LESS
 Agile
 SCRUM
 RAD
4
80%
20%
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
4
In the beginning, functional testing was all
manual…
Manual
0%
Test Cycle Time = 6 weeks*
Test Data for Execution in Test
Environments
Test Data Requirements
Requirement
Definition
Test Design
Design
Test Repository
Test Execution
Build
* On average for an SAP, Oracle eBusiness suite, or Siebel etc. grade system
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Test & Accept
Reporting
Then ALM provided a repository for test
assets…
Automated
Manual
20%
Test Cycle Time = 4 weeks*
Test Data for Execution in Test
Environments
Test Data Requirements
Requirement
Definition
Test Design
Design
Test Repository
in ALM
Build
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Test Execution
Test & Accept
Reporting in
ALM
After that, test execution was automated…
Automated
Manual
40%
Test Data for Execution in Test
Environments
Test Data Requirements
Requirement
Definition
Test Design w/
BPT/UFT
Design
Test Cycle Time = 2 weeks*
Test Repository
in ALM
Build
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Test Execution
with Sprinter
and UFT
Test & Accept
Reporting in
ALM
And then test preparation was fully
automated…
Automated
Manual
Test Cycle Time = < 2 days*
Prepare Test Data with DataMaker®
Requirement
Definition with
Agile Designer®
Design
Test Design in
Agile Designer +
ITAS
Test Data for Execution in Test
Environments generated from
scripts in Test Data Warehouse
Test Repository
in ALM
Build
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
90%
Test Execution
with Sprinter
and UFT
Test & Accept
Reporting in
ALM
Save time & money, whilst increasing quality…
Automation
Manual
Test Cycle Time = < 2 days
Test Data for Execution in Test
Environments generated from
scripts in Test Data Warehouse
Prepare Test Data with
DataMaker®
Requirement
Definition with
Agile Designer®
Design
Test Design in
Agile Designer +
ITAS
90%
Test
Repository in
ALM
Build
Test Execution
with Sprinter
and UFT
Test & Accept
* Down to minutes for smaller/web applications! Full SAP/Oracle system in less then 2 days!
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Reporting in
ALM
Vision for Test Automation
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Test Automation
ALM with traditional Test Automation
Design
Build
Test & Accept
HP Application Lifecycle Management
Release Management
Requirements Management
Test Planning
Test Execution
Automated testing happens too late in the
software development life cycle, especially when
Working in Agile environments
11
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Defect Management
Analysis & Reporting
HP UFT / BPT
Record & Replay
** CONFIDENTIAL // INTERNAL **
Keyword Driven
Testing
Execution Engine
Test Automation
Accelerated testing that fits in a continuous delivery process
Design
Build
Test & Accept
HP Application Lifecycle Management
Release Management
Requirements Management
Test Planning
Test Execution
ITAS and UFT
Agile Designer
Requirement & App Flow Design
Test Case Paths generation
Test Data Generation (Datamaker)
Defect Management
Analysis & Reporting
Accelerated Test Automation
Out of the box support for major applications
Unified Applications Inspector
Support for continuous integration.
Shift testing left in delivery process.
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Business Execution Reporting
Technical Change Analysis
Native Integration with ALM products
Test Automation
Accelerating Test Automation with ITAS

ITAS is a test automation accelerator that reduces
test authoring and maintenance efforts traditionally
associated with test automation tools. This allows
ITAS customers to deploy test automation quicker in
order to spend more time testing their applications
and less time creating or maintaining test scripts.

ITAS can ensure customers:

Ability to test their end to end business process in an
efficient and effective manner;

Leverage on test automation much earlier in the
software development lifecycle;

Greatly reduce maintenance costs ensuring lower Total
Cost of Ownership and quicker ROI.
13
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
** CONFIDENTIAL **
Test Automation
ITAS Solution Overview
AUT
Out of the box BPT
components
14
Unified Applications
Inspector
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Multi-platform
support
Build on top of
HP ALM
Test Automation
ITAS in action…
Script Initializer
Launch App & Login
Navigate App

Inspected screen
Set value to field A
Set value to field B
Set value to field C
App Logout
Test Scenario
Create PO
1) Application Inspection
15
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
2) Test Composition
** CONFIDENTIAL **
3) Run
Return on Investment
Effort in Hours
Total Effort Comparison Based on Average 40 Business Processes
ROI with
traditional
automation in
5-6 Test Cycles
ROI with ITAS
in 2-3 Test
Cycles
16
Number of Test Cycles
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Recorded Demo
Accelerated testing that fits in a continuous delivery process
Design
Build
Test & Accept
HP Application Lifecycle Management
Release Management
Requirements Management
Test Planning
Test Execution
ITAS and UFT
Agile Designer
Requirement & App Flow Design
Test Case Paths generation
Test Data Generation (Datamaker)
Defect Management
Analysis & Reporting
Accelerated Test Automation
Out of the box support for major applications
Unified Applications Inspector
Support for continuous integration.
Shift testing left in delivery process.
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Business Execution Reporting
Technical Change Analysis
Native Integration with ALM products
Test Center of Excellence
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Test Center of Excellence
Definition
The TCOE is a unit within an organization that is responsible for:
• Establishing Testing Policies
• Defining Testing Processes and training staff in their use
• Establishing what Testing Tools will be used by the organization, procuring them
centrally from suppliers and training staff in their use
• Testing Delivery Management using a centralized testing team either in-house or
outsourced to a supplier.
HP recommends that enterprises establish a TCOE and implement
the vision for test automation and test data management
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
TCOE
Goals
Test data is sufficiently
complete to enable all
requirements to be tested
Test data does not contain
sensitive or personally
identifiable information
Test cases are prepared and
executed so that all
requirements are tested
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
All stages of testing are
automated from point at
which requirements are
defined, through test case
preparation and test
execution, to the production
of test results
The duration of a test cycle
is reduce to less than 2 days
for large systems, and
minutes for smaller/web
applications.
Why engage HP to put Test Automation ‘on
Steroids’ (TAoS) to grow towards a Test Center of
Excellence (TCoE)?
More apps demanded  more, faster & better testing is needed!
Why
TCoE?
1
2
3
4
Increased stability
in production
Lowered cost
Fast delivery
Reduced risk
& rework
(must have for Agile!)
Realize value quickly and remain doing so, whilst enabling DevOps and Enterprise Agile!
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Strategic Test Coverage Assessment
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Strategic Test Coverage Assessment
“To deliver a step by step blueprint on how to create a test practice which can operate at full test
coverage on both test data and test scripts, and is completely automated: TCoE (Test Center of
Excellence). This tailor made blueprint, based upon the findings of the current situation, provides
clear steps on how to arrive at the desired situation, saving you significant time and money whilst
dramatically improving quality of software delivery.”
ROI within just a few months!
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Strategic Test Coverage Assessment
Goals and Value
Goal
Value
• Delivers the blueprint on how to establish a Test Center of Excellence that
delivers full test coverage of functional requirements, using advanced, highly
automated, testing and test data management tools. Next to the ‘toolchain’
develop capability, by enablement & training.
• The blueprint, based upon the findings of the current situation, provides clear
steps on how to arrive at the desired situation, saving organizations significant
time and money whilst dramatically improving quality of software delivered.
Enabling the growth towards a mature organization, and DevOps.
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
More information
Aernoudt Bottemanne
Practice Lead, DevOps & Enterprise Agile
HP SW Professional Services
[email protected]
+31 6 46800079
Jon Fairclough
Lead Solution Consultant, Devops
HP SW Professional Services
[email protected]
+44 7790 492087
Steven Brown
Director
IOVIO
[email protected]
+31611206999
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.