Transcript PowerPoint template guide (title)

NON-FUNCTIONAL TESTING IN AN AGILE
WORLD
29 January 2015
SYNOPSIS
“Non-Functional Testing in an Agile World” in a workshop format
Sprang from UKTMF July 2014 session that asked more questions
No matter what process is used to deliver systems, performance problems kill
positive user perception … non-functional is more than just performance
Asking ourselves whether we can address all aspects of non-functional
testing within an Agile project. Is it possible to fully integrate non-functional
testing into every sprint or is there a middle ground, for example:
 Basic performance test in every sprint
 Infrastructure and stress performance test for every release?
Will we reach consensus, conflict or confusion?
 That is really up to you, the attendees.
2
Non-Functional Testing in an Agile World
PLAGIARISM
Agile is Like Teen Sex Because…





3
Everyone wants to do it
Many say they’re doing it
Everybody else seems to be doing more than you
Very few of you/your friends are doing it correctly
You start getting a bad reputation when you spend too much time ‘Doing it’
Non-Functional Testing in an Agile World
NON-FUNCTIONAL TESTING
No matter what process is used to deliver a system, performance problems
kill positive user perception!
And yet non-functional testing is so much more than just Performance.
Non-functional testing means different things to different people, but in a
nutshell it describes “how well” we deliver the “what”:






4
Performance
Security
Resilience
Compatability
Useability (discuss)
Accessability
Non-Functional Testing in an Agile World
CAN WE CHANGE THE MODEL?
•
Early Agile view ‘flipped’ the test triangle
•
Can our non-functional testing strengthen the Acceptance Tests?
TRADITIONAL TEST
Manual
Functional
Manual
Tests
Functional
Tests
5
AGILE TEST
Functional
Tests
Acceptance
Tests
Acceptance
Tests
Acceptance
Tests
Unit
Tests
Unit
Tests
Unit
Tests
Non-Functional Testing in an Agile World
INTEGRATION OF NON-FUNCTIONAL TESTING
The maxim that defects found late take longer to resolve still holds true,
whether developing with Waterfall or Agile, and yet we still appear to be
delaying performance testing.
This session sprang from informal discussions at various UK Test
Management Forums, and in particular from a session in July, where we
touched on the subject of security
6
Non-Functional Testing in an Agile World
SOPRA STERIA EXPERIENCES
Automated Test Frameworks (Selenium +)
 Student Loans, Ministry of Justice, Easy Jet, Scottish Prison Service
Continuous integration
 Preparation of scripts
 Automated build scripts
‐ Check out
‐ Deploy
‐ Run unit & functional tests
Building individual service tests as they become available to expand the
performance journeys
 Thereby reducing the future risks of full performance tests
‐ Traffic mix
‐ Volumes
‐ Etc
7
Non-Functional Testing in an Agile World
ADAPTIVE SPRINTS
Incorporation of a “Release Test” cycle, with the main focus on
infrastructure and integration
One of our clients executes this in a 10 week window
 3 three week sprints, followed by 1 week performance & integration
 Each subsequent release cycle is enhanced with new tests and baselines
8
Non-Functional Testing in an Agile World
SECURITY TESTING
Separate out the areas of risk
Infrastructure can be tested in isolation of developed code




Hardware
OS
Standard perimeters
Encryption
Development can be protected by standards
 Design principles
 Good practice
 Checking
Final tests integrated into “Release” cycle
9
Non-Functional Testing in an Agile World
CROSS-BROWSER TESTING
Automation can make this easier
Assessment of risk
 Who are our customers & what technology might they be using?
 Can we limit the scope?
 “Minimum viable product”
For one client, cross-browser functionality is a business critical aspect, and
thus automated cross-browser testing is conducted with every sprint
 Dedicated lab
 TestPlant’s “EggPlant” tool
10
Non-Functional Testing in an Agile World
QUESTIONS
11
Non-Functional Testing in an Agile World
SOPRA STERIA
A new European leader in digital transformation
€
EUR 3.1 bn
Revenue
(2013 pro forma)
35,000+
20+
People
Countries
TOP 4 IN FRANCE -
TOP 10 IN EUROPE
Source: Gartner. Market share is based on IT services revenue and does not include income from licensing and software activity.
Capita Group not included in European rankings.
12
Non-Functional Testing in an Agile World
CONTACTS
YOUR BUSINESS CONTACT
Mark Gilby
T. +44 (0)7920 075830
Mark Gilby
Senior Test Manager
Sopra Steria
4th Floor
30 Old Broad Street
London EC2N 1HT - United Kingdom
www.soprasteria.co.uk
13
Non-Functional Testing in an Agile World
T. +44 (0)2077 865800
M. +44 (0)7920 075830
[email protected]
14
Non-Functional Testing in an Agile World