Transcript The AIM Testing Cycle

A Testing Roadmap for Complex Oracle E-Business Suite
Projects
Yugant Patra
Going Up?
Elevate Your Business Today
We @ Capgemini
Outsourcing
Technology
Consulting
• Key Capgemini statistics
 Serve 2/3 of global Fortune 500
• Total Revenue: $ 11 Billion
 Industry focus: Retail, Distribution, Life Sciences, Manufacturing, Automotive, Health &
Public Services, Energy and Utilities, Financial Services
• 100,000 + employees
• 6,400 Testers
 Presence in >30 countries
 Full-service firm
Revenue Distribution by Discipline
Our Group Headcount Covers Key Regions Across the Globe
Iberia:
5,435
France:
21, 175
Approximately $11 Billion Global Revenue
27%
Manufacturing
Nordic Countries
4,049
Government
25%
North America 8,379
South America 1,016
Global
Headcount
91,621
UK & Ireland: 7,985
Central
Europe:
7,534
Italy: 1,462
Benelux:
12,291
Asia Pacific:
1,524
India: 20,554
Financial
Services
Outsourcing Services
38.4%
16%
Energy &
Utilities
13%
Telecom, Media
& Networks
Other
Local Professional
Services
18%
9%
Technology
Services
40%
Consulting
Services
6.7%
7%
© Copyright Capgemini 2010 All Rights Reserved
2
Service Offering
Our Testing Service Offerings
Test Process
Improvement®
COE
Solution Enabler
Test lab
Tools
Functional
Testing
Test Factory
Test
Process
Framework
 Infrastructure &
Setup Lab
 Checklists, guidelines
and best practices
 Tool Licenses
 System Requirements
 Implement across
projects
 Maintenance
 Tool specific add-ins
Tool Framework
DDF™ framework
Requirements Modeling
Blueprint Requirement Center,
Microfocus Optimal Trace
Test Automation
 Aligned with
Capgemini standard
TMap® and DDF™ and
Oracle AIM
methodology
Accelerators
COE
Performance
Testing
Integration
Testing
Competency
Building
Regression
Testing
Research &
Development
 In house tools
 Creating Solutions for
new technologies
using existing tools
 Knowledge
repositories
 Internal Training
Programs
Vendor Tie-ups
Test Automation and Regression Automation
Oracle ATS, HP QTP
Test & Defect Management
Teamforge™, HP QC, IBM Rational
Test Manager, Mantis
© Copyright Capgemini 2010 All Rights Reserved
3
Meet Mr. Brown
YAY!!
Now What??
What’s my
roadmap?
© Copyright Capgemini 2010 All Rights Reserved
4
Test Guru to the Rescue
© Copyright Capgemini 2010 All Rights Reserved
5
The AIM Testing Cycle
• CRP 1
• CRP 2
• CRP 3 *
• UAT
© Copyright Capgemini 2010 All Rights Reserved
6
See the Complete Picture
Demand Planning
Order to Cash
HCM (OTL)
Project Billing
Accounts Receivable
Cash Mgmt
Fixed Assets
General Ledger
Supply
Chain
Planning
Procure to Pay
Project Costing
Enterprise Asset
Mgmt
Manufacturing
Mobility
Change Management / Testing / Training
Analytics/Reporting
© Copyright Capgemini 2010 All Rights Reserved
7
Collateral
• Test Strategy Document
• Testing Calendar
• Testing Collateral
• Scenario Sheet
• Test Scripts
• Datasheets
© Copyright Capgemini 2010 All Rights Reserved
8
CRP 1- OBA
What’s
OBA??
Do you Know
OBA?
© Copyright Capgemini 2010 All Rights Reserved
9
Use of OBA
•
Powerful, Easy to use Rapid implementation solution
for NEW E-Business Suite implementation.
•
An Automated Setup Tool
•
Allows an implementer to download the setup
question configuration answers from the associated
project workspace
•
Includes business flows representing leading industry
practices
•
Flow model, Videos and Demo Scripts available for
increasing end users awareness and training
•
Reduce implementation time
•
In built Market, Industry and Country variations
© Copyright Capgemini 2010 All Rights Reserved
10
AIM for Business Flows with Accelerators
Questionnaire
Questionnaire
CRP1
CRP2
Workshop
CRP3
SIT
Prod
Cutover
Only If Needed
UAT
Training
Prod
Go Live !
11
© Copyright Capgemini 2010 All Rights Reserved
11
CRP 1- OBA
By using the Accelerator Process and Assets, the time needed to prepare and execute
your first functional CRP is reduced from months to as little as a 1 - 3 weeks.
© Copyright Capgemini 2010 All Rights Reserved
12
CRP 2/3
Should I wait for
all Custom
Objects to be ready?
No Test as they
come
© Copyright Capgemini 2010 All Rights Reserved
13
CRP 2/3
•
Maximum Time and effort - Heavy
involvement of Country Champions
•
Ideally Test as they come – Start the first
Custom object in the end to end flow
•
Client’s client facing piece requires most
testing and attention
Financial
Reporting
Testing
Functionality
Testing
Performance
/Load Testing
Custom
Objects
CRP 2/CRP 3
•
•
Use of Oracle SSC for quick issue
resolution
Custom functionality test
Integration/
End to End
Testing
SOX
Compliance
Month End
Closing
•
Issue documentation and resolution
© Copyright Capgemini 2010 All Rights Reserved
14
UAT
•
The UAT test packet should contain: Test
Scenarios, Test Data and Test Scripts –The
Test Bible
•
It is CRUCIAL for scenarios tested to reflect
realistic, relevant business situations
•
Validate the application from end user
perspective
•
Country/LOB Champions and Role
Champions should lead the test
•
Representative “Day In The Life Of “ (DILO)
of the firm
•
Include a short survey to gauge the UAT
testers feedback of the new system
CRP1
Development
CRP2
Defect Resolution
UAT
© Copyright Capgemini 2010 All Rights Reserved
15
Timelines
Month
of
Design
CRP1/OBA
Develop
ment
Data &
Scripts
CRP2/CRP3
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Nov
Dec
CRP1
Test Plan
Scenarios
Development
Functional User
and Country
Champion
Signoff
Gather Data & Develop Scripts
Test Packet Preparation
CRP2/CRP3
Training Material
Prep
UAT
Training
Onsite
Orientation &
Kick-Off
UAT
Training
Conduct UAT
UAT
Test Mgmt.
Oct
Design Freeze
Training
Material
Prep
Defect
Resolution
Sep
Global
Tester Sign
Off
Go No-Go
Decision
Defect Resolution & Retest
Test Planning, Support and Reporting
© Copyright Capgemini 2010 All Rights Reserved
16
Test Tracking
• Use of Tools
• Virtual Repository for
Test Scenarios and Test Scripts
• Facilitates reusability
• Defect Reporting
• Defect Triage
• Test Progress Reporting
HP Quality Center software
PVCS
Oracle Test Manager
Rational TestManager
Good Old Excel
© Copyright Capgemini 2010 All Rights Reserved
17
Defect Life Cycle
Close
Defect
Identify
Defect
Tester verifies the defect
has been resolved and
changes its status to
‘Closed’.
Test Lead reviews the
Awaiting Retest-UAT
defects on a daily basis to
plan and communicate
retest of the fix.
Re-Test
Defect
If the defect has not been
resolved tester changes its
status to ‘Re-Opened’.
Config.Mgmt. Team
migrates the changes
to User Test
environment and
changes the status to
‘Migrated’;
Upon assuring the fix
migration and prelim
test on UAT (if it
necessitates), assigns
the defect to ‘Awaiting
Retest – UAT’.
Re-Open
Defect
Migrate
Change
System
Test
Solution Team performs
system test; Upon
successful test, initiates the
migration of the fix to UAT.
Defect
Resolution
Assigned resource
resolves the defect and
assigns the resolution
status to ‘Fixed’ & status
to ‘Awaiting Retest –
System’
Testers find
defects during
UAT, functional,
regression or
integration
testing.
Developers find
defects during
unit/system
testing.
‘Re-Opened’ defects are
discussed during the next
Defect Review meeting.
Open
Defect
Tester or developer logs a
defect and assigns an
‘Open’ status to the defect.
Defect
Review
Meeting
Defect Triage Team reviews
the defect, adjusts the
defect type, responsible
group, severity, priority &
others attributes of Defect.
Responsible Team Leads
assign the defect to a
resource and Estimated Fix
Date.
Track
Defect
All Open defects
with a severity of
‘Showstopper’,
‘High’ are tracked
on the daily
defect report..
© Copyright Capgemini 2010 All Rights Reserved
18
Defect Reporting
How do I report my
Defects?
Graphs,
Management love
Graphs
© Copyright Capgemini 2010 All Rights Reserved
19
Defects Metrics
Defects Identified vs. Closed or Fixed, Awaiting Retest
(includes defects from Functional Testing)
Open Defects Severity by Module
(includes defects from all testing events)
1200
50
1000
40
800
30
600
20
400
10
200
0
0
6
6
6
6
6
6
7
7
6
6
6
6
7
00
00
00
00
00
00
00
00
00
00
00
00
00
/2
/2
/2
/2
/2
/2
/2
/2
/2
/2
/2
/2
/2
3
7
0
4
2
1
5
2
8
5
9
8
9
/
/
/
/
1
1
2
1
/1
/2
/1
/2
/2
9
1
2
8/
9/
9/
12
1/
10
10
11
11
12
AR
OIE
PA
3
2
4
Medium
18
11
15
Low
20
22
6
Total
41
35
26
1
Show Stopper
High
Cumulative Defects Logged
Cumulative Closed
Cumulative Closed + Fixed, Awaiting Retest
Show Stopper
Severity
Showstopper
High
Medium
Low
High
Medium
Low
Total
Total
AR
3
18
20
41
OIE
2
11
22
35
PA
1
4
15
6
26
Totals
1
9
44
48
102
© Copyright Capgemini 2010 All Rights Reserved
20
People Structure
Project
Management
Office
Implementation
Lead
Country Group 1
LOB 1
Country Group 2
LOB 2
Country Group 3
LOB 3
Testing Lead
Country Group 4
LOB 4
Country Group 5
LOB 5
Legacy Manager
Role Champions/
Functional Leads
Projects
Purchasing/Iproc
Receivables
Payables
Fixed Assets
General Ledger
Test Support
Proj. Admin
Proj Mgr
Proj. Admin
Proj Mgr
Proj. Admin
Proj Mgr
Proj. Admin
Proj Mgr
Proj. Admin
Proj Mgr
Requisitions
Requisitions
Requisitions
Requisitions
Requisitions
Billing.& Rev
Billing.& Rev
Billing.& Rev
Billing.& Rev
Billing.& Rev
Invoicing
Receipts
Invoicing
Receipts
Property/Tax
Property/Tax
Property/Tax
GL/Acctg.
GL/Acctg.
GL/Acctg.
Invoicing
Receipts
Invoicing
Receipts
Property/Tax
GL/Acctg.
Solution Team
Legacy
Application
Integration
Invoicing
Receipts
Property/Tax
GL/Acctg.
© Copyright Capgemini 2010 All Rights Reserved
21
People Structure
Functional Team
CRP1
CRP2
UAT
Trainers
Come in as Testers leave as Trainers
UAT
TTT
© Copyright Capgemini 2010 All Rights Reserved
22
The Reason we Test
• CRP 1/OBA
– Avoid Major Customizations
– Use best Industry Practices
• CRP2
–
–
–
–
–
–
Use the system to its full potential
Validate eBS in the IT Environment of the Firm
Validate eBS in the Business Environment of the Firm
Avoid Gold Plating
Balanced test effort with quality requirements
Risk based, Business driven Testing
• UAT
– Have a smoother Go-Live
– Easier acceptance to Change
– Facilitates system transfer from the Solution Team to the Client
© Copyright Capgemini 2010 All Rights Reserved
23
How to reduce Costs?
• Keep it simple
• Scenario Selection
• Do not overstaff - Use the Functional Team
and Solution Team
• Do not reinvent the wheel
• Leverage Testing Collateral for Training &
Change Management
• Reuse Reuse Reuse
© Copyright Capgemini 2010 All Rights Reserved
24
Tips
•
•
•
•
•
•
Entrance and Exit criteria
Stage gate and Signoff
Feedback
Do not over do Testing Automation
Global Testers – Bilingual
Single war room seating
© Copyright Capgemini 2010 All Rights Reserved
25
Mr. Brown gets a raise
YAY!!
© Copyright Capgemini 2010 All Rights Reserved
26
Oracle Test Manager
Oracle Functional Testing
Oracle Testing: Capgemini’s TMap® Method Well Aligned with
Oracle’s AIM methodology
Oracle Load Testing
Oracle Data Masking
Delivery Phases
Business Process
Architecture &
Business
Requirements
Definition
Business
Requirement
Mapping
Evaluation Environment
Architecture / Design /
Data conversion
System Testing
Integration Testing
Dev Environment
QA Environment
Adoption
and
Learning
Production
Migration
Prod Environment
Functionality Testing
Prepare Testing
Strategy
Finalize Testing
Tool
Testing Team
Onboarding
Finalize Testing
Strategy
Identify Test
Scenarios
“Coverage”
Prepare System Test Cases
System Testing
Finalize Defect Resolution
Criteria
Go Live
Create Integration Test
Plan
Setup QA Client and Test
Data
Integration Testing
(# of cycles)
Set
Regression
Baseline
User
Testing
Automation and Performance Testing
Setup Central
Testing System
Create Test Plan
“Coverage”
Requirements: Setup Test Req. / Attributes
Load Test Scripts
Test Plan: Manual & Automated test creation
Execute Load Test
Test Set: Hierarchy and Execution
Automate Test
Defect: Creation & Resolution
Regression Testing
© Copyright Capgemini 2010 All Rights Reserved
27
Contact Information
 Anijay Zinzuwadia , Capgemini US LLC
 E-mail: [email protected]
 Yugant Patra, Capgemini US LLC
 E-mail: [email protected]
In collaboration with
 David Carrier, 7-Eleven Inc.
 E-mail: [email protected]
© Copyright Capgemini 2010 All Rights Reserved
28
Questions?
© Copyright Capgemini 2010 All Rights Reserved
29
Thank You
© Copyright Capgemini 2010 All Rights Reserved
30