Regression Testing the Oracle E-Business Suite

Presenter:

A Kumar Acharya Ramesh Padmanabhan

Agenda

• • • • • • • •

Introduction Background Problem Statement Objectives Solutions Implementation Details Lessons Learnt (Key Users) Q & A

Marvell Confidential

History of Marvell

• • • • •

Founded 1995 Fabless semiconductor Global operations

– – – –

Israel Europe (Germany, Italy, Switzerland) Asia Pacific (Singapore, India & China) USA Annual Revenue ($MM)

– – – – – –

FY 2002 FY 2003 FY 2004 FY 2005 FY 2006 1 st Half FY 2007 288.8

505.3

819.8

1,224.6

1,670.3

1,095.2

4000+ employees across US, Europe and Asia

Marvell Confidential

Marvell’s Journey

• • • • • • • • • • • • • • • • • • • • • • • • • Marvell Confidential AUG 2001 Galileo Go-live on Oracle Apps 11.0.3

DEC 2001 Upgrade Oracle Apps 11i (11.5.4) JAN 2002 Convert Oracle Apps to Multi-Org and Fiscal Calendar

MAY 2002 Migrate North America to OM/FI to Oracle Apps 11i

OCT 2002 Go-live OSFM

OCT 2002 Implement Rosettanet PIP 3D8 with 10 Sub Contractors AUG 2003 Install Oracle 10G iAS for Rosettanet

DEC 2003 Upgrade Oracle Apps to 11.5.9

JAN 2004 Migrate SysKonnect GmbH from BAAN to Oracle Apps 11i FEB 2004 Migrate RADLAN IL to Oracle Apps 11i (New Company) APR 2004 Install UTF8 to accommodate multi-byte characters

SEP 2004 Implement Basic HRMS

DEC 2004 Implement WEB based Employee Expense System for North America JAN 2005 Implement Compensation Work Bench JUL 2005 Implement Phase 1 ASCP (Wafer Buy Plan)

AUG 2005 Upgrade Oracle Apps to 11.5.10

JAN 2006 Integrate Q-Logic Acquisition FEB 2006 Integrate UTStarcom Acquisition APR 2006 Integrate National Semiconductor Acquisition MAY 2006 Integrate Avago Acquisition MAY 2006 Implement Marvell Penang Ltd (New Company) AUG 2006 Implement Single Sign On OCT 2006 Implement Marvell Switzerland Ltd (New Company)

NOV 2006 Integrate Intel Acquisition

NOV 2006 Implement Marvell DSPC IL (New Company in Israel)

Problem Statement

 Numerous configuration changes, patches, enhancements and new product introductions were being migrated to production on a weekly basis.

 The knowledge to do end to end test does not exist with one individual.  Some of the business processes had numerous steps and dependencies making those processes very complex to test.  The high growth of the company and the volume of changes compromised the breadth of testing  The manual testing processes did not have adequate audit trail to satisfy the SOX compliance needs and put a very heavy strain on the already stretched IT staff Marvell Confidential

Objective Production Control

 Establish QA as a critical part of the overall IT governance process  Establish a central repository of interconnected and stand alone business functions that will need to be tested as part of the QA process  Establish Integrated test data management  Automate the testing process to increase the breadth of testing and reduce the burden on IT staff  Ensure that the automated testing process generates adequate audit trail to meet the SOX compliance requirements  Ensure that the solution implemented is both scalable and low maintenance Marvell Confidential

Solutions

 Marvell decided to implement the Entegration Attest Test management console.  The Entegration Attest is a portal test console that is built to specifically address the testing needs of Oracle E-Business suite.

 Entegration Attest helped us address our objectives.

 Maintain a test script repository    Automate the test process Generate Audit trail Flexibility and scalability  Entegration Attest uses the industry leader Mercury’s Quick Test Professional (QTP) as the execution engine .

Marvell Confidential

Components of Entegration Attest

Marvell Confidential

Test Run Test Suite Comprises of multiple scenarios Test Scenarios Logically organized functions will make up a scenario Test Functions The test functions are the lowest building blocks and will correlate with individual business functions

Creating a New Test Scenarios/Test Suites

• • •

Identify the Reusable Components or Functions

–

Select from existing function or Create a new function Logical grouping of Functions or Scenarios/ Test Suites

– – –

Logical Business Flow to satisfy Test Cases Logical Grouping of Scenarios to create a Test Suites Logical Flow of In and Out Parameters Inputs required for Functions

– –

Static Input Parameter – csv File Dynamic Input Parameter – SQL Query

•

Application Signature

– – –

Oracle User Name Responsibility Name Instance Name

Marvell Confidential

Entegration Attest Test Process

Create Functions

Intermediate Test Console User

•Static Data (csv File) •SQL Statement Create Scenarios Create Data Queries Create Test Cycles Create Test Suites Marvell Confidential

Performed by Test Administrator Performed by Intermediate User Performed by Beginner User

Create Data Sets Create Test Runs View Results

Implementation Details

Marvell Confidential

Architecture

Components used during BPT

Linux Server •Entegration Attest •Oracle Database •Web Server Marvell Confidential Windows Server •QTP Software •QTP Scripts Oracle ERP •Stage •Devt •PrjX User Machine in Marvell intranet

BPT Details for Phase-I and II

• • • • •

Order to Cash

– –

OM Functions AR Functions Item Master

– – –

INV Functions BOM Functions Costing Functions General Ledger

–

GL Functions Manufacturing

– – – –

MFG Functions OSFM Functions INV Functions WIP Functions Procure to Pay

– –

AP Functions PO Functions

Marvell Confidential

OM Functions

• • • • • • • • • • • • • •

1 2 3 4 5 6 7 8 9 10 11 12 13 14 OM Apply Hold on Order OM Copy and Book OM Create New Customer OM Create New Order OM Create RMA MSI Credit OM Create RMA MSI Replacement OM Pick Release OM RMA Receive Returns OM Release Hold OM Reprice Item in Order Line OM Ship Confirm OM Ship Confirm and Back Order OM Split Order Line OM Transact Move Order

Marvell Confidential

AR Functions

• • • • • • • • • • • • •

1 2 3 4 5 6 7 8 9 10 11 12 13 AR Changes to Invoice AR Auto Invoice AR Create Manual Credit Memo Transaction AR Create New Invoice AR Create Receipt Adjustment AR Create Receipts AR Create and Reverse Receipt AR Get IC Invoice Details AR Inter Company Invoice AR Period Open Status Check AR Print Invoice by Order Number AR Print New Invoices AR to GL Transfer

Marvell Confidential

INV Functions

• • • • • • • • • • •

1 2 3 4 5 6 7 8 9 10 11 INV Account Alias Issue INV Account Alias Receipt INV Create Item INV Create Location INV Create Planner INV Create Subinventory INV Inventory Lot Merge INV Inventory Lot Split INV Inventory Lot Translate INV Item Cross Reference INV Org Period Open Status Check

Marvell Confidential

GL Functions

• • • •

1 2 3 4 GL Balance Inquiry GL Enter Journal GL Period Open Status Check GL Query Journal

Marvell Confidential

MFG Functions

• • • • • • • • • • • • • • • • • • • • • • • • • • •

19 20 21 22 23 24 25 26 27 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18

Marvell Confidential

BOM Co-Products BOM Create Bill BOM Create Common Bill BOM Resource Creation BOM Routing CST Enter Item Cost CST Submit Cost Rollup MFG OSP Close Job using Form MFG OSP Complete Job No Charges MFG View MIL Requisition Details MFG Wafer AutoCreate PO MFG Wafer Check Item Onhand MFG Wafer MVL Auto ISO Request Submit MFG Wafer Requisition Import Submit MFG Wafer Requisition Process Start OSFM Create Lot Based Job Standard OSFM Create Non Standard Lot Job OSFM Lot Creation OSFM Lot Merge OSFM Lot Split OSFM Material Issue OSFM Network Routing OSFM Process Move OSFM Scrap Transaction WIP Complete Transaction WIP Create Discrete Job WIP Move Transaction

P2P Functions

• • • • • • • • • • • •

1 2 3 4 5 6 7 8 9 10 11 12 AP Enter Invoices AP Payments for Invoice AP Period Open Status Check AP Transfer to GL PO Approval PO Cancel PO PO Change PO PO Create Expense PO PO Create Supplier PO Period Open Status Check PO Receive Shipments PO Return Shipments

Marvell Confidential

Results



A comprehensive QA process was established for Marvell. All changes that needed to be implemented in production first needed to be implemented in a QA environment. Unless all tests passed, the code was not approved to migrate to production. This was established as part of the overall IT governance process.



A comprehensive test script library of over 85 test scripts covering all the major business process was created to support the above process



What would take one week to test now takes six hours

Marvell Confidential

Continued …



This solution allows us to test the applications using the same user and responsibility as in production without having to worry about maintaining the scripts for menu changes.



There is complete audit trail for the tests executed with screen shots and time stamps



The Entegration Attest is the single user interface for managing the tests and viewing test results.

Marvell Confidential

Lessons Learnt



Planning is a key to success.



A phased implementation approach proved very beneficial to us.



Do not expect 100% automation. Certain processes will still continue to be tested manually. Be sure to clearly identify processes that will lend themselves best to automated testing.



Identify the Key Users or BSA for detail information and make sure they are engaged from start to finish



Good and effective communication between QA functions and BSA on process changes



Prepare to make a small investment in maintenance of your scripts. Changes in business processes may require some changes in the test scripts

Marvell Confidential

Marvell Confidential

Q

&

A

Contact Details

Name : A Kumar Acharya E-Mail : [email protected]

Name : Ramesh Padmanabhan E-mail : [email protected]

Marvell Confidential