Transcript Testing Solution - Rational User Community

®
IBM Software Group
Introducing
IBM Rational Performance Tester v7.0
A tool for measuring and tuning your application
© 2006 IBM Corporation
IBM Software Group | Rational software
Agenda
 Rational Performance Tester Overview
 Demonstration
2
IBM Software Group | Rational software
Mission Impossible: Test a Gazillion Users
We only have to
prove that it
works for
20,000 users!
And just HOW
are we
supposed to do
that?
The
SWEAT
Method
3
IBM Software Group | Rational software
The SWEAT Method for Performance Testing
Five Essentials of Loadtesting:
 Steps
 Workload
 Equipment
 Analysis
 Tools
Help!
What have I gotten myself into?
4
IBM Software Group | Rational software
Steps in the Process
1. Identify Testing Goals
2. Define the Workload Model
3. Build the Lab Environment
4. Build and Test the Workload
5. Analyze and Tune the System
6. Measure and Report the Results
Many important steps
need to be taken
“It’s hard work!”
5
IBM Software Group | Rational software
Identify Testing Goals
 Performance tests are designed to answer specific questions
 Identify the key stakeholders for the test and its results
 Work with the stakeholders to explicitly list the questions
 Gain agreement on goals before scoping and planning the test
 Negotiate project scope against the cost of the test
 Write it down: testing goals, project artifacts, and criteria for
project completion
6
IBM Software Group | Rational software
Workload (Model)

Document the test goals

Elaborate the user scenarios

List any specific emulated user
characteristics such as think time

Identify input data variation needed
to defeat optimistic server caching

Determine transaction rates during
peak load (per user and aggregate)

Identify key measurement points
Sometimes it feels like…
a hard hat zone
7
IBM Software Group | Rational software
Workload Definition Approach #1 – User Groups
 Define each type of user in a workload and what they do
 Concentrate on a “busy hour” definition with an analyst who
knows the customer’s work flow
Transactions / Busy Hour (# in group)
Telesales
Cust Svc
Managers
(1500)
(200)
(50)
Enter new customer data
3000
0
0
Take a customer order
6000
300
0
Check status on a customer order
1500
1000
100
Provide return # for a customer order
0
500
150
Adjust quantities on customer order
0
200
50
8
IBM Software Group | Rational software
Workload Definition Approach #2 –Transaction Rates
 Get a monitored workload log from the customer’s production
environment
 Make sure you can isolate a peak workload period and separate out
the transaction rates during that time
Transactions / Busy Hour
10 AM
Noon
3 PM
* daily batch reports running
Peak
Rush
Peak*
Enter new customer data
3000
1000
1500
Take a customer order
6300
8000
3000
Check status on a customer order
2600
3000
1500
Provide RMA for a customer order
150
50
120
Adjust quantities on customer order
150
25
50
9
IBM Software Group | Rational software
Equipment

Use a powerful workstation for your
console (2GB main memory)

Use an array of identical servers as
driver systems (Blade Center)

Plan on 10-20% spare driver capacity

Provide adequate network bandwidth
between drivers and system under test
A maze of twisty little passages…
10
IBM Software Group | Rational software
What about Driver Sizing for RPT
 Test Agent Equipment Sizing -- General Guidelines
Dual processor systems (or better) where possible
> 2 GB main memory where possible
May get better performance running two engines on one agent box
Beware of running out of CPU before memory
Treat Windows and Linux as equivalent for sizing
Hot AIX (JS21) boxes could be the most scalable
As always, mileage may vary especially if you accelerate “per user” rates
Server Hardware
CPU Speed
Main Memory
Capacity
xSeries 330 (2 CPUs)
800 MHz (PIII)
1 GB memory
800 VTs
xSeries 346 (2 CPUs)
3.4 GHz DualCore 3.2 GB memory
1500 VTs
AIX JS21 (2 CPUs)
2.7 GHz (64-bit)
2500 VTs
16 GB memory
11
IBM Software Group | Rational software
Analysis – Gain Access to the Right Expertise

Arrange for a Subject Matter Expert
familiar with tuning WebSphere and
any back-end databases involved

Set up system resource and
network monitoring

Set up server logging with
transaction timing enabled

Tune the subsystems first before
trying to do a full capacity load test
The value of IBM Services
12
IBM Software Group | Rational software
Monitoring and Analyzing the Test Results
 Make sure driver system run with <70% CPU utilization once in
steady state to ensure valid response time data
 Monitor CPU, memory, and I/O statistics on systems under test
 Look for hot spots from a resource usage perspective
 Tune multi-tiered and clustered systems on a subsystem basis
first before looking at overall system performance
 Evaluate system performance from an architectural perspective
 Login authentication servers
 Front-end web servers
 Web application servers
 Database servers
13
IBM Software Group | Rational software
Rational Performance Tester v7.0 – The tool of choice
 Visual test representation
 Fully adaptable test execution without running wizards
 Zero programming required for input data variation
 Custom Java code environment for enhanced functionality
 Highly scalable architecture with multiple agents
 Customizable reports of real-time performance measurements
 System monitoring and application breakdown data available
 Support for statistical analysis for the steady state interval
 Full support for all major packaged ERP applications
14
IBM Software Group | Rational software
Rational Performance Tester
New in v7
 Root Cause Analysis
 Integrated IPOT Functionality
 Agentless remote monitoring
 Enhanced reporting
 Resource Overlay
 New Environment Support
 Firefox
Benefits
 Simplifies process for problem diagnosis by
easily identifying performance bottlenecks in
underlying application code
 Simplify reports for faster interpretation and
analysis
 Expands the breadth of environments in
which Performance Tester can be used
 mySAP (SAP HTTP Interface)
 Client Side Digital Certificates
 Adoption of Process Advisor
 Provide guidance and expertise to enhance
tool experience
 Execution within a Citrix
environment
 Enable remotely distributed resources to
participate in functional testing process
15
IBM Software Group | Rational software
Rational Performance Tester
New in v7
 Various enhancements
Time based reporting
Benefits
 Remove various objections and barriers
to adoption for new users
Schedule cut/copy/paste
Added Test Save As…
Simplified IP Aliasing, Std
Deviation, Test Stop
Startup and Scalability
enhancements
 Collectively improve overall tool
experience for both new and
experienced users
16
IBM Software Group | Rational software
Solution: Root Cause Analysis
 Benefits:
 Ability to perform detailed analysis and
breakdown of J2EE transactions when a
system is under load.
New!
IBM Rational Performance
Tester decomposes poor
response times identified
during a performance test…
 Helps testing teams to pinpoint the
component responsible for the bottleneck.
 For IT organizations that use Tivoli ITCAM
solutions, detailed performance data can
be delivered directly to the developers
desktop to help the developer pinpoint the
source code causing the bottleneck.
 Key Features:
 Problem Analysis Tools
 Response Time Breakdown
 Agentless Resource Monitoring
 Resource Overlays with Response Times
…into the amount of time
spent within each application
component.
 IBM Tivoli Monitoring Collectors Additions
17
IBM Software Group | Rational software
Packaged Application Support
New!
 Challenge:
 Provide test automation support for mission
critical enterprise resource planning
applications
 New in this release:
 Functional Tester

SAP 6.2 and 6.4 support

Siebel 7.8 support
 Performance Tester

mySAP support (SAP HTTP interface)

Partner BSD offering for Oracle eBusiness
Suite
 Provides a comprehensive solution for
all key ERP solutions
 Existing foundation
 Functional Tester Siebel 7.7 support
 Performance Tester Siebel and SAP support
 PeopleSoft support implicit with RFT and RPT support for HTML/HTTP
environments
18