Testing Solution - Rational User Community
Download
Report
Transcript Testing Solution - Rational User Community
®
IBM Software Group
Introducing
IBM Rational Performance Tester v7.0
A tool for measuring and tuning your application
© 2006 IBM Corporation
IBM Software Group | Rational software
Agenda
Rational Performance Tester Overview
Demonstration
2
IBM Software Group | Rational software
Mission Impossible: Test a Gazillion Users
We only have to
prove that it
works for
20,000 users!
And just HOW
are we
supposed to do
that?
The
SWEAT
Method
3
IBM Software Group | Rational software
The SWEAT Method for Performance Testing
Five Essentials of Loadtesting:
Steps
Workload
Equipment
Analysis
Tools
Help!
What have I gotten myself into?
4
IBM Software Group | Rational software
Steps in the Process
1. Identify Testing Goals
2. Define the Workload Model
3. Build the Lab Environment
4. Build and Test the Workload
5. Analyze and Tune the System
6. Measure and Report the Results
Many important steps
need to be taken
“It’s hard work!”
5
IBM Software Group | Rational software
Identify Testing Goals
Performance tests are designed to answer specific questions
Identify the key stakeholders for the test and its results
Work with the stakeholders to explicitly list the questions
Gain agreement on goals before scoping and planning the test
Negotiate project scope against the cost of the test
Write it down: testing goals, project artifacts, and criteria for
project completion
6
IBM Software Group | Rational software
Workload (Model)
Document the test goals
Elaborate the user scenarios
List any specific emulated user
characteristics such as think time
Identify input data variation needed
to defeat optimistic server caching
Determine transaction rates during
peak load (per user and aggregate)
Identify key measurement points
Sometimes it feels like…
a hard hat zone
7
IBM Software Group | Rational software
Workload Definition Approach #1 – User Groups
Define each type of user in a workload and what they do
Concentrate on a “busy hour” definition with an analyst who
knows the customer’s work flow
Transactions / Busy Hour (# in group)
Telesales
Cust Svc
Managers
(1500)
(200)
(50)
Enter new customer data
3000
0
0
Take a customer order
6000
300
0
Check status on a customer order
1500
1000
100
Provide return # for a customer order
0
500
150
Adjust quantities on customer order
0
200
50
8
IBM Software Group | Rational software
Workload Definition Approach #2 –Transaction Rates
Get a monitored workload log from the customer’s production
environment
Make sure you can isolate a peak workload period and separate out
the transaction rates during that time
Transactions / Busy Hour
10 AM
Noon
3 PM
* daily batch reports running
Peak
Rush
Peak*
Enter new customer data
3000
1000
1500
Take a customer order
6300
8000
3000
Check status on a customer order
2600
3000
1500
Provide RMA for a customer order
150
50
120
Adjust quantities on customer order
150
25
50
9
IBM Software Group | Rational software
Equipment
Use a powerful workstation for your
console (2GB main memory)
Use an array of identical servers as
driver systems (Blade Center)
Plan on 10-20% spare driver capacity
Provide adequate network bandwidth
between drivers and system under test
A maze of twisty little passages…
10
IBM Software Group | Rational software
What about Driver Sizing for RPT
Test Agent Equipment Sizing -- General Guidelines
Dual processor systems (or better) where possible
> 2 GB main memory where possible
May get better performance running two engines on one agent box
Beware of running out of CPU before memory
Treat Windows and Linux as equivalent for sizing
Hot AIX (JS21) boxes could be the most scalable
As always, mileage may vary especially if you accelerate “per user” rates
Server Hardware
CPU Speed
Main Memory
Capacity
xSeries 330 (2 CPUs)
800 MHz (PIII)
1 GB memory
800 VTs
xSeries 346 (2 CPUs)
3.4 GHz DualCore 3.2 GB memory
1500 VTs
AIX JS21 (2 CPUs)
2.7 GHz (64-bit)
2500 VTs
16 GB memory
11
IBM Software Group | Rational software
Analysis – Gain Access to the Right Expertise
Arrange for a Subject Matter Expert
familiar with tuning WebSphere and
any back-end databases involved
Set up system resource and
network monitoring
Set up server logging with
transaction timing enabled
Tune the subsystems first before
trying to do a full capacity load test
The value of IBM Services
12
IBM Software Group | Rational software
Monitoring and Analyzing the Test Results
Make sure driver system run with <70% CPU utilization once in
steady state to ensure valid response time data
Monitor CPU, memory, and I/O statistics on systems under test
Look for hot spots from a resource usage perspective
Tune multi-tiered and clustered systems on a subsystem basis
first before looking at overall system performance
Evaluate system performance from an architectural perspective
Login authentication servers
Front-end web servers
Web application servers
Database servers
13
IBM Software Group | Rational software
Rational Performance Tester v7.0 – The tool of choice
Visual test representation
Fully adaptable test execution without running wizards
Zero programming required for input data variation
Custom Java code environment for enhanced functionality
Highly scalable architecture with multiple agents
Customizable reports of real-time performance measurements
System monitoring and application breakdown data available
Support for statistical analysis for the steady state interval
Full support for all major packaged ERP applications
14
IBM Software Group | Rational software
Rational Performance Tester
New in v7
Root Cause Analysis
Integrated IPOT Functionality
Agentless remote monitoring
Enhanced reporting
Resource Overlay
New Environment Support
Firefox
Benefits
Simplifies process for problem diagnosis by
easily identifying performance bottlenecks in
underlying application code
Simplify reports for faster interpretation and
analysis
Expands the breadth of environments in
which Performance Tester can be used
mySAP (SAP HTTP Interface)
Client Side Digital Certificates
Adoption of Process Advisor
Provide guidance and expertise to enhance
tool experience
Execution within a Citrix
environment
Enable remotely distributed resources to
participate in functional testing process
15
IBM Software Group | Rational software
Rational Performance Tester
New in v7
Various enhancements
Time based reporting
Benefits
Remove various objections and barriers
to adoption for new users
Schedule cut/copy/paste
Added Test Save As…
Simplified IP Aliasing, Std
Deviation, Test Stop
Startup and Scalability
enhancements
Collectively improve overall tool
experience for both new and
experienced users
16
IBM Software Group | Rational software
Solution: Root Cause Analysis
Benefits:
Ability to perform detailed analysis and
breakdown of J2EE transactions when a
system is under load.
New!
IBM Rational Performance
Tester decomposes poor
response times identified
during a performance test…
Helps testing teams to pinpoint the
component responsible for the bottleneck.
For IT organizations that use Tivoli ITCAM
solutions, detailed performance data can
be delivered directly to the developers
desktop to help the developer pinpoint the
source code causing the bottleneck.
Key Features:
Problem Analysis Tools
Response Time Breakdown
Agentless Resource Monitoring
Resource Overlays with Response Times
…into the amount of time
spent within each application
component.
IBM Tivoli Monitoring Collectors Additions
17
IBM Software Group | Rational software
Packaged Application Support
New!
Challenge:
Provide test automation support for mission
critical enterprise resource planning
applications
New in this release:
Functional Tester
SAP 6.2 and 6.4 support
Siebel 7.8 support
Performance Tester
mySAP support (SAP HTTP interface)
Partner BSD offering for Oracle eBusiness
Suite
Provides a comprehensive solution for
all key ERP solutions
Existing foundation
Functional Tester Siebel 7.7 support
Performance Tester Siebel and SAP support
PeopleSoft support implicit with RFT and RPT support for HTML/HTTP
environments
18