Transcript Document

Tuning Production Systems
David Gehringer
Director, Product Marketing
IT Applications Drive Business
• Applications increase revenue or decrease
costs
• Applications effectiveness can be measured
by:
 Invoices / hour
 Pageviews / day
 Records updated / day
 Completed transactions / hour
 Response time
 Etc..
IT wasted $500B in 2001
“Gartner Says 20 Percent of Corporate IT Budgets
Wasted Globally in 2001 on Inefficient Information
Communication Technology Spending”
 Typical areas of misspend include:
•
•
•
•
•
'over specified' hardware
over specified network infrastructure
unnecessary customization of software packages
poor central control of software licensing
projects that never see the light of day (especially true
during the e-business hype)
Production Tuning Can Prevent This Waste
Top Production Problems
• Systems are very complex
 “Millions of moving parts”
 Can’t separate problems between infrastructure and
app(s)
 Intermittent & non-reproducible problems can be
chronic
 No way to ensure security under peak load conditions
• Changes, changes, changes…..
New Application Roll Out?
We cross our
fingers AND toes.
12%
We hear, “it
worked fine
in testing.”
34%
Our tools did not identify
what was wrong.
9%
Source: Gartner 2002
It meets all tested and expected
response time measurements;
users are happy.
14%
Our IT department is
overwhelmed with calls.
15%
We just add
bandwidth to get rid of
the problem.
9%
Our company loses
revenue, time and
credibility.
7%
Amazing Statistics
• 98% of the environments have critical
problems
• Sites only scale to 15% of design capacity
• Performance can often be increased by
400%+
• Security and production performance are
related
(Based on 2,000 ActiveTune engagements)
Bottlenecks identified in all areas of
Web application infrastructure
60%
Application
40%
Infrastructure
Infrastructure
•Network
•Computing H/W
•Security
Application
•Database
•Application Server
•Web Server
Systems contain multiple bottlenecks in both:
application and infrastructure areas
Data gathered from over 2,000 tuning sessions (September 2001)
Why Applications Don’t Scale in
Production
The testing / QA lab is not the production system!!
 QA is a scaled down version of production
 Does not have production infrastructure in testing
• Firewalls, Load balancers, cache servers, etc..
 The internet and its infrastructure is absent
• Switches, routers, gateways, Bandwidth, ISP peering, etc..
 Security systems are not represented
• Hardware, software, encryption, ect..
Production systems are incredibly complex
Firewall
Network
Devices
WEB
Production systems include multiple end users for
CRM, ERP, B2B, B2C, Intranet, Internet
Enterprise Application Testing &
Performance Monitoring
Application
Testing in Lab
Requirements
Test
Planning
Iterative
Testing
Load & Stress
Testing
Functional
& Regression
Testing
HF
Dev.
Monitoring
24 x 7 in Production
Systems
Initial Application Release onto Production
Infrastructure Requires Tuning & Optimizing
• Baseline performance on real production system
• Maximize utilization of existing investments
 Application
 Infrastructure
 Security
Application From Testing
or Staging environments
Ongoing Discrete Events In Production
Require Tuning & Optimizing
Chasing
intermittent
performance
problems
Increasing
Users/Traffic
Launch
HF
New
architectures
System and
application
upgrades
What Business Problems does
Performance Optimization Solve?
• Reduced costs
 Reduction in hardware and software purchase
 Redeployment of resources to other projects
• Revenue Protection
 Increased reliability
 Higher end user experience
• 3rd party validation
 Ensuring that the system and partners can scale
 Check security infrastructure resilience to load
The Answer is:
• Production Tuning:
 We utilize experts, industry standard tools,
proven processes to systematically tune each
tier and component of the production system to
maximize utilization of the system and improve
performance.
Ok, but how do you do it?
Tuning Joins All Areas
Infrastructure
Application
Security
Hosting Equip.
Application Servers
Firewalls
Routers
Databases
IDS Systems
ISP Peering
Middleware
DDOS system
Switches
Back Office
ISP Bandwidth
Client servers
Load balancers
Legacy system
Gateways
Web Servers
3rd Party
Cache Servers
Credit Cards service
LAN / WAN
.NET, SUN 1 services
The Tuning Process
3
Security System
2
Application(s)
1
Infrastructure
& Network
The Tuning Process
Drilling Down from the Global to the Specific
Security System
Application(s)
Infrastructure
& Network
1
2
3
Problem Resolution
Increase server connections
Entire System
Response time unacceptable
Component Testing:
App, Web, DB, FW, etc..
Problem Isolation
Application Server doesn’t scale
Tuning Requires Targeting Tiers & Delivering
Load From An End-user Perspective
Business Processes
ISP
ISP
ISP
Router
Router
Firewall
“Tier specific”
sessions
Net2
Mgmt
Net1 Firewall
Mgmt Mgmt
Load
Balancer
Load
Mgmt
Web
Servers
Application
Server
System Network
Mgmt
Mgmt
• Tuning targets system one tier at a time
• Creates a baseline of performance
Database
Server
DB
Storage
Mgmt Mgmt
Key Tuning Procedures
Infrastructure
Load Balancer
scheme & strategy
Check Bandwidth
Border router and
network validation
Caching algorithm
optimization
ISP capacity, SLA,
and connection
validation
Application
Check Scalability
Server connection
capacity, release,
and renew
Business process
optimization
Database process &
search validation
Page construction
check
Security
Security operation
under heavy traffic
DDOS system
operation check
Vulnerability Scan
Firewall:
connection DMZ,
throughput
validations
Confirm IDS
operation
Production Tuning Advantages
• Maximize Infrastructure & Software Utilization
• Maintains Optimal Performance
• Save Time
• Protect Revenue
• Security Performance Check
• Validate 3rd parties scale
• Establish Monitoring Benchmarks
• Base-lining system capacity
• Fail-over testing
Tuning Enterprise Applications
•
•
Tuning can be leveraged for:
 B2B, B2C, CRM, ERP package apps, etc…
 Internet based applications
 Intranet, WAN, LAN applications
Mercury Interactive has validated and proven this
approach with our ActiveTune service
Questions