Transcript Slide 1

CXtec Migration from
Large SMP to Oracle
RAC Cluster on Linux
CXtec Migration from Large SMP
to Oracle RAC Cluster on Linux
Dean Bettinger
Storage Technology
Business Development Manager
CXtec Company Overview
o World-wide VAR for Network, Voice, and Data Center
equipment – new and certified pre-owned.
o equal2new®: 10-step certification process, 99.51%
reliability rating and lifetime warranty
o CABLExpress® cables, including fiber jumpers. Also
new and equal2new® Fibre Channel switches & HBAs.
o $135M annual sales, 6 consecutive years on VAR 500
(#231), ISO 9001:2000 certified.
o 300+ employees.
o Great Place To Work – last 4 years in top 25.
Where We Were - 2004
o ERP
o Oracle Applications eBusiness Suite 11.5.9
o Sun E4500, 12 x 400MHz CPU, 12G RAM
o Oracle Database 9i, named user license
o Running out of CPU cycles and RAM
o Web Site
o Sun 450, 400MHz CPU, 4G RAM for our web site
o Oracle Database 9i, per CPU license, unlimited
users
o Day old copy of production data replicated from ERP
Challenges
o Business desire to bring live transaction data to our web
site, especially to our Extranet for customers
o Business / IT desire to leverage Oracle for everything
o IT developer desire to simplify our development
environment
o Avoid complexity of live synchronization between
inside & outside databases
o Cease daily replication of day-old data to Extranet
o Utilize web services from Extranet to access up to
the moment live data
Database Licensing Migration
o Migrate internal Oracle database licensing from named
user to per CPU, unlimited users
o Can now serve 5,000+ Extranet users directly.
Avoided $800 per user -- $4M
o Can now leverage Oracle database for all
application development: ERP, Extranet, Intranet for
all employees, not just ERP users
o Eliminate Oracle database from our DMZ
o Corporate web site and Extranet will now use web
services to get data from the one true source
Ouch!
o Oracle charges $40K per CPU license
o Sun CPUs were 900MHz max and we figured we
needed 12 CPUs -- $480K
o New Sun enterprise-class server -- $350K
o Sun SPARC and Sun Solaris – out the window!
o CXtec had been a long-time committed customer of
Sun, and we loved its reliability
o Solaris was favored operating system due to
features and stability, but Sun had abandoned
Solaris x86.
The Way Forward
o In Intel we trust!
o Scale CPU speeds faster than CXtec grows
o 3GHz Xeon much faster than 900MHz SPARC
o Desire to move to commodity 2 socket servers
o Goodbye Sun, Dell here we come!
o Decision point – How do we get to 12GHz?
o Single Quad socket server?
o Simple, but hardware more expensive
o Two Dual socket servers in a RAC cluster?
o Complex, but commodity servers, resiliency
Mitigating RAC Complexity
o Raw device mapping?
o Not visible to SysAdmins, complexity borne by DBA
o Oracle ASM not yet available
o Cluster file system?
o Oracle Cluster File System – OCFS1
o Not ready for prime time
o Sistina GFS (now a Red Hat product)
o Single node lock manager
o PolyServe Matrix Server (now an HP product)
o Distributed lock manager, BCF reference
PolyServe Matrix Server
o We settled on PolyServe’s Database Utility for RAC
o Common mount points on all servers
o SysAdmin friendly
o Simple for DBA
o Shared Oracle HOME
o Distributed Lock Manager
o No single point of failure
o Context Sensitive Symbolic Links
o Oracle Disk Manager (ODM) integration
`
1st Generation
RAC Cluster
`
`
End
Users
Corporate LAN – Nortel 450 switches
Middle
Tier
Servers
Oracle Apps
Web Apps
Discoverer
9iAS
9iAS Java Edition
AS 10g Enterprise Edition
Core Network Stack – Nortel 5510 switches
Database Server
9iRAC
Dababase Server
Cisco 3508 GbE
Cluster Interconnect
9iRAC
Oracle
RAC
Cluster
Brocade 2800
Fibre Channel Switch
Brocade 2800
Fibre Channel Switch
Xiotech Magnitude 3D
`
2nd Generation
RAC Cluster
`
End
Users
`
Corporate LAN – Cisco 6509 Core switch
Oracle Apps
Discoverer
AS 10g
AS 10g Enterprise Edition
Middle
Tier
Servers
Web Apps
AS 10g Java Edition
Cisco SFS 3001
10G InfiniBand
Switch
Cisco SFS 3001
10G InfiniBand
Switch
Database Server
Cluster
Interconnect
Dababase Server
10gRAC
10gRAC
Oracle
RAC
Cluster
Qlogic 5200
Fibre Channel Switch
Qlogic 5200
Fibre Channel Switch
Compellent Storage Center
Results
o Improved Performance
o Batch job take minutes instead of hours
o Dmart loading window dramatically reduced
o Improved End-User Productivity
o Most application response now sub-second
o Improved IT Productivity
o Single database for all applications. Simple!
o Live Extranet information for Customers
o Enhanced Reliability
o Run on 2 nodes, 3rd standby node
Economic Analysis
o Startup Costs - $137K
o $20K for 3 Dell 2 socket 3GHz Xeon servers, 8GB
o $24K for PolyServe Matrix Filesystem, DBU
o $93K Oracle License Migration to RAC
o Annual Maintenance Commitment
o +$16K / year
Economic Analysis
o Cost Avoidance - $670K
o $350K for a new Sun Enterprise-Class SMP server
o $320K in Oracle CPU licensing for slow Sun CPUs
o Annual Maintenance Cost Avoidance
o $112K on Sun Server and Oracle Licenses
o Bottom Line
o $1,017,075 Cumulative 5 Year Net Benefit
o ROI 473%, Payback Period – 2 Months
InfiniBand Cluster Interconnect
o Cisco / TopSpin SFS 3001 InfiniBand switches
o 12 ports of 10G Full-Duplex InfiniBand
o 2 port of 2G Fibre Channel
o For dual pathing to two Fibre Channel switches
o Cisco HCA (Host Channel Adapter) cards for servers
o 2 ports of 10G Full-Duplex InfiniBand
o For dual pathing to two InfiniBand switches
o 10x bit rate of Gigabit Ethernet
o 1/10th latency of Gigabit Ethernet
o 1/10th CPU utilization compared to Gigabit Ethernet
Compellent Storage Center
o
o
o
o
o
o
o
o
o
Storage Virtualization on steroids
Boot from SAN
Snapshots and Views
Enterprise Manager
Thin Provisioning
Automated Tiered Storage
Fast Track
Thin Import
Windows File Space Recovery
Questions & Answers
o ???