Transcript Virtualization Of The Storage Infrastructure Amir Biran Regional Technical Partner Advisor eMed & Africa Innovating to Deliver New Choices 2007 De-Duplication 2006 Scalable grid storage 2005 Thin provisioning and.

Virtualization Of
The Storage
Infrastructure
Amir Biran
Regional Technical Partner Advisor
eMed & Africa
Innovating to Deliver New Choices
2007 De-Duplication
2006 Scalable grid storage
2005 Thin provisioning and virtual cloning
2004 RAID-DP™ disk resiliency
2003 iSCSI storage system
2002 Unified SAN/NAS appliance
2001 Near-line storage appliance
1996 Multiprotocol appliance
1993 NAS appliance and Snapshots
2
© 2008 NetApp. All rights reserved.
Simplifying Data Management
Network Appliance brings
unmatched simplicity
to the complex world of
enterprise data management.
• Reduce cost & complexity
• Minimize risk
• Control change
© 2008 NetApp. All rights reserved.
3
Gartner
Midrange Enterprise Magic Quadrant
Source: Gartner, Inc. Nov 2008
Roger W. Cox, Pushan Rinnen, Stanley
Zaffos
Magic Quadrant for Midrange Enterprise
Disk Arrays
This Magic Quadrant was published as
part of a larger research note and
should be evaluated in the context of
the entire report. The report is available
upon request from NetApp.
The Magic Quadrant is copyrighted Nov 12, 2008 by Gartner, Inc. and is
reused with permission. The Magic Quadrant is a graphical
representation of a marketplace at and for a specific time period. It
depicts Gartner's analysis of how certain vendors measure against
criteria for that marketplace, as defined by Gartner. Gartner does not
endorse any vendor, product or service depicted in the Magic Quadrant,
and does not advise technology users to select only those vendors
placed in the "Leaders" quadrant. The Magic Quadrant is intended
solely as a research tool, and is not meant to be a specific guide to
action. Gartner disclaims all warranties, express or implied, with respect
to this research, including any warranties of merchantability or fitness
for a particular purpose.
© 2008 NetApp. All rights reserved.
Recognized Industry Technology Leadership
Gartner Magic Quadrant for NAS
challengers
leaders
NetApp
ability to execute
EMC
IBM
Hitachi/Hitachi Data Systems
HP
Isilon Systems
BlueArc
Ibrix
Panasas
ONStore
SGI
Exanet
Pillar Data Systems
Sun Microsystems
niche players
visionaries
completeness of vision
© 2008 NetApp. All rights reserved.
Source: Gartner, Inc. March 2008
Pushan Rinnen, Robert E. Passmore,
Roger W. Cox,
Magic Quadrant for Midrange and
High-End NAS Solutions, 1H08
This Magic Quadrant was published
as part of a larger research note and
should be evaluated in the context of
the entire report. The report is
available upon request from NetApp.
The Magic Quadrant is copyrighted March 5, 2008 by Gartner,
Inc. and is reused with permission. The Magic Quadrant is a
graphical representation of a marketplace at and for a specific
time period. It depicts Gartner's analysis of how certain vendors
measure against criteria for that marketplace, as defined by
Gartner. Gartner does not endorse any vendor, product or service
depicted in the Magic Quadrant, and does not advise technology
users to select only those vendors placed in the "Leaders"
quadrant. The Magic Quadrant is intended solely as a research
tool, and is not meant to be a specific guide to action. Gartner
disclaims all warranties, express or implied, with respect to this
research, including any warranties of merchantability or fitness for
a particular purpose.
As of March 2008
What If You Could . . .
 Backup and restore your VMs
instantaneously
 Easily protect all your virtualized data
with DR
 Save 50% on your storage, power,
cooling, and space
 Deduplicate virtual server and virtual
desktop data, enabling 50% space
savings, or more
 Automate your most labor-intensive
data management tasks
 Clone and provision storage as
quickly as your VMs
 Do all of this with one architecture in
any environment
© 2008 NetApp. All rights reserved.
The Functional-Silo Storage Model
SAN
SAN
NAS
NAS
Enterprise
Departmental
Enterprise
Departmental
Fibre
Channel
iSCSI
Cost

© 2008 NetApp. All rights reserved.
Complexity
Ethernet

LAN
Access
7
The NetApp Model: Unified Storage
SAN
Enterprise
NAS
Departmental
Fibre
Channel
Enterprise
iSCSI
Ethernet
Departmental
LAN
Unified Storage
© 2008 NetApp. All rights reserved.
8
Fabric Attached Storage (FAS) Systems





Enterprise level Features and Functionality across all models
One O/S, One Admin Interface
Seamless Scalability
FAS6040
No Data Migration
Total interoperability
FAS3170
FAS6080
FAS3160
1176TB
FAS3140
1,176 drives
FC & SATA
840TB
FAS2050
840TB
FAS2020
672TB
420TB
99TB
65TB
68 drives
FC , SAS
& SATA
104 drives
FC, SAS
& SATA
672 drives
FC & SATA
840 drives
FC & SATA
840 drives
FC & SATA
420 drives
FC & SATA
Data ONTAP + One Family of Management Software
© 2008 NetApp. All rights reserved.
Standard Solutions
Most storage solutions – HARD link between
physical disk cylinders and LUNs
Allocate SPECIFIC
Disk Sectors
Sectors
Exchange
Oracle
© 2008 NetApp. All rights reserved.
10
NetApp’s Approach – Virtualize Data Layout
Total abstraction of logical filesystems from physical disks
Each volume utilizes ALL disks – great performance for all volumes
Each additional disk improves performance of ALL volumes
Oracle
SMS
Billing
Mail
© 2008 NetApp. All rights reserved.
11
FlexVol™ Volumes:
Improving Space Utilization
Vol 1
Vol 2
Vol 3
Vol 4
Vol 1
Vol 2
Free
Vol 3
Vol 4
© 2008 NetApp. All rights reserved.
12
™
FlexVol Volumes:
Increasing I/O Performance
Regular volumes
 Volume performance
limited by number of
disks it has
 “Hot” volumes can’t
be helped by disks on
other volumes
FlexVol volumes
 Spindle sharing makes
total aggregate
performance available
to all volumes
© 2008 NetApp. All rights reserved.
13
The new RAID issue
 Disk drives are very big (1.5 TB).
 Reconstruct of failed, large, disk can take over
36 hours.
 Any media error on another disk during
reconstruct will cause a data loss.
 Adding disks to existing RAID group should not
put data in risk.
Traditional RAID types (like RAID/5) are
not acceptable anymore
© 2008 NetApp. All rights reserved.
Problems With Traditional RAID
Data Lost
NOT
OK
Is
mirroring
Solution?
the right
Mirroring
solution?
© 2008 NetApp. All rights reserved.
RAID-DP: High Performance RAID-6
RAID
 2,000 to 40,000 times more
secure than regular RAID
Protects against single
disk failure
P
 More reliable than mirroring for
double-disk failure
RAID DP
Protects against any
P
two-disk failure
DP
 14% Parity Overhead vs.
50% Overhead w/Mirror(*)
 72% more usable capacity
than competitive offerings(*)
(*) Comparing 2P+12D vs. 7+7 Mirror
© 2008 NetApp. All rights reserved.
Cost-Effective Data Reliability
The Problem
 Double-disk failure is a
mathematical certainty
 RAID 5 (single parity disk)
– Insufficient protection
 RAID 10 (mirrored copy)
– Double the cost
NetApp RAID-DP™ Solution
 Protects against double- disk
failure
 High performance and
fast rebuild
 Same protection and
performance as RAID 10
at half the cost
RAID 5
RAID 6
RAID 10
RAID-DP
Cost
Low
Low
High
Low
Performance
Low
Low
High
High
Resiliency
Low
High
Med
High
© 2008 NetApp. All rights reserved.
17
Reasons For Downtime
PhysicalFailures
Failures= = CPU, Disk, cables
•• Logical
80%
Logical
Failures
• System
Downbugs,
Until accidental
Hardware Replaced
Virus Is
attack,
delete
•NetApp:
Requires recovery from tapes
• Using Best of breed HW
NetApp:
20%
Physical
Failures
Source: Gartner
Hot plugable
components
•• Invented
Snapshot
technology
• Smart instant backups
• RAID-DP
•• Up
to 255
Snapshots
per volume
Reboot
takes
60 seconds
•
Example: Every hour for past 48 hours,
File system Every
is ALWAYS
consistent
night for past
14 nights
Every weekend for past 3 weekends
• No performance impact
• Backups stay online = fastest recovery
© 2008 NetApp. All rights reserved.
18
Instantaneous Backup, Zero Server Impact
The Problem
NetApp Snapshot™ Solution
 High server utilization
 No spare cycles for backups
 Tape is slow, complex, &
expensive
 DR can be difficult to manage
 Servers run apps, not background
processes
 Instantaneous backup and recovery
 Low storage overhead
 Application consistent
VM1 VM2
VM1 VM2
CPU Utilization
CPU Utilization
Storage Pool
Traditional Backup Is NOT Practical
© 2008 NetApp. All rights reserved.
Fast, Affordable, and Simple
Backup and Restores
19
SnapShots – The NetApp way
File
Legend
C
A
B
D
Writable
Read Only
C
SnapShot
© 2008 NetApp. All rights reserved.
20
SnapShots – The Competition’s way
File
Legend
C
A
B
D
Writable
Read Only
C
SnapShot
© 2008 NetApp. All rights reserved.
21
C.O.W. Performance Impact
Source: Veritest, Nov 2006, NetApp FAS3070 and EMC CLARiiON CX3-80: Comparison Performance and Usability
© 2008 NetApp. All rights reserved.
22
Useable Snapshots for Rapid Recovery
Market-leading performance
SPC-1 Performance (IOPS)
Baseline
30,986
With Snapshots
24% higher
29,958
233% higher
 NetApp
– 3% difference
– Snapshots 4/hr
– First RAID-6
24,997
 EMC
8,997
– 64% impact
– Snapshots 1/hr
NetApp EMC
FAS3040 CX3-40
© 2008 NetApp. All rights reserved.
NetApp EMC
FAS3040 CX3-40
– Best practice
mirroring
SnapMirror - Our Flagship DR Technology
Value Proposition
Primary Data Center
Simple, flexible and cost-effective
Benefits
LAN
Simple
FAS
FAS
–Simple configuration
–Integrated with SnapManager
–Simplified failover/failback - MultiStore
Flexible
–Address a broad range of DR requirements
–Operate with FC or IP network
–Mirror to/from any NetApp system
–Multi-hop, cascading
SnapMirror
DR Site
Cost-effective
FAS
NearStore
© 2008 NetApp. All rights reserved.
–Mirror to inexpensive targets
–Supports all protocols
–Bandwidth efficient with BLI changes
–Leverage low cost IP networks
–Backup data can be made writeable
24
SnapManager for Virtual Infrastructure
Primary Site
VM1 VM2
Virtual
Server
Admin
 Policy based
management of
VM3 VM4
Virtual Center
API
SMVI
Storage
Admin
POLICIES
VM1
VM2
VM3
VM4
VMDK VMDK VMDK VMDK
Storage Pool
© 2008 NetApp. All rights reserved.
– Snapshots
– Restores
– Replication
 Storage Admin sets
and controls policy
 Virtual Server Admin
delegated to run data
management for virtual
infrastructure
 SMVI coordinated with
Virtual Center
– VM-aware snapshot
– VM locality
25
SnapManager for Virtual Infrastructure
Automates Snapshot Replication
Primary Site
VM1 VM2
Virtual
Server
Admin
DR Site
VM3 VM4
VM1 VM2 VM5
Virtual Center
API
SMVI
POLICIES
VM1
VM2
VM3
VM4
VM1
VM2
VM5
VMDK VMDK VMDK VMDK
VMDK VMDK VMDK
Storage Pool
Storage Pool
© 2008 NetApp. All rights reserved.
26
VMware Site Recovery Manager
Disaster Recovery & Runbook Automation
Primary Site
DR Site
SRM
VM1 VM2
Virtual
Server
Admin
SRM
VM3 VM4
VM1 VM2 VM5
Site
Failure
Virtual Center
Confirm?
VM1
VM2
VM3
VM4
VM1
VMDK VMDK VMDK VMDK
© 2008 NetApp. All rights reserved.
VM5
VMDK VMDK VMDK
SnapMirror
Storage Pool
VM2
®
Storage Pool
27
VMware Site Recovery Manager
Automated DR Testing With FlexClone
Primary Site
DR Site
SRM
VM1 VM2
Virtual
Server
Admin
SRM
VM3 VM4
VM1 VM2 VM5
Virtual Center
Test DR
VM1
VM2
VM3
VM4
VM1
VMDK VMDK VMDK VMDK
© 2008 NetApp. All rights reserved.
VM5
VMDK VMDK VMDK
SnapMirror
Storage Pool
VM2
®
Storage Pool
28
Complementary Site Recovery and
Automated Data Protection
Primary Site
DR Site
SRM
VM1 VM2
Virtual
Server
Admin
SRM
VM3 VM4
VM1 VM2 VM5
Virtual Center
API
SMVI
POLICIES
VM1
VM2
VM3
VM4
VM1
VM2
VM5
VMDK VMDK VMDK VMDK
VMDK VMDK VMDK
Storage Pool
Storage Pool
© 2008 NetApp. All rights reserved.
29
SnapRestore – Immediate Recovery
NetApp is the only one with this incredible feature!!
Active Data
A
B
Active
Snapshot
data
C
D
Z
Recovering any size of volume within seconds
Recovering any size of volume within seconds
© 2008 NetApp. All rights reserved.
SnapRestore – Immediate Recovery
Recovery from Database Corruption:
750 GB database corrupted
Tape
SnapRestore
Restore Time
~8 Hours
A few minutes
Log To Replay
Full Day’s (Since
last night)
Log Replay Time
HOURS
1 Hour
(From last
SnapShot)
Minutes
© 2008 NetApp. All rights reserved.
Volume Cloning
Volume clone is immediate – 0 time
Initially takes 0 space
As blocks get modified, space is consumed
Oracle
Oracle
Oracle21
Billing
Mail
© 2008 NetApp. All rights reserved.
Volume Cloning - FlexClone
Production
Production
Mrror
VM1
VM2
VM3
VM4
VM5
 Full copies consume space
and time
© 2008 NetApp. All rights reserved.
Production
Production
VM1
VM2
VM3
VM4
QA
 FlexClone copies are nearinstantaneous and storage
efficient
Block Level Deduplication of Data
Original Data
Duplicates
identified
Duplicates
Removed
(after byte-level
comparison)
Looks the same
to applications
and users
 Application transparent deduplication
 Significant capacity savings for:
– Backup data
– Archived data
– Primary storage
© 2008 NetApp. All rights reserved.
34
An Opportunity for NetApp Deduplication
 VM images consume storage equal to size of template
 VM images are 100% identical
– OS software, patches, software drivers, application data
 Save 50% on primary storage requirements after deduplicating
APP
DATA
OS
APP
APP
APP
APP
DATA DATA DATA DATA
OS
OS
OS
OS
APP
APP
APP
APP
APP
Data DATA
DATA DATA Duplicate
DATA DATA
Is Eliminated
OS
OS
OS
OS
OS
NetApp FAS
System RAID Arrays
Traditional
Enterprise
© 2008 NetApp. All rights reserved.
35
Use 50% Less Storage. Guaranteed*.
50
“During
the research
“We now
see an
phase
of your
next
average
of 83%
storage
purchasing
reductions
in
cycle,
ask each
redundant
data
vendor
if itVMware®
offers a
on our
capacity savings or
system.”
utilization guarantee.”
- Jonathan Davis, Duke
Gartner Inc. Nov 2008 April Adams
Institute
for Genome
Sciences
Capacity
Savings
and Storage
Utilization
and
Guarantees: What's Included,Policy
and Are
They Worth Considering?
Use NetApp for your virtual
environments, and we
guarantee* you will use 50%
less storage
 Implement our standard best practices
 Use our industry-leading features
–
Thin provisioning
–
Deduplication
–
RAID-DP®
–
NetApp Snapshot™ copies
 Have us help you install
 If you don’t use 50% less storage, get the
required capacity at no additional charge
*For terms and conditions, go to netapp.com/guarantee
© 2008 NetApp. All rights reserved.
Lower Power, Cooling & Space
waste
Typical: 40% Utilization
App 3
waste
App 2
8 spindles
6 spindles
NetApp: 70+% Utilization
Buy 50% Less Storage*
Save 50% in Power, Cooling,
& Space*
Shared
capacity
App 1
waste
App 3
6 spindles
12 spindles
App 2
App 1
Standard Volume Manager
NetApp Thin Provisioning
Source: Oliver Wyman Study: “Making Green IT a Reality.” November 2007.
*Thin Provisioning, clones, & multiprotocol all contribute to savings.
© 2008 NetApp. All rights reserved.
Increase Agility with Fast Provisioning
Traditional Provisioning
NetApp Provisioning
3
sec
27
27
mins
mins




Time-consuming physical copies
Slow to provision or reprovision
Manual and complex
Not suited for VM provisioning




®
Instant copies with FlexClone ®
Quick provisioning with FlexVol
Simple commands or policies
Ideal for dynamic VM environment
“The FlexClone feature allows our DBAs to establish new development and
test environments in minutes instead of days. Ultimately, this shortens the
time it takes to go from a new idea to a new revenue stream by at least 99%.”
- Mark Tuttle, Sr. Engineering Mgr, AutoTrader.COM
© 2008 NetApp. All rights reserved.
The NetApp & VMware Global Alliance
 Thousands of joint customers
 Virtualization Escalation Team for joint support
 Reference platform for iSCSI and NFS for ESX3.0
 All NetApp products are VMware certified
 Deep engineering-level collaboration
 Actively engaged across all levels
 Mutual Global Partners
© 2008 NetApp. All rights reserved.
So, Can We Do It All?
 Backup and restore your VMs
instantaneously
 Easily protect all your virtualized data
with DR
 Save 50% on your storage, power,
cooling, and space
 Deduplicate virtual server and virtual
desktop data, enabling 50% space
savings, or more
 Automate your most labor-intensive
data management tasks
 Clone and provision storage as
quickly as your VMs
 Do all of this with one architecture in
any environment
© 2008 NetApp. All rights reserved.
With NetApp, We Can!
© 2008 NetApp. All rights reserved.
© 2008 NetApp. All rights reserved.