Transcript EMC Data De-Duplication & Virtualization Backup High Level

Data and Infrastructure
Assessments
TCO and ROI Analysis
Wade Carroll – BRS Account Executive
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
1
The Backdrop for Data Protection
Major trends influencing the transformation of backup environments
 Data growth
Digital Information Created and Replicated Worldwide
– Typically represents a factor of 4 to 30 times
production capacity
– New requirements to keep more data for longer
periods
Exabytes
– Daily, weekly, and monthly full backups kept for
months or years
2,500
2,000
5-FOLD Growth
1,500
in 4 YEARS
1,000
500
0
2008
2009
2010
2011
2012
Source: IDC Digital Universe white paper, sponsored by EMC, May 2009
 Server virtualization
– Dynamic environment causes increased complexity
20 percent resource utilization
80 percent resource utilization
100%
100%
CPU Utilization
– Server consolidation creates high server utilization
leaving little bandwidth for backup
New Paradigm
CPU Utilization
– VM sprawl creates protection challenges
Old Paradigm
80%
60%
40%
20%
0%
60%
Server
B
Server
C
ESXServer
40%
Hardware
20%
0%
Server
A
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
80%
Shared Physical Resources
Virtual
Server
A
Virtual
Server B
Virtual
Server
C
2
What are your top storage initiatives?
Tiered Storage Build Out
Consolidation
Technology Refresh
Backup Redesign
Virtualization Adoption
Improving Performance
Archiving
Maximize Investment
With Proper Assessment
And Sizing
Improving Forecasting
Disaster Recovery
Expanding Replication
Data Migration
Thin Provisioning
Wave 9
Wave 10
New Data Center
Wave 11
Wave 12
Securing Storage
Wave 13
Green Storage
0%
Source: The InfoPro Wave 13 (12/09)
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
10%
20%
30%
40%
50%
% Respondents
3
We Have Our Challenges and Costs
 Staffing/Operations Costs
$
 Time to Restore
 Backup Scheduling & Window
Management
 Complexity of Restore
 Disaster Recovery Readiness
 Backup Performance Optimization
 Data Retention on Disk (D-D-T)
 Specialty Application Requirements
(DB, Email)
 Compliance/Risk of Data Loss
$
 Multiple Backup Applications or
Processes
 Remote Site Backup
$
 Backup Hardware & Reliability (Tape)
 Tape Operations and Handling
 Off-site Tape Storage Costs
$
$
 Off-site Tape Storage Availability for
Recall/Restore
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
$
$
4
Real Customer - Existing Tape Environment BefoReal Customer - Existing Tape Environment Before Data Domain Data Domain
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
5
Real Customer - After - Data Domain Back Up
Environment
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
6
Assessment Tools/Examples
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
7
Assessment Workbench Tools
 Backup Quickscripts
– Windows .bat or UNIX/Linux script
– Simple database “dump”
– Typical time required: 1 hour or less.
 DPA Assessment
– Application install and system requirement
– SQL server needed
– Can run for multiple days/months
Checking the “Rear View
mirror” may help you better
understand where you’re
backups are heading…
 Deduplication/Commonality
Assessment
– Executable agent for in scope servers
– Runs 3-5 days consecutively
 File System/Email Assessment
– Executable agent run one time (can take
hours to complete)
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
8
Backup Assessment Output:
What’s Included…
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
9
Understanding the Data Protection Landscape
Long backups are a sign of unhealthy and overloaded
backup servers, impacting both recovery point and
recovery times.
Backup Job Summary
Server
Clients
# Jobs
Success Rate
(%)
# Clients > 8
Hours
# Clients >
12 Hours
# Clients >
24 Hours
Backed Up
(GB)
# Files
BACKUP2
15
1,149
98.87
9
9
6
43,696.17
16,392,022
GVLFILE2
19
648
84.41
4
3
0
1,902.51
10,499,396
CORPPRODBAK101
39
2,643
96.25
4
4
3
26,668.83
92,486,746
Restore Job Summary
Server
Clients
# Restore Jobs
Success Rate (%)
Restored (GB)
# Files
BACKUP2
1
3
100.00
81.25
20
CORPPRODBAK101
1
2
100.00
1.86
2,416
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
10
Understanding The Load/Burden
Charleston
Greenville
Charlotte
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
11
Where Are The Delays Occuring?
Queue delays of up to 40 hours resulting from tapebased processes unnecessarily increase complexity and
puts critical data at risk
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
12
Which Systems Are The Biggest Offenders?
Server
Host
Job Name
Date
Duration
(Hours)
Capacity
(GB)
# Files
MB/sec
CORPPRODBAK101
ENRLPRODUTL101
\\ENRLPRODUTL101\D:
2010-01-02
55.44
48.18
4,115,335
0.25
CORPPRODBAK101
ENRLPRODUTL101
\\ENRLPRODUTL101\D:
2010-01-12
47.79
212.37
11,034,781
1.26
CORPPRODBAK101
ENRLPRODUTL101
\\ENRLPRODUTL101\D:
2010-01-19
47.09
216.09
11,344,705
1.31
CORPPRODBAK101
EXCHPRODSTR101
\\EXCHPRODSTR101\E:
CORPPRODBAK101
EXCHPRODSTR101
Backups
are taking
up to 55 4.19
hours. Deduplication
of
2010-01-04
38.78
108,326
0.03
data2010-01-01
at client or SAN
could1,412.01
reduce backup
durations.
\\EXCHPRODSTR101\E:
37.92
14,146,879
10.59
CORPPRODBAK101
EXCHPRODSTR101
\\EXCHPRODSTR101\E:
2009-12-25
36.02
1,399.72
13,911,850
11.05
BFBACKUP2
BFIFILE1
\\BFIFILE1\P:
2009-12-26
23.85
518.74
2,743,910
6.19
BFBACKUP2
BFIFILE1
\\BFIFILE1\P:
2010-01-02
23.08
482.54
2,750,349
5.95
BFBACKUP2
DBAUTLDBS01
\\DBAUTLDBS01\E:
2009-12-21
21.67
1,646.24
5,382
21.60
CORPPRODBAK101
ENRLPRODUTL101
\\ENRLPRODUTL101\D:
2010-01-15
20.54
4.29
41,278
0.06
BFBACKUP2
BFIFILE1
\\BFIFILE1\P:
2010-01-09
20.45
495.74
2,948,618
6.90
CORPPRODBAK101
ENRLPRODUTL101
\\ENRLPRODUTL101\D:
2010-01-14
20.18
5.16
98,387
0.07
BFBACKUP2
BFIFILE1
\\BFIFILE1\P:
2010-01-16
20.08
516.36
3,039,101
7.31
BFBACKUP2
DBAUTLDBS01
\\DBAUTLDBS01\E:
2009-12-30
19.65
1,560.70
4,938
22.59
CORPPRODBAK101
ENRLPRODUTL101
\\ENRLPRODUTL101\D:
2010-01-13
18.89
6.13
131,806
0.09
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
13
Which Clients Are Failing and How Often?
Server
Media Server
Host
# Jobs
Success Rate (%)
CORPPRODBAK101
CORPPRODBAK101
icuproddbm101
22
0.00
BFGVLFILE2
BFGVLFILE2
BFGVLCVS.benefitfocus.com
18
0.00
BFGVLFILE2
BFGVLFILE2
BIZDEVDBSBCKUPS
21
4.76
BFGVLFILE2
BFGVLFILE2
bizqaarch302.benefitfocus.com
21
4.76
BFGVLFILE2
BFGVLFILE2
bizqaarch301.benefitfocus.com
21
4.76
CORPPRODBAK101
CORPPRODBAK101
BIZPRODEDI101
30
66.67
CORPPRODBAK101
CORPPRODBAK101
ESBPRODAMQ101
88
72.73
CORPPRODBAK101
CORPPRODBAK101
ENRLPRODUTL101
26
80.77
BFGVLFILE2
BFGVLFILE2
Bizdevbuild301.benefitfocus.com
21
80.95
CORPPRODBAK101
CORPPRODBAK101
EXCHPRODSTR101
36
88.89
CORPPRODBAK101
CORPPRODBAK101
CORPCLUSFTP101
44
90.91
CORPPRODBAK101
CORPPRODBAK101
CORPFINTS101
44
90.91
BFBACKUP2
BFBACKUP2
DBAUTLDBS01
22
90.91
CORPPRODBAK101
CORPPRODBAK101
CORPFINDBS101
154
92.86
CORPPRODBAK101
CORPPRODBAK101
CORPPRODSTR101
88
93.18
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
14
What Are My Performance Considerations?
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
15
Email System Assessment
Email Server
Host
Software
host
Software Version
Exchange Server 2003
Version 6.5 (Build 7638.2: Service Pack 2)
Email Totals
Host
host
# Messages
# Attachments
2,225,838
Messages (MB)
931,411
Attachments (MB)
44,464.19
117,425.04
Exchange (MB)
137,122.78
Email Storage Group
Host
Group Name
Store
Size (GB)
host
First Storage Group
Public Folder Store
0.40
host
First Storage Group
Mailbox Store
2.77
host
First Storage Group
Store1
0.22
host
First Storage Group
Store2
27.09
host
Second Storge Group
Mailbox Store2
36.73
host
Second Storge Group
Store2.1
31.30
host
Third Storage Group
Mailbox Store3
19.33
host
Third Storage Group
Store3
41.60
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
16
Email Data by Age/Top Offenders
Age
# Messages
Size (MB)
0 to 30 days
263,160
20,587.27
31 to 60 days
149,597
9,671.45
61 to 120 days
223,563
13,513.02
1,589,518
93,351.05
Greater than 120 days
Host
Mailbox
# Messages
# Attachments
Messages (MB)
Attachments (MB)
Exchange (MB)
host01
User
45,710
20,395
516.10
3,217.52
3,988.77
host01
User
10,823
6,987
555.78
2,608.66
3,223.86
host01
User
48,024
18,578
79.02
2,109.22
2,467.07
host01
User
19,645
10,445
129.61
1,679.57
1,902.88
host01
User
57,389
14,571
78.14
1,271.74
1,803.91
host01
User
22,462
8,219
51.96
1,447.49
1,589.55
host01
User
59,748
28,747
76.92
1,129.58
1,522.84
host01
User
1,144
1,103
2.43
1,506.84
1,509.92
host01
User
22,342
17,131
44.93
1,310.99
1,465.47
host01
User
5,451
1,810
20.62
1,397.79
1,442.46
host01
User
13,807
7,958
147.06
1,150.71
1,339.04
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
17
Deduplication Analysis Summary
Host
Object
Scanned (MB)
First Scan
New Data
(MB)
First Scan %
Common
First Scan
Duration
Avg New
Data (MB)
Avg %
Common
Avg Duration
ADVMFS01
M:
92,160
74,588
19.07
02:01:49
223.00
99.76
00:12:42
ADVMFS01
S:
146,125
109,978
24.74
06:27:38
24.00
99.98
00:13:13
ADVMFS01
T:
53,862
41,052
23.78
02:06:25
0.00
100.00
00:04:30
ADVMFS01
U:
231,936
154,522
33.35
06:03:12
1,075.25
99.54
01:07:26
Backup Data Reduction Possible
Host
Object
Total Backups
(GB)
First Backup
(GB)
Second Backup
(GB)
Third Backup
(GB)
Fourth Backup
(GB)
Fifth Backup
(GB)
ADVMFS01
M:
73.71
72.84
0.53
0.00
0.06
0.28
ADVMFS01
S:
107.49
107.40
0.00
0.00
0.03
0.06
ADVMFS01
T:
40.09
40.09
0.00
0.00
0.00
0.00
ADVMFS01
U:
155.10
150.90
0.01
0.01
1.50
2.69
371.23
0.53
0.01
1.60
3.02
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
18
Deduplication Analysis/Data Reduction
Host
Object
Scanned (MB)
First Scan
New Data
(MB)
First Scan %
Common
First Scan
Duration
Avg New
Data (MB)
Avg %
Common
Avg Duration
ADVMFS01
M:
92,160
74,588
19.07
02:01:49
223.00
99.76
00:12:42
ADVMFS01
S:
146,125
109,978
24.74
06:27:38
24.00
99.98
00:13:13
ADVMFS01
T:
53,862
41,052
23.78
02:06:25
0.00
100.00
00:04:30
ADVMFS01
U:
231,936
154,522
33.35
06:03:12
1,075.25
99.54
01:07:26
Host
Object
Total Backups
(GB)
First Backup
(GB)
Second Backup
(GB)
Third Backup
(GB)
Fourth Backup
(GB)
Fifth Backup
(GB)
ADVMFS01
M:
73.71
72.84
0.53
0.00
0.06
0.28
ADVMFS01
S:
107.49
107.40
0.00
0.00
0.03
0.06
ADVMFS01
T:
40.09
40.09
0.00
0.00
0.00
0.00
ADVMFS01
U:
155.10
150.90
0.01
0.01
1.50
2.69
371.23
0.53
0.01
1.60
3.02
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
19
Consumption by Last Modified Date
85% (2,100 GB) of files have not been MODIFIED in 6
months or older
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
20
Consumption by Last Accessed Date
38% (936 GB) of files have not been ACCESSED in 6
months or older
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
21
All File Categories
Category
# Files
% of Files
Size (GB)
% of Total
All Other
730,352
38.92
927.57
40.83
Multimedia Files
505,168
26.92
620.28
27.30
MS Office and Document Files
356,335
18.99
315.54
13.89
Compressed Files
32,570
1.74
196.37
8.64
Data Files
20,881
1.11
111.01
4.89
919
0.05
44.79
1.97
Program and Executable Files
40,147
2.14
34.32
1.51
Database Files
31,270
1.67
16.81
0.74
Internet Files
151,918
8.10
2.67
0.12
Temp Files
1,610
0.09
2.24
0.10
Settings and Config Files
2,927
0.16
0.16
0.01
Log Files
2,247
0.12
0.03
0.00
154
0.01
0.02
0.00
Backup Files
System Files
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
22
Data Growth over Past 6 Years
Year
# Files
Size (GB)
Total GB
Growth Rate (%)
2004
251,726
123.04
123.04
2005
164,052
97.16
220.20
78.96
2006
420,506
410.37
630.57
186.36
2007
552,737
521.32
1,151.90
82.67
2008
543,406
763.37
1,915.26
66.27
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
23
Economic Example of
Deduplication Benefit
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
24
Total Cost Landscape
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
25
Understanding True Costs
What’s the operational Impact of Tape?
1469 Moving Parts!
518TB
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
26
Identifying Hidden Opportunities…
(4) 12.7TB Full
(24) 465GB Incr
~62TB/Month!
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
27
Deduplication Math Works!
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
28
Extending The Math!
248TB vs.
14.1TB
U Choose!
1282Mbps vs.
37Mbps
U Choose!
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
29
Real World Results - Validation
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
30
TCO Comparative Data
36 Month TCO Analysis , DD Restorer
EMC DD Solution
DD 660s
Implementation Services/Education
Annual HW/SW Maintenance
$
Inc.
Inc.
Acquisition
Cost
287,000
P&L Impact
Business As Usual
Tape Acquisition Costs - Site 1
Tape Acquisition Costs - Site 2
Tape Storage Costs - Site 1
Tape Storage Costs - Site 2
$
Monthly
Rate
7,972
$
7,972
$
$
$
$
$
Monthly
Rate
2,068
449
517
310
$
$
$
$
Basis
2010
2011
2012
Total
$ 95,667 $ 95,667 $ 95,667 $ 287,000
$
$
95,667 $ 95,667 $ 95,667 $
2010
24,811
5,385
6,204
3,720
2011
2012
$ 27,292 $ 30,021
$ 5,924 $ 6,516
$ 6,390 $ 6,582
$ 3,832 $ 3,947
Tape System Required Upgrade
Annual Tape System Maintenance
$
$
90,000
10,800
$
$
2,500
900
$
$
30,000 $ 30,000 $ 30,000
10,800 $ 10,800 $ 10,800
Backup & Restore Timesheet (hours)
Estimated Fully burdened labor Cost
$
115,000
$
2,220
60 $
$
720 $
720 $
720
26,640 $ 26,640 $ 26,640
$
$
-
Total
82,124
17,826
19,176
11,498
90,000
32,400
2,160
79,920
-
$
-
Cost of Restore Failures???
$
P&L Impact
$
9,023
$ 108,280 $ 111,598 $ 115,226 $
Savings w/ DD Solution
$
1,051
$
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
-
$
- -
$
$
$
$
$
$
$
$
$
$
$
287,000
12,614 $ 15,931 $ 19,559 $
335,104
48,104
31
© Copyright 2009 EMC Corporation. All rights reserved. Joe Staiber
32