Transcript Gene Chellis Rutwick Bhatt Three storage changes have already begun: New options are decreasing the cost of high-performance, scalable network storage Customers are moving.

Gene Chellis
Rutwick Bhatt
Three storage changes have already begun:
New options are decreasing the cost of
high-performance, scalable network storage
Customers are moving data to the cloud
Recovery and the cloud is becoming a reality
Windows Server 2012
System Center 2012 SP1
SMB3
Scale-Out
File Server
8,000 VMs
per Cluster
Block storage
provisioning
iSCSI Target
SMI-S
Provider
Storage
Utilization
Trending
Dedup
Hyper-V
Replica
Virtual
Fibre
Channel
VM
Prioritization
File storage
provisioning
Thin
Provision
Alert Monitor
Dynamic
iSCSI Target
Array
ReFS
ClusterAware
Updating
iSCSI Target
Server
VM Storage
Migration
VHDX
Hyper-V
Storage
Management
SAN based
Rapid
Provisioning
SAS Array
Support
SM API
SMI-S
Storage
Service
NFS 4.1
NTFS
Trim /
Unmap
CSVFS
online
CHKDSK
Storage Pool
Classification
SM API
Integration
Thin LUN
provisioning
Storage
Spaces
64-node
clusters
Offload
Data
Transfer
Hyper-V Clusters
SMB
Scale-Out File Server Clusters
Storage Spaces Virtualization and Resiliency
Shared JBOD
Storage
Windows Server 2012 R2 is cloud optimized
Private Clouds
Hosted Clouds
Cloud Service Providers
Reducing capital and operational
storage and availability costs
IT pain points
 Need offline files and secure data
 Data access over WANs driving need for
network optimization
20
0
Block based (CAGR = 16%)
2015
Workforce decentralization
40
2014
server
60
2013
 More data volumes and network sessions per
80
2012
Data consolidation
100
2011
 Despite declining disk drive costs
 Data management costs
120
2010
Rising storage TCO
140
2009
 Storage demand ballooning
 Increased stress on backup systems
2008
Rapid growth in file data
160
File based (CAGR = 60%)
Source: IDC Worldwide File-Based Storage 2011-2015 Forecast: Foundation Solutions for Content
Delivery, Archiving and Big Data, doc #231910, December 2011
Efficiently store, transfer and back up fewer bits.
Transparently removes duplication,
without changing access semantics.
Post-processing approach:
Role can be turned on
in Server Manager and
enabled on new
volumes.
Can be easily enabled
on existing data
volumes.
Can exclude specific file
types or select folders
to skip.
Process files in the
background or choose
a more aggressive
schedule.
Default setting is to
process files older than
5 days.
Not a deduplication
server.
Transparent to the
primary server
workload.
Designed to back-off if
the server needs
resources.
Protect against
hardware data
corruption.
Identify and repair
corruptions.
After Dedup:
Non-optimized files
Before Dedup:
Chunk
Store
Optimized
file stubs
2TB physical size
Savings = 8TB
10TB
plus
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
User home folder (MyDocs)
General file share
Software deployment share
VHD library
Source: Sample Windows Server 2012 file server production data (12 servers, 7TB)
*
*New
in Windows Server 2012 R2
Hyper-V VDI
Scale-out File Server
Dedup
Spaces-Based
Virtualized
Storage
VHD
VHD
Cluster Shared
Volumes
Dedup
Storage Spaces
virtualized
storage
VHD
VHD
Cluster Shared
Volumes (CSV)
Query each node for
cluster-wide dedup status
Reparse
Reparse
Deployment view for general file servers
Management
Windows Server
• Server Manager
• PowerShell
• WMI
Windows volumes
Config
status
……
Branch Office
BranchCache enabled
Deployment view for VDI
Management
Windows Server
• Server Manager
• PowerShell
• WMI
Windows volumes
Config
status
……
•Identify servers and
data volumes
•optional: Evaluate
savings (DDPEval)
•Plan rollout, scale and
policies
• Install feature / choose
volumes
•optional: Start
optimization job
> Add-WindowsFeature
Dedup-Core
> Enable-DedupVolume D:
> Start-DedupJob D:
–Type Optimization
•optional: Change file
selection policy
> Set-DedupVolume D: …
•optional: Set
optimization schedules
> New-DedupSchedule …
> Set-DedupSchedule …
•Identify servers and
data volumes
•optional: Evaluate
savings (DDPEval)
•Plan rollout, scale and
policies
• Install feature / choose
volumes
•optional: Start
optimization job
> Add-WindowsFeature
Dedup-Core
> Enable-DedupVolume D:
-UsageType HyperV
> Start-DedupJob D:
–Type Optimization
•optional: Change file
selection policy
> Set-DedupVolume D: …
•optional: Set
optimization schedules
> New-DedupSchedule …
> Set-DedupSchedule …
•Deploy VDI VMs to
volume until almost
full (leave ~10Gb free)
•Optimize volume
> Start-DedupJob D:
–Type Optimization
•Repeat until all VMs
are deployed
•Get optimization savings and status
•Launch ad hoc optimization job
> Get-DedupVolume | fl
> Get-DedupStatus | fl
> Get-DedupJob
> Start-DedupJob D: –Type Optimization
•Logs events for corrupted files to be used by
scrubbing
(e.g., if volume is getting tight due to extra churn)
•Run scrubbing and garbage collection
(runs weekly by default)
> Start-DedupJob –Type GarbageCollection D:
> Start-DedupJob –Type Scrubbing D:
•Un-optimize a volume (remove deduplication)
> Start-DedupJob –Type UnOptimization D:
•Query dedup system metadata
> Get-DedupMetadata D:
Unsupported









Reliability and data integrity
Detection
Redundancy
Reporting
Repair
Checksum validation on all data and
metadata
Scrubbing job inspects corruptions and
tries to fix them
Extra copies of all metadata and popular
data chunks
Corrupted data replaced when possible:
• Redundant copies
• Storage Spaces mirroring
• Future chunks
Deduplication evaluation tool
No need to upgrade to evaluate
(available after installing the dedup feature)
• Determine expected savings
without altering your data.
• Runs on Windows 7 or newer, and on
Windows Server 2008 R2 or newer.
• Evaluate VHDs of running VMs.
• Evaluate data on SMB/CIFS shares, including
non-Windows servers.
Note: Dedup of remote shares is not supported,
but you can evaluate the data.
50-95% primary data
reduction, with less
data to backup, archive
and migrate.
Simple, fast and higher
density storage for VDI.
Support for open files
and CSV volumes.
No change to data
access semantics for
apps or users.
Minimal impact on
server resources.
Now support for live
VHDs for VDI over SMB.
Constant validation of
all data and metadata.
Redundancy for critical
metadata and popular
data chunks.
Repair corrupted data
from available sources.
Faster file downloads,
lower WAN bandwidth
use with BranchCache
integration.
Cached chunk data on
SMB server in Hyper-V
mode.
http://aka.ms/WS2012R2
http://aka.ms/SC2012R2
http://channel9.msdn.com/Events/TechEd
www.microsoft.com/learning
http://microsoft.com/technet
http://microsoft.com/msdn