Gene Chellis Principal Group Program Manager Microsoft Windows Server, Hybrid Storage Services.
Download ReportTranscript Gene Chellis Principal Group Program Manager Microsoft Windows Server, Hybrid Storage Services.
Gene Chellis Principal Group Program Manager Microsoft Windows Server, Hybrid Storage Services Windows Server 2012 R2 is cloud optimized Private Clouds Hosted Clouds Cloud Service Providers Reducing capital and operational storage and availability costs Windows Server 2012 R2 Focus Areas Enabling Hosters and the Private Cloud Three storage changes have already begun: New options are decreasing the cost of high-performance, scalable network storage Customers are moving data to the cloud Recovery and the cloud is becoming a reality IT pain points Need offline files and secure data Data access over WANs driving need for network optimization 20 0 Block based (CAGR = 16%) 2015 Workforce decentralization 40 2014 server 60 2013 More data volumes and network sessions per 80 2012 Data consolidation 100 2011 Despite declining disk drive costs Data management costs 120 2010 Rising storage TCO 140 2009 Storage demand ballooning Increased stress on backup systems 2008 Rapid growth in file data 160 File based (CAGR = 60%) Source: IDC Worldwide File-Based Storage 2011-2015 Forecast: Foundation Solutions for Content Delivery, Archiving and Big Data, doc #231910, December 2011 Efficiently store, transfer and back up fewer bits. Transparently removes duplication, without changing access semantics. Post-processing approach: Role can be turned on in Server Manager and enabled on new volumes. Can be easily enabled on existing data volumes. Can exclude specific file types or select folders to skip. Process files in the background or choose a more aggressive schedule. Default setting is to process files older than 5 days. Not a deduplication server. Transparent to the primary server workload. Designed to back-off if the server needs resources. Protect against hardware data corruption. Identify and repair corruptions. After Dedup: Non-optimized files Before Dedup: Chunk Store Optimized file stubs 2TB physical size Savings = 8TB 10TB plus 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% User home folder (MyDocs) General file share Software deployment share VHD library Source: Sample Windows Server 2012 file server production data (12 servers, 7TB) * *New in Windows Server 2012 R2 Hyper-V VDI Scale-out File Server Dedup Spaces-Based Virtualized Storage VHD VHD Cluster Shared Volumes Dedup Storage Spaces virtualized storage VHD VHD Cluster Shared Volumes (CSV) Query each node for cluster-wide dedup status Reparse Reparse Deployment view for general file servers Management Windows Server • Server Manager • PowerShell • WMI Windows volumes Config status …… Branch Office BranchCache enabled Deployment view for VDI Management Windows Server • Server Manager • PowerShell • WMI Windows volumes Config status …… •Identify servers and data volumes •optional: Evaluate savings (DDPEval) •Plan rollout, scale and policies • Install feature / choose volumes •optional: Start optimization job > Add-WindowsFeature Dedup-Core > Enable-DedupVolume D: > Start-DedupJob D: –Type Optimization •optional: Change file selection policy > Set-DedupVolume D: … •optional: Set optimization schedules > New-DedupSchedule … > Set-DedupSchedule … •Identify servers and data volumes •optional: Evaluate savings (DDPEval) •Plan rollout, scale and policies • Install feature / choose volumes •optional: Start optimization job > Add-WindowsFeature Dedup-Core > Enable-DedupVolume D: -UsageType HyperV > Start-DedupJob D: –Type Optimization •optional: Change file selection policy > Set-DedupVolume D: … •optional: Set optimization schedules > New-DedupSchedule … > Set-DedupSchedule … •Deploy VDI VMs to volume until almost full (leave ~10Gb free) •Optimize volume > Start-DedupJob D: –Type Optimization •Repeat until all VMs are deployed •Get optimization savings and status •Launch ad hoc optimization job > Get-DedupVolume | fl > Get-DedupStatus | fl > Get-DedupJob > Start-DedupJob D: –Type Optimization •Logs events for corrupted files to be used by scrubbing (e.g., if volume is getting tight due to extra churn) •Run scrubbing and garbage collection (runs weekly by default) > Start-DedupJob –Type GarbageCollection D: > Start-DedupJob –Type Scrubbing D: •Un-optimize a volume (remove deduplication) > Start-DedupJob –Type UnOptimization D: •Query dedup system metadata > Get-DedupMetadata D: Unsupported Reliability and data integrity Detection Redundancy Reporting Repair Checksum validation on all data and metadata Scrubbing job inspects corruptions and tries to fix them Extra copies of all metadata and popular data chunks Corrupted data replaced when possible: • Redundant copies • Storage Spaces mirroring • Future chunks Deduplication evaluation tool No need to upgrade to evaluate (available after installing the dedup feature) • Determine expected savings without altering your data. • Runs on Windows 7 or newer, and on Windows Server 2008 R2 or newer. • Evaluate VHDs of running VMs. • Evaluate data on SMB/CIFS shares, including non-Windows servers. Note: Dedup of remote shares is not supported, but you can evaluate the data. 50-95% primary data reduction, with less data to backup, archive and migrate. Simple, fast and higher density storage for VDI. Support for open files and CSV volumes. No change to data access semantics for apps or users. Minimal impact on server resources. Now support for live VHDs for VDI over SMB. Constant validation of all data and metadata. Redundancy for critical metadata and popular data chunks. Repair corrupted data from available sources. Faster file downloads, lower WAN bandwidth use with BranchCache integration. Cached chunk data on SMB server in Hyper-V mode. http://aka.ms/WS2012R2 http://aka.ms/SC2012R2 http://channel9.msdn.com/Events/TechEd www.microsoft.com/learning http://microsoft.com/technet http://microsoft.com/msdn