Transcript Speech title here

High Productivity Computing
Windows HPC Server 2008
Why Microsoft in HPC?
Current Issues
 HPC and IT data centers merging: isolated cluster
management
 Developers can’t easily program for parallelism
 Difficult for users to access processing cores and data
How can Microsoft help?
Positioned to mainstream integration of application parallelism
 Efforts underway to enable parallelism broadly to the
developer community
 Can expand the value of HPC by integrating productivity and
management tools
Microsoft Investments in HPC
Comprehensive software portfolio: Client, Server,
Management, Development, and Collaboration
Dedicated teams focused on Cluster Computing
Unified Parallel development through the Parallel Computing
Initiative
Partnerships with the Technical Computing Institutes
2008 Microsoft Investment in HPC
>$150M total investment in HPC in 2008.
• Platform Portfolio:
–
–
–
–
–
Client: Windows Vista 64-bit (technical workstation)
Server: Windows Compute Cluster Server
Development Platform: Visual Studio IDE with Parallel Tools
Management: Systems Center for HPC
Collaboration/Workflow: Sharepoint and Windows Workflow
Foundation
• Windows HPC Server
–
–
–
–
40 engineers on HPC server tools
40 incubation sales world-wide (sales+technical)
15 dedicated HPC marketing leads
55 half-time regional leads
• Parallel Computing Initiative
– 180 engineers focused on parallel development tools
• Technical Computing Institutes
Microsoft Confidential
HPC Technical Management Team
Name and Background
Craig Mundie, Chief Research and Strategy Officer
Tony Hey, Corporate Vice President
Bill Laing, Vice President of Engineering
Kyril Faenov, HPC General Manager
Burton Smith, Technical Fellow
Shawn Hansen, Director of HPC Marketing
Dan Fay, Director Technical Institutes
Dan Reed, Director of Microsoft Research
Windows HPC Server 2008
• Complete, integrated platform for computational clustering
• Built on top the proven Windows Server 2008 platform
• Integrated development environment
Windows Server
Operating System
• Secure,
Reliable, Tested
• Support for high
performance hardware
(x64, high-speed
interconnects)
HPC Pack
•
•
•
•
Job Scheduler
Resource Manager
Cluster Management
Message Passing Interface
Microsoft Windows HPC
Server 2008
• Integrated Solution
out-of-the-box
• Leverages investment in
Windows administration
and tools
• Makes cluster operation
easy and secure as a
single system
Beta1 available from http://www.microsoft.com/hpc
Windows HPC Server 2008: Ready for Prime-time
Location
Hardware – Machines
Hardware – Networking
Number of Compute Nodes
Total Number of Cores
Total Memory
Linpack Results
Linpack rating
Cluster efficiency
For Comparison…
Linpack rating from June2007
Top500 run (#106) on the
same hardware
Cluster efficiency from
June2007 Top500 run (#106)
on the same hardware
Typical Top500 efficiency for
Clovertown motherboards w/
IB regardless of Operating
System
Tukwila, WA
256 Dual-CPU, quad-core Intel
5320 Clovertown 1.86GHz
processors and 8GB RAM
Cisco Infiniband SDR
Broadcom GigE
256
2048
2 TB of RAM
#116
Top 500
11.75 TeraFLOPS
77.1%
8.99 TeraFLOPS
59%
65-77%
(2 instances of 79%)
30% improvement in
efficiency on the same
hardware.
Less than 2 hours to
deploy
6
Industry Focused Solutions
Academia Aerospace Automotive
Financial
Services
Geo
Life
Services Government Sciences
Market Results
• Key traction in commercial and higher education markets.
– Large clusters in financial services.
• National City, Lincoln Financial, Aegon,
– Clusters in education
• Arizona State, Holland Computing Center, NCSA, Univ of Minn, Univ of
Arizona
– Many POCs in manufacturing, scaling out now.
• Honeywell, Callaway, 3M, Boeing
• Clusters >1,000 nodes in almost every major region. Real
growth in every geography.
• Expect FY08 to focus on government as major new
segment.
Microsoft HPC Strategy: Expanding to the Enterprise
Productivity
Common mgt and
productivity platform
Dev Tools
Common dev platform
for desktop->cluster
IO
Windows Compute
Cluster Server 2003
Technologies
Compute
2006-2007
Markets
Phase 1:
Departmental
Clusters
Storage
MOSS, SQL,
System Center
Visual Studio 2008
Parallel Computing
Initiative
NetworkDirect for very
high network efficiency
Scalable Clustered
File System Support
Key Partners
Resource Mgt
SOA-based; scalable
partners
Key Partners
Compute
Rapid deployment
Turnkey app monitoring
Ease-of-management
Windows HPC
Server 2008
2008
Phase 2:
Common Platform for
Departmental to
Enterprise Clusters
What’s new in HPC Server 2008?
 New System Center UI
 PowerShell for CLI Management
High Availability for Head Nodes
Windows Deployment Services
Diagnostics/Reporting
Support for Operations Manager
 Support for SOA and WCF
 Granular resource scheduling
 Improved scalability for larger
clusters
 New Job scheduling policies
Interoperability via HPC Profile
Systems
Management
Networking
& MPI
 NetworkDirect (RDMA) for MPI
 Improved Network
Configuration Wizard
 Shared Memory MS-MPI for
multi-core
 MS-MPI integrated with
Windows Event Tracing
Job
Scheduling
Storage
 Improved iSCI SAN Support in
Win2008
 Improved Server Message
Block ( SMB v2)
 New 3rd party parallel system
file support for Windows
 New Memory Cache Vendors
Aggregate (Mb/s/core)
HPC Storage Solutions
Shared File
Systems or SAN
file systems
Parallel File
Systems
• IBM – GPFS
• Panasas – Active Scale
• HP - PolyServe
• Ibrix - Fusion
• Quantum - StorNext
• SANbolic – Melio file system
NAS and
Clustered
NAS
• Windows Server 2003
• Windows Server 2008
…
Number of cores in cluster
Greater
Sophistication
High Speed Networking Technologies
Bandwidth
Cisco
Voltaire
Qlogic
Open Fabrics
NetEffect
Myricom
Availability
Improved Efficiency for the Systems Admin
•
Simple to setup and manage in a familiar environment
–
–
Turnkey cluster solutions through OEMs
Simplify system and application deployment
•
•
Focus on ease of management
–
–
–
•
Comprehensive diagnostics , troubleshooting
and monitoring
Familiar, flexible and “pivotal” management
interface
Equivalent command line support for
unattended management
Scale up
–
–
–
–
•
Base images, patches, drivers, applications
Scale deployment, administration,
infrastructure
Head node failover
Cluster usage reporting
Compute node filtering
Better integration with enterprise
management
–
–
–
–
Patch Management
System Center Operations Management
PowerShell
Windows 2008 high Availability Services
Parallel Programming
•
Available Now
–
–
•
Emerging Technologies – Parallel Framework
–
–
•
Development and Parallel debugging in Visual Studio
3rd party Compilers, Debuggers, Runtimes etc.. available
LINQ/PLINQ – natural OO language for SQL queries in .NET
C# Futures – way to explicitly make loops parallel
For the future: Parallel Computing Initiative (PCI)
–
–
Triple investment with a new engineering team
Focused on common tools for developing multi-core codes from desktops to clusters
Compilers
• Visual Studio
• Intel C++
• Gcc
• PGI Fortran
• Intel Fortran
• Absoft Fortran
• Fujitsu
Profilers and Tracers
• PerfMon
• ETW (for MS-MPI)
• VSPerf /VSCover
• CLRProfiler
• Vampir (Being ported to
Windows)
• Intel
Collector/Analyzer(Runs
on CCS w Intel MPI)
• Vtune & CodeAnalyst
• Marmot (Being ported to
Windows)
• MPI Lint++
Debuggers
• Visual Studio
• WinDbg
• DDT
Runtimes and Libraries
• MPI
• OpenMP
• C# Futures
• MPI.C++ and MPI.Net
• PLINQ
Release Schedule
Tech
Preview
Aug
2007
Beta 1
Beta 2
Nov
2007
Early
2008
RTM
Summer
2008
• Technical Preview – Private Release
• Beta 1 – Publicly Available now!
• Beta 2 – Coincides with Windows Server 2008
RTM
• RTM – 90 to 120 days after Windows RTM
Resources
• Microsoft HPC Web site – download Beta 1 Today!
– http://www.microsoft.com/hpc
• Windows HPC Community site
– http://www.windowshpc.net
• Windows Server x64 information
– http://www.microsoft.com/x64/
• Windows Server System information
– http://www.microsoft.com/windowsserver
• Get the Facts Web site
– http://www.microsoft.com/getthefacts