Transcript What is this file?
Build a Better Data Center with APC and Cisco
Choosing and specifying density High density in an existing environment High density in a new environment
All content in this presentation is protected – © 2009 APC by Schneider Electric Core | High Density | Rev 0
APC|Cisco Partnership Overview
● Cisco Technology Developer Partner since 1999 creating tested and integrated solutions for: ● CallManager ● Unity Express ● Cisco Unified Communications Manager ● Cisco “Data Center of the Future” Partner ● Online presence on www.thedcofthefuture.com
● Joint webcasts ● Presence in Cisco’s booth at Cisco Live in June ● Speaking opportunities with Cisco at Cisco Live © 2009 APC by Schneider Electric Core | High Density | Rev 0
High density is a key factor in the challenges facing data centers
Increasing availability expectations Uncertain long-term plans for capacity or density Rapid changes in IT technology Energy and service cost control pressure High density blade server power/heat Dynamic power variation Regulatory requirements Server consolidation & virtualization
APC can help simplify the complexities of data center high density challenges
© 2009 APC by Schneider Electric Core | High Density | Rev 0
Challenges to COOLING
Example: COOLING requirement for an 20 kW rack = 2,100 cfm per rack
Would require 7 vented floor tiles per rack (7x more than normally allocated)
Floor tile
300
cfm Floor tile
300
cfm Floor tile
300
cfm Floor tile
300
cfm Floor tile
300
cfm Floor tile
300
cfm Floor tile
300
cfm
Requires substantial increases in aisle width and spacing between racks
Clogged raised floors compound the problem
White paper 46
Raised floor, perimeter-cooled data centers face practical limitation of approximately 5 kW (average)
© 2009 APC by Schneider Electric Core | High Density | Rev 0
per rack
Challenges to POWER
Breaker chaos
● Insufficient breaker positions ● “Cascading” panels ● Mislabeled or unlabeled breakers ● Becomes worse with redundancy
Adding new voltage levels & receptacle types
to the rack ● Increases need for hot work ● Trend towards minimizing hot work
Getting more power to the rack
● Avoid tripping breakers
White papers 28 29
COMPLEXITY increases likelihood of downtime
© 2009 APC by Schneider Electric Core | High Density | Rev 0
Challenges to SPACE and CABLING
Floor loading
of fully-loaded high-density rack ● Sub-floor weight bearing limitations ● Supplemental raised floor pedestals may be required
Airflow limitations
of front and rear doors
Cable chaos
– Risk of blocked airflow and human error from proliferation of cables in the rack
Without effective high-density implementation, rack and cable challenges proliferate
© 2009 APC by Schneider Electric Core | High Density | Rev 0
Racking and Cabling Solutions for Nexus
NEW! These configuration guides are now Available on www.thedcofthefuture.com
© 2009 APC by Schneider Electric Core | High Density | Rev 0
First we need a standardized way to specify density Traditional way
Specifying Density
Same 500 kW data center – but different “average density” depending on how calculated:
746 watts/ft 2 179 watts/ft 2 119 watts/ft 2 189 watts/ft 2 Ambiguous
•
Include access area around racks?
•
Include back-room area?
•
Consider total mains power consumption ?
A better way
White paper 120
© 2009 APC by Schneider Electric Core | High Density | Rev 0
5 kW/rack = Total IT power # of racks
●
Eliminates the ambiguities of
watts/ft 2
●
Allows different densities for different areas of the data center
Density specification principles
Specifying Density Specify at the
● ● ●
ROW level Rack: Room:
Too detailed
ROW: Just right!
– Not enough information up front Not detailed enough – No flexibility for variation
Use watts/rack
● Unambiguous
Environment Average watts/rack Establish average peak-to ratio of approximately 2
● ●
Too low
impacts IT flexibility and causes inefficiency
Too high
leads to oversizing
Lab Server intensive (Typical data center) Storage intensive Co-location Supercomputing Medium
(4-10 kW/rack)
Medium to high
(4-15 kW/rack)
Low
(< 4 kW/rack)
High
(10-15 kW/rack)
High
(10-15 kW/rack)
Typical peak-to-average ratios High
(up to 4)
Medium
(approx 2)
Low
(< 2)
Medium
(2)
Low
(close to 1)
These 3 basic principles simplify density implementation
© 2009 APC by Schneider Electric Core | High Density | Rev 0
Four cooling strategies for high density
A spectrum of strategies, depending upon level of investment and planning
High investment
Most planning
Whole-room high density 4
Low investment
Least planning
White paper 46
© 2009 APC by Schneider Electric Core | High Density | Rev 0
High-density pod Suplemental cooling 2 Spread the load 1 3
Cooling strategies:
Option 1: Spread the load
1 2 Spread the load Supplemental cooling 3 High-density pod 4 Whole room
Advantages
● Extends life of near-end-of-life data center ● Essentially “free” band-aid approach
Spread out high density equipment in the room
Disadvantages
● IT equipment placement can be surprisingly complex ● One addition of IT equipment can have surprising effects on other existing loads ● Difficult to figure out where the limits to growth are ● Uses the most floor space ● Data cabling issues
Assessment services can help plan implementation and determine the limits of this strategy
© 2009 APC by Schneider Electric Core | High Density | Rev 0
Cooling strategies:
Option 2: Supplemental cooling Advantages
● Can target high density (brings the solution TO the hot spot) ● Defers capital cost
1 2 Spread the load Supplemental cooling 3 4 High-density pod Whole room
Disadvantages
● Room constraints could limit deployment ● May be constrained to available bulk cooling
Air removal unit Air distribution unit Single AC unit Supplemental cooling devices are available and can help with targeted high-density equipment
© 2009 APC by Schneider Electric Core | High Density | Rev 0
Cooling strategies:
Option 3: High-density pods
Low-density room
Advantages
● Maximum density capability (30 kW/rack) ● High-efficiency design ● Optimal floor space utilization ● Allows for targeted availability ● Effective long-term strategy ● No need for raised floor
1 2 Spread the load Supplemental cooling 3 4 High-density pod Whole room
Hot/cool air circulation is localized within the zone
High-density pod HEAT OUT
To building’s heat rejection system
Disadvantages
● Needs to be planned for in advance ● Requires grouping of high-density equipment
White paper 134
© 2009 APC by Schneider Electric Core | High Density | Rev 0
Easy-to-implement, cost effective, high-efficiency solution
Cooling strategies:
Option 4: Whole-room high density
Advantages
● Handles all high density scenarios ● Smallest footprint
Go
Watch video about this purpose-built high-density data center
1 2 Spread the load Supplemental cooling 3 4 High-density pod Whole room
Disadvantages
● Highly specialized and custom built ● Extreme capex compared to other options ● Can result in extreme underutilization of cooling capacity if not correctly engineered
Not a widely adopted approach – requires significant engineering for unique scenarios
© 2009 APC by Schneider Electric Core | High Density | Rev 0
Deployment strategies for cooling EXISTING data centers
1 Spread the load
● High density is very small fraction of load
2 Supplemental cooling
● High density is small fraction of load ● Location placement of IT equipment is flexible ● Open U-space in existing racks ● No flexibility over the placement of IT equipment ● Limited capital budget
3 Dedicated high-density pods
● High density is moderate to high fraction of load ● Sub-section of data center is available for pod(s)
White paper 46
© 2009 APC by Schneider Electric Core | High Density | Rev 0
4 Whole-room high-density cooling
Deployment strategies for cooling NEW data centers
1 Spread the load 2 Supplemental cooling
● Perimeter cooled room specified at < 6 kW/rack ● High density is small fraction of load ● Limited capital budget
3 Dedicated high-density pods 4 Whole-room high-density cooling
● High density is moderate to high fraction of load ● Large farms of high density servers (i.e. HPC) ● Cooling redundancy requirements vary by equipment ● Location of all racks and density are known in advance
White paper
● Future rack density requirements uncertain ● Expensive to implement
46
© 2009 APC by Schneider Electric Core | High Density | Rev 0
Cooling strategies:
High-density pod explained
1 2 Spread the load Supplemental cooling 3 4 High-density pod Whole room
● ● ●
A “mini data center” with its own cooling Contributes no heat to rest of data center Works alongside existing room-based cooling
© 2009 APC by Schneider Electric Core | High Density | Rev 0 ● ●
Hot/cool air circulation localized within the pod by short air paths and/or containment Achieves optimum efficiency
Cooling IN the row, close to the load
Hot-aisle air enters from rear, preventing mixing of hot and cool air Heat is captured and transferred to heat rejection system
1 2 Spread the load Supplemental cooling 3 4 High-density pod Whole room
Cold air is supplied to the cold aisle Cooling units
© 2009 APC by Schneider Electric Core | High Density | Rev 0
Operates on hard floor or raised floor
Standardized modular multi-rack high-density pod
1 2 Spread the load Supplemental cooling 3 4 High-density pod Whole room Air conditioners return ambient room-temperature air Hot air is exhausted to the hot aisle and returns to the back of the air conditioners
© 2009 APC by Schneider Electric Core | High Density | Rev 0
Integral row-based air conditioners
Major efficiency benefits of row-based approach vs traditional room cooling
●
Less air mixing
equipment, instead of mixing the room air: 60% reduction in fan power Fans move only the air required by the IT ●
Variable fan speed
load, instead of running at full speed: 50% typical further reduction in fan power Fan speed dynamically tracks the actual IT ●
Higher return temperature
Air is captured by the CRAC at higher temperature, easing the transfer of heat to the heat rejection systems: 10% reduction in chiller power ●
No rehumidification
Air is processed by the CRAC at higher temperature, eliminating the energy associated with dehumidification / rehumidification: 10% reduction in CRAC power ●
More economizer use
Return water temp to chiller is higher, increasing the operating hours of economizer modes: 10% typical reduction in chiller power © 2009 APC by Schneider Electric Core | High Density | Rev 0
Is there an efficiency vs density tradeoff?
● High density and high efficiency are related ● Many people think high density makes efficiency worse Only true when trying to push existing data centers to cool high density ●
High density enables high efficiency
in a properly designed new data center or a pod in an existing data center ● Shorter pipe lengths Less pump power ● Shorter air flow lengths ● Less air mixing Less fan power ● Higher return air temperatures Less humidification/dehumidification power and chiller power
The highest efficiency data centers will be high-density data centers
© 2009 APC by Schneider Electric Core | High Density | Rev 0
POWER: High-density power distribution
415 volt distribution
(Elimination of PDU transformers) ● Increased energy efficiency Lower electric bill ● Decreased copper ● Smaller footprint Less weight More space for IT racks
Modular power distribution
● Hot swappable
→
No need to predict future rack power requirements ● Allows higher power densities in distribution products ● Auto-sensing of breaker size and location © 2009 APC by Schneider Electric Core | High Density | Rev 0
MANAGEMENT: Adding intelligence Knowing what
’
s going on, in real time
● Smart management can: ● Analyze the effect of proposed changes ● Suggest the best place for adding new servers ● Recognize overloads or trends in time for corrective action ● Identify
stranded capacity
Locations where there is available POWER, COOLING or SPACE but not enough of the other two
White paper 150
© 2009 APC by Schneider Electric Core | High Density | Rev 0
High density
Summary
Choosing and specifying density
Row-level specification eliminates stranded capacity, prevents hot spots, and provides flexibility for future deployments. This leads to a high efficiency data center.
High density in an existing environment
Assessment of existing cooling and power environment helps determine best strategy to implement high density. Cooling solutions range from spreading out the load to high density pods.
High density in a new environment
An optimal data center physical infrastructure design strategy includes dedicated high-density pods with close-coupled cooling, 415 V power distribution, modular power distribution, and capacity & change management software.
© 2009 APC by Schneider Electric Core | High Density | Rev 0
Where to go for more info? Next Steps?
●
Where to get more info
● www.apc.com
● Tools.apcc.com
● www.thedcofthefuture.com
● Cisco Partner Central under Technology Developer Partners and APC ●
APC White papers
●
APC WP#129: A Scalable, Reconfigurable, and Efficient Data Center Power Distribution Architecture
●
APC WP#118: Virtualization: Optimized Power and Cooling to Maximize Benefits
●
APC WP#114: Implementing Energy Efficient Data Centers
●
APC WP#126: An Improved Architecture for High-Efficiency, High Density Data Centers
●
APC WP#150: Power and Cooling Capacity Management for Data Centers
© 2009 APC by Schneider Electric Core | High Density | Rev 0