Transcript HP Cloud Services Global Data Center Strategy

HP Thermal Sensor Grid
Mathew Brown
HP Cloud Services
Global Data Center Operations
Jun 13, 2013
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Agenda
• Introduction
• Problem Statement
• Rack Sensor Solution
• Software Architecture
• Using the Data (Visualizations and more)
• Measuring Success
2
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Introduction
Core Members:
Organizations:
Data Centers:
•
•
•
•
•
•
•
•
•
Matt Brown
Itoro Meshioyoe
Brad Ziemer
Erick Levitre
Ken Jackson
Kevin Smith
George Mckee
•
•
•
•
•
HP-IT Global Data Center
Strategy and Design
HP-IT Cyber Security
HP-IT Global Telecom
HP Cloud Services
HP Labs
End-User Organizations:
•
•
•
•
Facilities
Data Center IT Operations
Data Center IT Engineering
Enterprise Services
• Vendors:
3
• RFCode
• Rovisys
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
• OSISoft
HP-IT Global Data Centers
• (6) Data Centers & (100)
Satellite compute spaces
• 400,000+ Sq./ft.
• 13,000+ IT racks
• 30,000+ servers
Problem Statement
Data Center Engineering was engaged in lots of Data Center energy efficiency projects
• Hot Aisle containment
• VFD controls
• Variable flow floor tiles
• Plenum sealing
• Temperature adjustments
• Etc…
We understood the operational performance and impact to the Mechanical plant, but we realized we
didn’t know anything about cooling performance at the IT.
•
•
•
•
4
Point measurement solutions were not very useful
Dynamic IT loads were difficult to understand and predict
CFD models were only as good as the quality of input data
We needed a Performance metric for cooling
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Technical Objectives
Objectives:
• Instrument enough racks in the data center provide an adequate
coverage grid to measuring cooling performance
•
Use Herrlin, M. K., 2005, Rack Cooling Effectiveness in Data Centers &
The Green Grids Data Center Maturity Model as a framework for
instrumentation
•
Deliver a hardware abstract solution that meet IT application architecture
requirements
•
Unify data across all data centers into a single database with common
role based analytics tools
•
5
Standardize one single performance metric for analyzing cooling
effectiveness across all data centers
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
What is RCI ?
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
RCI – Rack Cooling Index
The Rack Cooling Index (RCI)
•
•
•
Developed by ANCIS
Magnus K. Herrlin, Ph.D. Formerly, Principal Scientist for Telcordia Technologies
The RCI: a dimensionless index that could become the basis for a common standard
•
•
7
measures how effectively equipment racks are cooled and maintained within industry thermal
guidelines and standards
provides the basis for interpreting modeled or measured air intake temperatures
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Calculating RCI
The Math
Degree Range
Tmin rec –Tmin allowable
 of RCI Low
intake temp
calculations
Degree Range
 of RCI IHI
intake temp
calculations
Number
of intake
temps
Tmax allowable –Tmax rec
Number
of intake
temps
=IF(20=0,"",(1-(1/(20*10)))*100)
8
Example Excel Formulas
Number of
intake
temps
Number
of intake
temps
=IF(20=0,"",(1-(42/(20*6)))*100)
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Benefits of RCI
Benefits of RCI
• Meaningful measure that can also be shown graphically
• Easily understood numerical scale - 100% means all racks are cooled to a
standard or objective
• By using two indices, over-cooling of some racks does not compensate for
under-cooling of others
•
•
9
Provides the means to isolate potential heat-related failures
Portable and non-dimensional - it work with any standard or guideline that specifies max/min
temperature ranges.
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Rack Sensor Solution
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Methodology
Technology Evaluations:
• Compared several different sensor & software solutions
• Developed TCO cost analysis
• Created Test /Dev environment for small scale solution testing / POC
• Made sure solution could integrate with existing technologies i.e. EPMS,
DCIM solutions
• Engaged IT security and Network engineering teams for high level solution
design and buy in.
11
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Cost Comparisons
Average cost for a wired solution is ~$500 per rack with cost of associated infrastructure.
•
Network infrastructure cabling to each rack >~$40K per cell
•
Three control modules per row for sensors ~$3-5K
•
Sensors ~$100-250 per sensor
•
Switches ~$35K per cell
•
Total per cell >~$200K
Cost of the RF Code solution is ~$250 per rack (4 sensors per rack) minimal infrastructure
costs.
•
Hardware cost is approximately
$80K per cell
•
POE switch
$6K per cell
•
Software/Integration:
$14K per cell
•
Total cost estimate per cell:
$100K
Cost of leveraging existing wired Sensors in particular locations <$25K
12
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Solution
•
•
•
•
•
•
•
•
13
Launch a project to deploy 13,000+ sensors across (6) Core IT data centers and (100) compute
spaces
Leverage OSIsoft PI system as the data collection and analytics layer
Utilized RFCode 433mhz RF sensors for rack level instrumentation where we didn’t already have
legacy wired sensors
Integrated 4000+ pre-existing wired sensors
Hired a systems integrator to build the PI interfaces and visualizations
Project lasted for 9 months
1900 software development man hours
7200 install man hours
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
System Components Cont.
RF Code Sensors / Readers
Sensors / Wireless “Tags”:
•
•
•
•
•
•
Simple to deploy
Operate at 433 MHz
Transmit every 10 seconds
Small form factor (2”w * 1.7”d * .3”h)
Long lithium cell battery life (3 to 4 yrs.)
Replaceable battery
– CR2302
• Transmit range of 300+ ft.
• Installation methods available
– Push Pins
– Adhesive
– Magnetic
– Screw
14
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
System Components
RF Code Reader Layout (Typical)
Readers - are similar in size to a
residential wireless router
• Security
– Tags only transmit data
– Readers only receive tag data.
– No network entry point via reader.
• POE reader every third row on avg.
• 3 temp & 1 temp/humidity wireless
sensors per rack every 3rd rack
• 2 power redundant POE switch
connected to the network per cell.
• Approx. 12 readers per cell
• Approx. 1200 sensors per cell
15
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Challenges
•
Fears around wireless sensors in the DC?
•
•
•
•
Ease of Deployment & Maintenance
•
•
•
•
•
•
•
Zip ties are horrible…
Push pin fasteners are great…
Replacing batteries not great..
Custom software had to be developed with wired sensor network
Containment areas
Devices that had unique air flow characteristics
Environmental
•
16
Security
RF Interference
Frequency conflicts (licensing)
Batteries in the DC
• Shhhh…Don’t tell anyone but servers have batteries
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Software integration
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
What is PI ?
The PI System - is a real time “Big Data”
historian capable of analyzing and
storing millions of data streams
Industries that use PI:
Critical Facilities
• Industrial manufacturing
• Oil & Gas refineries
• Data Centers
• Utilities
• Power plants
18
HPIT PI System factoids:
•
•
•
•
•
•
Single application instance
Collects and processes 1.5 million
streams of data every min
Analyzes over 30,000 data generating
devices
Annually stores 1.2TB of real-time data
300 different interfaces supporting all
major protocols , i.e. Modbus,
BACNET, SNMP, OPC etc..
300,000 concurrent connections
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Solution Architecture
PI System Components – The software erector set
The Server:
• PI Archive Database
(time series)
• Asset Frame Work
Database
• Real-time interfaces
19
The Analytics:
• Advanced Compute
Engine
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
The Visuals:
• PI Datalink
• PI ActiveView
• PI Process Book
• Mobile PI
• PI Coresite
Transformation of data to information
PI System Architecture
Objects represent equipment &
processes
PI and non-PI data related to
objects
Intuitive search & browse for data
Quick replication of structures
Provides dimensions for BI
•
•
•
•
•
Data Center Capacity
Long-term
archival in
PI Server
PI- Interface Nodes
Real-time data
collection
Utility
Meter
20
20
Power Gen &
Distribution
Energy Trending
Eco Pod ECS
Building
Automation
Sensor
Network
Real-time energy cost by
asset
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Turning Insight into Action
© Copyright 2011, OSIsoft LLC. All rights Reserved.
Solution Architecture
Rack Thermal Sensor
PI Archive DB
Deployed 13,000 + sensors across (6)
data centers & 100 remote compute
spaces
~9000 RFCode Sensors
~4000 Wired Sensors
– RF Code Readers
– RF Code Zone Manager
– OSIsoft PI Interface servers
– PI OPC Interface
- PI RDBMS Interface
21
PI Interface Nodes
Zone Manager
OPC
RFCode Reader
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Zone Manager
OPC
RFCode Reader
Environmental Observer
RDBMS
Wired sens or arrays
Visuals - Mobile
CELL RCI
Row Temps
22
Rack Temp
HP Private Cloud
- HP Mobile PI
Citrix Server hosts visualization
– PI ProcessBook
– PI ActiveView
Rack/Row Based Screen Navigation
Real Time Data Trends
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Measuring Performance
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Key Performance Indicator
RCI
The RCI is designed to be a measure of how
effectively equipment racks are cooled and
maintained within industry thermal guidelines
and standards, where 100% means that all
racks are cooled within the recommended
temperatures
RCI High
racks that are below 81 F
RCI Low
racks that are above 65 F
RCI Index
racks that are within 65 and
81 degrees F
24
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
RCI
RCI
Key Performance Indicator
Cooling Improvement
99%
Results and Findings:
•
27% increase in RCI Index across all
Data Centers
We weren’t as good at the basics as
we thought
Measuring closer to the IT allows for a
more aggressive Energy program
Using PI Analytics allows us to identify
optimization opportunities
Need to incorporate real-time data into
other tools i.e. CFD & DCIM
application
•
•
•
•
25
72%
Estimated Energy
Savings
10 million kwh
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thank you
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.