Transcript TRAFFIC REQUIREMENTS FOR UTILITIES 2014 UTILITY SPECTRUM ACCESS MEETING Jayant Deshpande, Director, Strategic Industries Network Transformation, Bell Labs (Mark Madden, Regional VP, North.

TRAFFIC REQUIREMENTS FOR UTILITIES
2014 UTILITY SPECTRUM ACCESS MEETING
Jayant Deshpande, Director, Strategic Industries Network Transformation, Bell Labs
(Mark Madden, Regional VP, North American Utilities)
September 9, 2014
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
This presentation is based on the
UTC whitepaper:
K. Budka, J. Deshpande, M. Thottan,
“Estimating Smart Grid Communication
Network Traffic”,
A Utilities Telecom Council Whitepaper, 2014.
2
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
AGENDA
• Impact of Smart Grid on Grid Communications Networks
• Traffic Aggregation Scenarios
• Traffic Characterization
• A Transmission Substation
• LTE Field Area Network
- Assumptions
- Application Traffic Characteristics
- Implications in a 700MHz Broadband Deployment
- Extending to Other Bands
• Conclusion
3
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
SMART GRID
IMPACT ON UTILITY COMMUNICATIONS NETWORKS
Supervisory Control and Data Acquisition (SCADA)
Distribution Automation (DA)
Advanced Metering Infrastructure (AMI)
Teleprotection
Synchrophasors
Demand Response (DR)
Electric Vehicle Charging Station (EVCS)
Distributed Storage (DS)
Mobile Workforce Dynamic Line Rating
Distributed Generation (DG)
Application Plane Closed Circuit Television (CCTV)
Communication Plane
Power Delivery Plane
New grid applications drives transformation of legacy utility communication networks
4
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
UTILITY COMMUNICATIONS NETWORK
5
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Smart Grid and Other Critical Utility Applications
•
Supervisory Control And Data Acquisition (SCADA) – Refers to communication between Remote Terminal Units (RTU) or Intelligent Electronic
•
Advanced Metering Infrastructure (AMI) – Smart meters report electrical measurements (energy, voltage, power, etc.). Frequent meter
•
Demand Response -- Demand Response refers to actions taken by a utility to adapt to changes in demand. Some DR methods, such as ADR,
•
Distribution Automation (DA) -- DA refers to monitoring and control of IEDs deployed in the utility distribution system outside of the distribution
substation. These IEDs may be deployed at reclosers, switches, and capacitor banks installed along feeders (distribution lines).
•
Distributed Generation -- Large-scale distributed generation (solar, wind, fuel cells, biomass and biogas, etc.) are an integral part of Smart Grid
•
Electric Vehicle Charging Stations -- Electric Vehicle Charging Stations that allow EVs parked at the station to discharge energy from vehicle
•
Phasor Measurement Units (Synchrophasors) -- PMUs are special-purpose, state-of-the art IEDs that report measurement+status at very
short intervals (e.g. 60 or 50 times a second). PMU measurements from transmission substations are collected and analyzed to support wide area
situational awareness and control of the regional power system.
•
Dynamic Line Rating (DLR) -- DLR systems are being deployed to monitor environmental conditions at transmission lines using IEDs deployed at
or close to transmission towers. DLR IEDs measure ambient temperature, wind, solar radiation, ice accumulation, sag, and other parameters.
•
Utility Engineering and Operations -- Data transfer are required for operations and engineering needs including the retrieval of sensor data for
•
Closed Circuit Television (CCTV) -- Utilities are increasingly deploying CCTV cameras at substations, Data and Control Centers, and other
•
Mobile Workforce (MWF) -- Legacy Push-To-Talk systems and VoIP. For PTT, at any time, only one member of a talk group can speak. There is
•
Utility Business Voice -- Supports voice traffic for utility personnel located in business offices, field offices, and other sites as well as for MWF
•
Utility Business Data -- Supports business data traffic for utility personnel located in business offices, field offices and other sites as well as for
Devices (IED) deployed in a substation with the SCADA Master (Control) in the utility control center.
measurements are used for applications including Automated Demand Response (ADR), energy management, rate management, & power quality.
occur over the timescale of seconds, others occur over the timescale of several months to years.
evolution. DG deployments that require monitoring and control by the utility generate network traffic.
batteries into the grid (in addition to charging EV batteries) can be considered stand-alone DS deployments.
analysis, software/firmware upgrades, remote programming, and configuration of sensors, and re-registration of meters after blackouts.
locations to support physical security. Video feeds from cameras are typically stored in local Digital Video Recorders (DVR). When required (such as
during a security incident at a substation), one or more live video feeds may also be uploaded to the DCC.
often more than one talk group in the utility service area.
personnel. Support of voice communication over the smart grid requires the use of IP-based interfaces.
MWF personnel.
6
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
GOALS
• Quantify volume of traffic
generated by grid applications
Data critical for
network planning, design
• Quantify volume of traffic
that must be carried at points
in the network where traffic
is aggregated
Substation
Business
Office
(Primary)
Data and Control
Center
(Backup)
Data and Control
Center
Edge Router
ER
Estanet Connections
• Estimate the amount of
broadband spectrum for
Field Area Networks
Wide Area Network
Access Router
(AR)
Connections through One or More Field Area Networks
Fiber, Leased Lines, MPLS services, Ethernet, PLC, etc
Narrowband Private Wireless, 3G Wireless Broadband services, LTE, Microwave, etc)
• Service Level
Agreements (e.g., FirstNet)
Mobile
Workforce
Substation
Meter
DA
IED
Distributed
Generation
Distributed
Generation
• Required cell capacity in
other networks (private, public)
• Impact of spectrum band
DLR
IED
Neighborhood
Area Network
Substation
DA
Conc.
7
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Distribution
“Pole”
Distributed
Storage
Meter
Conc.
Neighborhood
Area Network
EV Charging Station
Transmission
Tower
FAN
Substation
Distributed
Generation
ASSUMPTIONS
• Smart Grid Network is an IP/MPLS network
• “Uplink” traffic  “downlink” traffic (most applications)
• Reasonable worst case assumptions on:
• Number of network endpoints
• Traffic generated by each endpoint
• Traffic at aggregation point =  traffic from endpoints for each
application
• Models used to characterize application traffic
• Traffic estimates also provided for gas operations
• Pumping, metering and recording (M&R) stations
The focus of the whitepaper and this presentation is on traffic estimation methodology. The
methodology can be used in other scenarios or with different inputs (with little or no
modifications to the methodology).
8
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
TRAFFIC AGGREGATION SCENARIOS
LTE FANs will be
analyzed in
more detail later
9
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
TRAFFIC CHARACTERIZATION
PERIODIC MEASUREMENT+STATUS
Management and Control System
Sensor
Poll (Periodic)
SCADA IED
Measurement+Status (Periodic)
PMU
DLR IED
DG, DS, EVCS IED
DA IED
Meter
Event (Asynchronous)
Control (Asynchronous)
Software/Firmware Upgrade (as needed)
File transfer( Scheduled, on-demand)
10
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
One or more servers Supporting
• SCADA Master Control
• Synchrophasor Management
• DLR Management
• Energy Management
• Demand Response
• DA Master Control
• Meter Data Management System
TRAFFIC CHARACTERIZATION
PERIODIC MEASUREMENT+STATUS
• Periodic messages packet formats (Up to and including Layer 2)
• SCADA, DLR IED, DG, DS, EVCS, DA, and Gas SCADA: Use DNP3-like protocol
• Synchrophasors: Use IEEE C37.118-2 standard
• AMI: Empirical
• Add fixed overhead to account for asynchronous traffic (events, file transfers)
• Add Layer 1 overhead
• Normal Condition: Periodic + asynchronous. Critical condition: Periodic only
Reporting
entity
Typical interval between
successive transmissions
Interval value used for
analysis
SCADA (Transmission Substation)
SCADA (Distribution Substation)
IED
IED
2-10 seconds
2-30 seconds
2 seconds
4 seconds
SynchroPhasors
PMU
8-100 milliseconds
16.6667 ms
(1/60 second)
DLR
DG, DS, EVCS
DA
AMI
Gas Operation SCADA
IED
IED
IED
Meter
IED
5-30 seconds
5-30 seconds
5-30 seconds
Minutes, hours, days
5-30 seconds
10 seconds
10 seconds
15 seconds
15 minutes
10 minutes
Application
11
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
TRAFFIC CHARACTERIZATION
OTHER APPLICATIONS
• CCTV: fixed data rate per video stream (eg, 128 kbps, 512 kbps)
• Generally stored at DVRs at locations. At most one or two live streams per location
• Normal condition: no live video; Critical condition: add one live video stream
• Demand Response: assume that DR traffic flows through meter
• A fraction of meters sending measurements at higher frequency
• All traffic critical
• Mobile Workforce push-to-talk (VoIP): codec data rate = codec data rate +
protocol overheads
• At most one voice stream (uplink) per talk group
• Normal condition: 1 talk group; Critical condition: multiple talk groups
• Conversational Voice (Mobile workforce, substations, business offices, etc)
• Based on Erlang-B formula using busy hour demand per user in Erlang
• Codec data rate includes protocol overhead
• Normal condition: 0.08 Erlang; Critical condition: 0.15 Erlang
• Business data (Mobile workforce, substations, business offices, etc)
• Based on average busy hour uplink data volume (in Mbps)
• Same for both the normal and critical conditions
• Add Layer 1 overhead
12
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
TRAFFIC AGGREGATION AT A TRANSMISSION SUBSTATION
AN EXAMPLE
Endpoint Type
SCADA IED
PMU
DG, DS, EVCS IED
DLR IED
Meter Data Concentrator
Number
Interval between
Measurement+status
(seconds)
40
4
10
20
1
2
0.01667 (=1/60)
10
10
--900 (= 15 minutes)
Meters (Total)
10000
120 (during ADR)
CCTV cameras
20
--MWF persons using WiFi
5
--Voice Terminals
8
--Data Terminals
8
--Aggregate Traffic (at TSS Router)
Aggregate Operations Traffic
Aggregate Video Traffic
Aggregate Voice Traffic (including business voice)
Business Data Traffic
13
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Normal Data
Rate (kbps)
Critical Data
Rate (kbps)
72
302
4
7
---
60
252
3
6
---
30
65
275
0
121
66
826
41
181
66
1,564 kbps
451 kbps
826 kbps
181 kbps
107 kbps
LTE FIELD AREA NETWORK
REFERENCE ARCHITECTURE
14
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
LTE FIELD AREA NETWORKS
Urban
Dense Urban
Suburban
Rural
Range
Traffic Load
•Tower/mobile Height
•Edge date rates
•Frequency band
•#Devices
•#Substations
•Application Traffic
15
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
TRAFFIC IN WIRELESS BROADBAND NETWORKS
KEY ASSUMPTIONS
• Number of locations and endpoints supported in LTE cell coverage area
are typical of values seen in the field.
• Sectorized cells (3 sectors/cell)
• LTE cells are coverage-limited
• Worst-case traffic loads
Demographic Type
Dense
Urban
Urban
Suburban
Rural
(flat terrain)
Population Density (per sq. km)
25,000
4,500
250
100
Coverage Area of the LTE cell (sq. km) for
a coverage-limited Macro Cell (700 MHz)
0.3
2
580
2330
Population in the Macrocell Coverage Area
7,500
9,000
145,000
233,000
16
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
INPUTS – TRAFFIC ESTIMATION FOR 700 MHZ LTE FAN
Numbers in this table are average values where
appropriate
Number of Transmission Substations (TSS)
Number of Distribution Substations (DSS)
Number of Gas Operations Stations (GOS)
Number of IEDs in each TSS
Number of IEDs in each DSS
Number of IEDs in each GOS
Number of PMUs in each TSS
Number of DG, DS, EVCS IEDs per DSS area
Number of DLR IEDs per “TSS Area”
Number of DA IEDs per DSS
Meter overhead (see AMI below for the definition of
Meter overhead)
Number of CCTV cameras per TSS
Number of CCTV cameras per DSS
Number of CCTV cameras per GOS
Dense Urban
Urban
Suburban
Rural
1
2
2
40
30
5
4
40
12
60
1
3
2
40
30
5
4
50
20
60
5
20
15
30
20
5
2
50
40
50
10
30
4
25
15
5
2
70
60
0
2%
2%
2%
3%
12
8
8
12
8
8
8
6
6
8
5
5
Number of PTT talk groups during normal operation
1
1
1
1
Number of PTT talk groups during an incident
Number of MWF members of a talk group
Substation staff at a staffed TSS
Substation staff at a staffed DSS
(Busy hour) voice demand per person (Erlang)
Normal Operation
(Busy hour) voice demand per person (Erlang)
During an incident
(Busy hour) uplink data volume per person (MB)
(in the MWF and at substations)
5
10
8
4
5
10
8
4
3
10
8
4
2
10
6
4
0.08
0.08
0.08
0.08
0.15
0.15
0.15
0.15
3
3
3
3
17
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
RESULTS – TRAFFIC ESTIMATION FOR 700 MHZ LTE FAN
Minimum Required Data Rates (worst case) in Kbps
Application
Dense Urban
Urban
Suburban
Normal Critical Normal Critical Normal Critical
Rural
Normal
Critical
SCADA (Transmission)
72
60
72
60
271
226
452
376
SCADA (Distribution)
54
45
81
68
361
301
406
339
SCADA (Gas Operations)
4
3
4
3
27
23
7
6
SynchroPhasors
302
252
302
252
755
630
1,511
1,259
DG, DS, EVCS IEDs
29
24
54
45
361
301
759
632
DLR IEDs
4
4
7
6
72
60
217
181
DA IEDs
29
24
43
36
241
201
361
301
AMI
7
0
9
0
145
0
233
0
Demand Response
0
12
0
14
0
226
0
363
CCTV
550
1,101
688
1,238
3,165
3,715
3,715
4,266
Mobile Workforce Push-to-Talk
Voice
30
151
30
151
30
90
30
60
Mobile Workforce Live Video
0
550
0
550
0
550
0
550
Conversational Voice
211
542
211
542
331
632
391
662
Business Data (MWF, Substation
Personnel)
181
511
181
511
445
610
593
676
Aggregate Traffic (kbps)
3,368
3,579
8,058
10,522
Traffic Density (kbps/sq. km)
11,227
1,790
13.9
4.52
514
587
2,460
4,308
1,651
1,789
4,266
4,816
Voice -PTT (kbps)
151
151
90
60
Voice-conversational (kbps)
542
542
632
662
Business Data (kbps)
511
511
610
676
Operations Data (kbps)
Video (kbps)
18
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
SENSITIVITY ANALYSIS (“OPERATIONS” TRAFFIC)
Sensitivity to the number of IEDs
Sensitivity to the number of PMUs
Sensitivity to the number of substations in the cell coverage area
19
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Sensitivity to the rural cell area
(Total traffic)
Fraction of LTE Cell Capacity Used by Utility Apps
COVERAGE-LIMITED LTE CELL, 700 MHz
10MHz-WIDE CHANNEL
CCTV
Metering +
Demand Response
Synchrophasor +
Substn Voice & Data
Mobile Workforce
Voice & Data
Critical SCADA
20
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
TRAFFIC IN 700MHz LTE MACROCELL
% OF AVAILABLE CAPACITY, 10 MHz-WIDE CHANNEL
Minimum Data Rate (kbps) and
Application
DA IEDs
DLR IEDs
DG, DS, EVCS, IEDs
SCADA (Transmission)
SCADA (Distribution)
SCADA (Gas Operations)
Mobile Workforce Push-toTalk Voice
Mobile Workforce conversational voice
Mobile Workforce - Data
Mobile Workforce - Live
video
Synchrophasors
Substation Voice
Substation Data
AMI
Demand Response
CCTV
Dense Urban
Data
%
Rate
29
0.096%
4
0.014%
29
0.096%
72
0.241%
54
0.181%
4
0.012%
Its Percentage of the Cell Capacity (30,000 kbps)
Urban
Suburban
Rural
0.803%
0.241%
1.204%
0.903%
1.204%
0.090%
Data
Rate
361
217
759
452
406
7
1.204%
0.722%
2.528%
1.505%
1.355%
0.024%
Data Rate
%
Data Rate
%
43
7
54
72
81
4
0.144%
0.024%
0.181%
0.241%
0.271%
0.012%
241
72
361
271
361
27
%
151
0.502%
151
0.502%
90
0.301%
60
0.201%
482
1.605%
482
1.605%
331
1.104%
271
0.903%
412
1.374%
412
1.374%
247
0.824%
165
0.549%
550
1.835%
550
1.835%
550
1.835%
550
1.835%
302
211
99
7
12
1,101
1.007%
0.702%
0.330%
0.025%
0.039%
3.669%
302
211
99
9
14
1,238
1.007%
0.702%
0.330%
0.030%
0.047%
4.128%
755
421
363
145
226
3,715
2.518%
1.405%
1.209%
0.482%
0.754%
12.384%
1511
542
511
233
363
4,266
5.036%
1.806%
1.703%
0.775%
1.211%
14.219%
21
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
REQUIRED CELL SITES
IMPACT OF SPECTRUM BAND
Higher
Bands
1x
450 MHz
~2x
~10x
700 MHz
1800 MHz
22
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
Higher
OpEx
&
CapEx
Dense Urban
Urban
Suburban
Rural
Cell Area (sq. km)
0.30
2
580
2330
700 MHz
Macrocell
Aggregate Traffic (kbps)
3,368
3,579
8,058
10,522
Operations traffic(kbps)
Video traffic (kbps)
Voice-PTT(kbps)
Voice-conversational (kbps)
Business Data (kbps)
Cell Area (sq. km)
514
1,651
151
542
511
0.58
587
1,789
151
542
511
4
2,460
4,266
90
632
610
1131
4,308
4,816
60
662
676
4544
450 MHz
Macrocell
Aggregate Traffic (kbps)
6,534
6,872
15,712
20,519
Operations traffic(kbps)
Video traffic (kbps)
Voice-PTT (kbps)
Voice-conversational (kbps)
Business Data (kbps)
Cell Area (sq. km)
996
3,203
292
1,051
991
0.021
1,127
3,434
289
1,040
981
0.38
4,796
8,318
176
1,233
1,189
104
8,401
9,391
117
1,291
1,318
419
1800 MHz
Macrocell
CELL TRAFFIC IN 450 MHz & 1800 MHz
Aggregate Traffic (kbps)
236
680
1,450
1,894
Operations traffic(kbps)
Video traffic (kbps)
Voice-PTT(kbps)
Voice-conversational (kbps)
Business Data (kbps)
36
116
11
38
36
112
340
29
103
97
443
768
16
114
110
775
867
11
119
122
23
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
CONCLUSION
• Quantified traffic generated by smart grid applications, traffic
carried at aggregation points
• Critical data for network planning, design
• Quantified amount of broadband spectrum needed by LTE
Field Area Networks in different bands
• Small amount of non-preemptible capacity required for
critical operations traffic
• ~5% of cell capacity (worst-case) in 10 MHz cell
• Methodology easily extended to other scenarios (bands, input
parameters)
24
COPYRIGHT © 2014 ALCATEL-LUCENT. ALL RIGHTS RESERVED.