Transcript 30406010r2 Presentation on IP Network Model.ppt

Analyze
Assure
Accelerate
Network Model for Evaluating Multimedia
Transmission Performance Over Internet Protocol
PN-3-0062
Will become TIA/EIA-921
Jack Douglass, Spirent
Chair TIA TR30.3
June 2004
TR30.3 TR30.3/04-6-011
[email protected]
Purpose of Presentation
• Establish a formal liaison between TR30.3 and appropriate committees to
•
help develop Network Model for Evaluating Multimedia Transmission
Performance Over Internet Protocol (PN-3-0062)
Other Liaisons Activities
–
–
–
–
–
–
–
ITU-T SG11
ITU-T SG13
ITU-T SG12 -- Approved as Question M/12
ITU-T SG15 Q7
ITU-T SG16 Q11, Q14 (QF)
IETF
Etc.
• Invite committee members to TR30.3 meetings to work on IP Network
Model
– IP Network Statistics
– Network Architecture
– Test Scenarios
TR30.3 Modem Test Standards
• TIA/EIA 496A-1989: Interface Between Data Circuit Terminating
Equipment (DCE) and the Public Switched Telephone Network
– Included Network Model for Evaluating Modem Performance
• TIA/EIA TSB 37A-1994: Telephone Network Transmission Model
for Evaluating Analog Modem Performance, which became ITU-T
Recommendation V.56bis-1995
• EIA/TIA TSB 38-1994: Test Procedures for Evaluation of 2-Wire 4
Kilohertz Voice Band Duplex Modems, which became ITU-T
Recommendation V.56ter-1996
• ANSI/TIA/EIA 3700-1999: Telephone Network Transmission
Model for Evaluating Analog Modem Performance
• ANSI/TIA/EIA 793 -2000: North American Telephone Network
Transmission Model for Evaluating Analog Client and Digitally
Connected Server Modems
• ANSI/TIA 876 – 2002: North American Network Access
Transmission Model for Evaluating xDSL Modem Performance
Network Model Coverage (NMC) Methodology
• Waterfall Curves
– Traditional method of measuring modem performance
– Error rate measured against single impairments such as Gaussian noise
– Severe stress conditions
• Network Model Coverage (NMC)
– Introduced by TR30.3 in TIA/EIA-1992 TSB37
– Network Model is a portrait of the real network
– Statistically based Network Model -- Likelihood of Occurrence (LOO) of a given
connection
– Modem performance evaluated using a Impairment Combinations and Local
Loop Combinations
– Curve showing Percentage of Network Model Vs Throughput
• Estimates percentage of network of the real network over which the modem can be
expected to operate
– Compare performance of different models or manufactures of modems
– Network Model is independent of modem technology
Converged IP Telephony Network is Very
Complex and has Many Impairments
Signaling Path
Network Topologies that need be considered when
testing Audio Quality over a Converged Network
Network Model for Evaluating Multimedia
Transmission Performance -- PN-3-0062
Converged Network Reference Model Diagram
TE
A Telco D
Gateway
Switch
L
IP Network
L
Gateway
TIA-793 Network
Model
D
Telco A
Switch
TE
TIA-793 Network
Model
R,G,S*
Gateway
L
L
R,G,S*
R,G,S*
Gateway
PN-3-0062 (TIA/EIA-921) Network Model will focus on
Transmission Performance Over Internet Protocol
Parameters and Impairments that Affect
Voice Quality
•
•
•
•
•
•
•
•
•
•
•
Network Architecture
Types of Access Links
QoS controlled Edge Routing
Voice coding algorithm
A/D and D/A Conversion
MTU Size
Signaling protocol mismatches
Network faults
Link Failure
•
•
•
•
•
•
•
Echo
Out of order packets
Noise – Circuit and External
Packet Loss (Frame Loss)
One Way Delay (Latency)
Variable Delays (Jitter)
Background Traffic
(Congestion, Bandwidth,
Utilization, Network Load,
Load Sharing)
Time Drift
Route Flapping
ITU G.113 defines the transmission impairments and their impact on voice quality
Sources of IP Network Impairments
IP Network Model
Source
Device A
LAN A
Local Access
B
Local Access
A
64 kbit/s
*128 kbit/s
256 kbit/s
1000BaseX
*384 kbit/s
* 100BaseT Switch
512 kbit/s
100BaseT Hub
*768 kbit/s
10BaseT
*T1 (1.536 kbit/s)
* WLAN (~4 Mbit/s) E1 (1.920 kbit/s)
---------------------E3 (34 Mbit/s)
Occupancy level
*T3 (44 Mbit/s)
Packet loss
ADSL (~256 kbit/s)
*Cable (~256 kbit/s)
Fiber (1-10 Gbit/s)
-------------------Occupancy level
QoS edge router
Core IP Network
Route flapping
One-way delay
Jitter
Packet loss
64 kbit/s
*128 kbit/s
256 kbit/s
*384 kbit/s
512 kbit/s
*768 kbit/s
*T1 (1.536 kbit/s)
E1 (1.920 kbit/s)
E3 (34 Mbit/s)
*T3 (44 Mbit/s)
ADSL (~2 Mbit/s)
*Cable (~3 Mbit/s)
Fiber (1-10 Gbit/s)
-------------------Occupancy level
QoS edge router
* Case used in impairment tables
LAN B
1000BaseX
* 100BaseT Switch
100BaseT Hub
10BaseT
* WLAN (~4 Mbit/s)
---------------------Occupancy level
Packet loss
Destination
Device B
Example of Test Profile with Fixed
Values of Network Impairments
Impairment Type
Units
Range
Jitter
ms
+/- 75
One Way Latency
ms
50 to 150
Sequential Packet Loss
#sequential packets losses
0 to 3
Rate of Sequential Loss
sec-1
< 10-3*
Random Packet Loss
%
0 to 2
Out of Sequence Packets
%
0 to 10-1**
• Network Impairments Conditions could be based on set of
impairment combination that have fixed values
– Stress IP Network Device
• Impairments on a real IP Network are not fixed
Packet Delay
Example of Test Profile with Time
Variable Network Impairments
Time
Time Varying Statistically Based IP
Network Impairment Conditions (ICs)
IC1
LOO X%
IC2
LOO X%
IC100
LOO X%
Time
• Each Impairment Condition is assigned a Likely-hood of
Occurrence (LOO) based on real IP Network Statistics, Network
Architecture, Classes of Service
• The goal is to have approximately 100 test combinations so that
an automated run of the test suite completes in less than a day.
Test Profiles Based on QoS Classes
Test Profiles
QoS Class
(Y.1541)
Applications (Examples)
Node Mechanisms
A
(VoIP, MoIP,
FoIP, ToIP)
0
Real-Time, loss sensitive, Jitter
sensitive, high interaction (VoIP, VTC)
B
(VoIP, MoIP,
FoIP, ToIP)
1
Real-Time, Jitter sensitive, interactive
(VoIP, VTC).
C
(FoIP only)
2
Transaction Data, Highly Interactive
(Signaling)
3
Transaction Data, Interactive
4
Low Loss Only (Short Transactions,
Bulk Data, Video Streaming)
Long Queue, Drop priority
Any route/path
5
Traditional Applications of Default IP
Networks
Separate Queue (lowest priority)
Any route/path
Strict QoS. Guaranteed no over
subscription on links.
Separate Queue with preferential
servicing, Traffic grooming
Network Techniques
Constrained Routing and Distance
Less constrained Routing and
Distances
Constrained Routing and Distance
Separate Queue, Drop priority
Less constrained Routing and
Distances
• Statistically based models can be created for different
QoS Classes
Service Test profile A
Impairment Type
Units
Range
Jitter
ms
+/- 50
One Way Latency
ms
50 to 100
Sequential Packet Loss
#sequential
packets
Random loss only
Rate of Sequential Loss
sec-1
Random Packet Loss
%
0 to 10-3*
Out of Sequence Packets
%
0 to 10-1**
*One
Packet loss out 100,000 packets
** 1 Out of Sequence Packet per 1000
Service Test profile B
Impairment Type
Units
Range
Jitter
ms
+/- 75
One Way Latency
ms
50 to 150
Sequential Packet Loss
#seque
ntial
packets
0 to 3
Rate of Sequential Loss
sec-1
< 10-3*
Random Packet Loss
%
0 to 2
Out of Sequence Packets
%
0 to 10-1**
* Sequential Packet Loss occurs 1 every 1000 seconds
** 1 Out of Sequence Packet per 1000
Service Test profile C
Impairment Type
Units
Range
Jitter
ms
+/- 300
One Way Latency
ms
200 to 500
Sequential Packet Loss
#sequenti
al packets
0 to 500
Rate of Sequential Loss
sec-1
< 10-1*
Random Packet Loss
%
0 to 10
Out of Sequence Packets
%
0 to 10
* Sequential Packet Loss occurs 1 every 10 seconds
Core Network Impairment Severity
Levels
Impairment
Route flapping
LOO (%)
rate (s)
Jitter (ms)
Delay
(ms)
∆ delay
(ms)
σ
Mean
Packet loss
%
Severity A
(hardest)
5
100
200
300
0.10
Severity B
15
200
100
100
0.05
Severity C
30
500
50
50
0.02
Severity D
(easiest)
50
∞
0
20
50
0.01
5
LAN Impairment Severity Levels
LOO (%)
Occupancy % time
Occupancy % capacity
Duplex Mismatch
Severity A
(hardest)
5
20
60
yes
Severity B
15
15
40
yes
Severity C
30
10
20
no
Severity D
(easiest)
50
5
10
no
Access Link Severity Levels
LOO (%)
Occupancy % time
Occupancy % capacity
QoS edge router
Severity A
(hardest)
5
60
100
off
Severity B
15
25
40
off
Severity C
30
10
20
on
Severity D
(easiest)
50
5
10
on
Rationale for Access and LAN Rate
Combinations
LAN rate (Mbit/s)
Access link type(s)
Access
rate
(kbit/s)
Home,
Busines
s
Home,
Busines
s
Busines
s
Busines
s
4
10
100
1000
ISDN, ADSL lite
128
M
H
0
0
Frac. T-1, ADSL lite, cable
upstream
256
H
M
0
0
Fractional T-1
384
L
L
L
0
Fractional T-1, ADSL
768
L
L
M
0
T-1, ADSL
1536
M
H
H
0
Cable modem downstream
3000
H
H
0
0
44000
0
0
H
H
T-3
Likelihood of occurrence: H = high, M = medium, L = low, 0 = very low
Impairment Severity Combinations
(Service Test Profile A)
LOO (%)
LAN A
(Origin
)
Access A
(Origin)
Core
Network
Access B
(Dest.)
LAN B
(Dest.)
Severity A
(hardest)
5
C
C
A
C
C
Severity B
15
C
C
B
C
C
Severity C
30
D
D
C
D
D
Severity D
(easiest)
50
D
D
D
D
D
Impairment Severity Combinations
(Service Test Profile B)
LOO (%)
LAN A
(Origin
)
Access A
(Origin)
Core
Network
Access B
(Dest.)
LAN B
(Dest.)
Severity A
(hardest)
5
C
C
A
C
C
Severity B
15
C
C
B
C
C
Severity C
30
D
D
C
D
D
Severity D
(easiest)
50
D
D
D
D
D
Impairment Severity Combinations
(Service Test Profile C)
LOO (%)
LAN A
(Origin
)
Access A
(Origin)
Core
Network
Access B
(Dest.)
LAN B
(Dest.)
Severity A
(hardest)
5
C
C
A
C
C
Severity B
15
C
C
B
C
C
Severity C
30
D
D
C
D
D
Severity D
(easiest)
50
D
D
D
D
D
Data Rates for Home -> Home
Direction
Home -> Home Rate Combinations
LAN Rates: Origin, Destination
(Mbit/s)
Access Rates (kbit/s)
Lab
el
Origin (A)
Dest (B)
4, 4
4, 10
10, 4
10, 10
HH1
128
128
HH100
HH101
HH110
HH111
HH2
128
768
HH200
HH201
HH210
HH211
HH3
128
3000
HH300
HH301
HH310
HH311
HH4
256
128
HH400
HH401
HH410
HH411
HH5
256
768
HH500
HH501
HH510
HH511
HH6
256
3000
HH600
HH601
HH610
HH611
Data Rates for Home -> Business
Direction
Home -> Business Rate Combinations
Access Rates (kbit/s)
Labe
l
Origin (A)
LAN Rates: Origin, Destination (Mbit/s)
Dest (B)
4, 4
4, 100
4, 1000
10, 4
10, 100
10, 1000
HB1
128
1536
HB100
HB102
HB103
HB110
HB112
HB113
HB2
128
44000
HB200
HB202
HB203
HB210
HB212
HB213
HB3
256
1536
HB300
HB302
HB303
HB211
HB312
HB313
HB4
256
44000
HB400
HB402
HB403
HB212
HB412
HB413
Data Rates for Business -> Home
Direction
Business -> Home Rate Combinations
Access Rates (kbit/s)
Labe
l
Origin (A)
LAN Rates: Origin, Destination (Mbit/s)
Dest (B)
4, 4
4, 10
100, 4
100, 10
1000, 4
1000, 10
BH1
1536
128
BH100
BH101
BH120
BH121
BH130
BH131
BH2
1536
768
BH200
BH201
BH220
BH221
BH230
BH231
BH3
1536
3000
BH300
BH301
BH320
BH321
BH330
BH331
BH4
44000
128
BH400
BH401
BH420
BH421
BH430
BH431
BH5
44000
768
BH500
BH501
BH520
BH521
BH530
BH531
BH6
44000
3000
BH600
BH601
BH620
BH621
BH630
BH631
Data Rates for Business - Business
Business -> Business Rate Combinations
Access Rates (kbit/s)
Label
Origin
(A)
Dest.
(B)
LAN Rates: Origin, Destination (Mbit/s)
4, 4
4, 100
4, 1000
100, 4
100,
100
100,
1000
1000, 4
1000,
100
1000, 1000
BB1
1536
1536
BB100
BB102
BB103
BB120
BB122
BB123
BB130
BB132
BB133
BB2
1536
44000
BB200
BB202
BB203
BB220
BB222
BB223
BB230
BB232
BB233
BB3
44000
1536
BB300
BB302
BB303
BB320
BB322
BB323
BB330
BB332
BB333
BB4
44000
44000
BB400
BB402
BB403
BB420
BB422
BB423
BB430
BB432
BB433
Example Impairment Combination Table
LOO % (calculated)
Combined Impairment
Severity
Data Rate Label
Rate
(Mbit/s)
LAN A
Severity
Rate
(kbit/s)
Access A
Severity
Core Network
Severity
Rate
(kbit/s)
Access B
Severity
Rate
(Mbit/s)
LAN B
Severity
Impairment Level
Units
Jitter
Constant
ms
Transient
Short-term
One-way latency
ms
Packet loss
Sequential
# packets
Rate
sec-1
Random
%
Out of sequence
%
Burst loss
%
Burst length
ms
Gap loss
%
Gap length
ms
R LQ
R CQ
HB302D
HB302C
HB302B
HB302A
D
HB302
C
HB302
B
HB302
A
HB302
4
4
4
4
256
256
256
256
1536
1536
1536
1536
100
100
100
100
Approximately
500 test per
Service Class
Profile
PN-3-0062 Simulator/Emulator
Example of Network Model Coverage
(NMC) Curve
QoS, PESQ, PSQM, MOS, Throughput, Connect Rate, etc.
Parameter X Vs Network Model Coverage Percentage
Device A
Device B
Device C
0
0
10
20
30
40
50
60
70
Percentage of Network Coverage
80
90
100
Examples of Communication Equipment that
can be tested over the Converged Network
Model
• IP Network Devices such as User Agents, Call Agents,
•
•
•
•
•
•
Media Servers, Media Gateway Controllers,
Gatekeepers, Application Servers, Edge Routers,
Gateways, IP Phones, IAF (Internet Aware Fax)
Plain Old Telephone Service (POTS) and IP telephones
Voice-over-IP (VoIP) gateways
T.38 facsimile devices and gateways
V.150.1 and voiceband data (VBD) modem-over-IP
gateways
TIA-1001 (and V.toip) textphone-over-IP gateways
PSTN Video H320 and H324
Value of Converged Network Model
• Predicts product performance under statistically base network
conditions
•
•
•
•
Finds design weaknesses
Find compatibility issues between network equipment
Facilitates isolating and resolving field problems
Assists in evaluating different technologies
Target Audience for Converged Network
Model
•
•
•
•
•
•
Operating Companies
Service Providers
Manufacturers
Design Engineers
Test houses
Magazines and product reviewers
Discussion
•
•
•
Comments, Suggestions and Recommendations
Input for Network Model
– IP Network Statistics
– Network Architecture
– Test Scenarios
Invited to participate in TR30.3