Transcript 31108014-hmm cluster analysis

Telecommunications Industry Association
Telecon
August 16, 2011
TR-30.3/11-08-014
Document Cover Sheet
Project Number
PN-3-0062-RV2
Document Title
HMM Cluster Analysis
Source
Alcatel-Lucent
Contact
Les J. Wu
Phone: 908-582-4964
Alcatel-Lucent
Fax: 908-582-4964
Email: [email protected]
600 Mountain Avenue
Room 2b-219
Murray Hill, NJ 07974
Distribution
Intended Purpose
of Document
(Select one)
TR-30.3
X
For Incorporation Into TIA Publication
For Information
Other (describe) -
The document to which this cover statement is attached is submitted to a Formulating Group or
sub-element thereof of the Telecommunications Industry Association (TIA) in accordance with the
provisions of Sections 6.4.1–6.4.6 inclusive of the TIA Engineering Manual dated October 2009, all
of which provisions are hereby incorporated by reference.
Abstract
Comparison of Markov Model Extraction and Cluster Analysis between TIA-921B test cases and TIA SG-12
packet loss on IPTV pcap files from TIA-921B.
1
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
HMM Cluster Analysis
Les J. Wu
August 2011
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
G1050 Examples
(Counter results from Telchemy vqcapture alpha)
3
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
4
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
Loss Generation
TGT="SD_cbr"
TGT="HD_cbr"
# 4 state default
tpkloss -m 4 -s 2000 -e 500 -pba 0.3 -pbc 0.02 -g 0.05 -b 0.3 -i $TGT.pcap –o $TGT.def.pcap
# 4 state custom
tpkloss -m 4 -s 2000 -e 500 -pba 0.3 -pbc 0.02 -pdc 0.4 -pcd 0.02 -pcb 0.5 -g 0.05 -b 0.3 -i $ TGT.pcap -o $ TGT.cus.pcap
# 1-7% loss in .5% steps
for loss in 10 15 20 25 30 35 40 45 50 55 60 65 70
do
echo "Processing $loss"
tpkloss -loss_ratio 0.0$loss -gap_ratio 0.7 -i $ TGT.pcap -o $ TGT.$loss.pcap
done
5
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
Pairwise P-Plot
TIA-921 Model
tpkloss
6
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
Probability Comparison
TIA-921 Model
tpkloss
7
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
HMM Probabilities and Component Comparison (1)
TIA-921 Model
tpkloss
8
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
HMM Probabilities and Component Comparison (2)
TIA-921 Model
tpkloss
9
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
Model Comparison
10
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
Backup
11
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
R Commands
Save Me as hmm.csv:
> hmm<-read.csv("hmm.csv")
case
Dw1
Dw2
Dw3
Dw4
Dw5
Dw6
Dw7
Dw8
Gw1
Gw2
Gw3
Gw4
Gw5
Gw6
Gw7
Gw8
Dw3
Gw3
Dp1
Dp2
Dp3
Dp4
Dp6
Dw2
Dw4
Dw5
Dw6
Dw7
Gp1
Gp2
Gp3
Gp4
Gp6
Gw2
Gw4
Gw5
Gw6
Gw7
Dp1
Dp2
Dp3
Dp4
Dp5
Dp6
Dw4
Dw6
Dw7
Gp1
Gp2
Gp3
Gp4
Gp5
Gp6
Gw4
> vec<-c("red", "red", "blue", "blue", "green", "green")
> class<-unclass(hmm$file)
> class2<-unclass(hmm$codec)
> vec2=c("blue", "red", "green")
> class
> class2
> pairs(na.omit(hmm[10:16]), pch=21, bg=vec[class])
> pairs(na.omit(hmm[17:20]), pch=21, bg=vec[class])
> hmm.prc<-princomp(na.omit(hmm[,10:16]))
> summary(hmm.prc, loadings=TRUE)
> pairs(hmm.prc$scores, pch=21, bg=vec[class])
> hmm.prc<-princomp(na.omit(hmm[,18:20]))
> summary(hmm.prc, loadings=TRUE)
> pairs(hmm.prc$scores, pch=21, bg=vec[class])
> plot(hmm.prc$scores[,1:2], pch=21, bg=vec2[class2],main="r-video b-audio")
> plot(hmm.prc$scores[,1:2], pch=21, bg=vec[class],main="r-HD b-SD")
> plot(hmm.prc$scores[,1:2], pch=21, bg=vec[class])
> text(hmm.prc$scores[,1:2], labels=class, pos=4)
> vec<-c("red", "red", "blue", "blue", "green", "green")
> pairs(hmm.prc$scores, pch=21, bg=vec[unclass(hmm$file)])
file
codec
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV1_Down
audio
HDTV2_Down
audio
HDTV2_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV1_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
SDTV2_Down
audio
c11
86939
86965
86960
86943
86829
86848
86842
86790
86979
86977
86973
86970
86968
86964
86962
86957
100179
100186
12807
12769
12754
12021
12047
12804
12793
12734
12761
12737
12808
12808
12807
12807
12804
12808
12807
12807
12806
12806
17898
17875
17806
16954
17351
17062
17895
17839
17803
17899
17898
17897
17897
17890
17893
17897
12
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
c13
c14
105
117
90
100
121
117
117
126
168
168
168
168
168
167
168
168
2
2
144
155
191
172
163
169
156
178
175
174
124
124
124
124
124
124
124
124
124
124
156
141
141
163
153
162
150
147
145
156
156
156
156
140
156
156
c22
22
18
22
32
92
89
90
103
0
0
0
0
0
3
0
1
7
0
83
18
27
72
69
20
73
38
26
7
24
24
24
24
24
24
24
24
24
24
15
31
30
109
116
107
19
24
28
15
15
15
15
21
15
15
c23
27
5
0
15
50
33
32
63
0
0
0
0
0
0
0
0
0
0
0
25
45
641
607
0
12
63
31
55
0
0
0
0
0
0
0
0
0
0
0
8
68
717
362
616
0
29
59
0
0
0
0
4
0
0
c33
2
1
0
2
7
7
5
7
0
0
0
0
0
0
0
0
0
0
0
5
4
83
82
0
2
7
4
7
0
0
0
0
0
0
0
0
0
0
0
2
7
86
59
81
0
5
9
0
0
0
0
2
0
0
661
648
678
655
646
649
653
646
609
609
609
609
609
609
609
609
2
2
899
961
911
930
942
940
896
912
934
951
977
977
977
977
977
977
977
977
977
977
775
786
790
811
800
797
778
797
796
774
774
774
774
784
774
774
p11
p13
p31
p32
p33
p22
0.99879 0.00121 0.13672 0.0026 0.86068 0.93103
0.99866 0.00134 0.15274 0.00131 0.84595 0.83333
0.99897 0.00103 0.11719
0 0.88281 NA
0.99885 0.00115 0.1321 0.00264 0.86526 0.88235
0.99861 0.00139 0.15633 0.00904 0.83463 0.87719
0.99865 0.00135 0.15136 0.00906 0.83959
0.825
0.99865 0.00135 0.15097 0.00645 0.84258 0.86486
0.99855 0.00145 0.16175 0.00899 0.82927
0.9
0.99807 0.00193 0.21622
0 0.78378 NA
0.99807 0.00193 0.21622
0 0.78378 NA
0.99807 0.00193 0.21622
0 0.78378 NA
0.99807 0.00193 0.21622
0 0.78378 NA
0.99807 0.00193 0.21622
0 0.78378 NA
0.99808 0.00192 0.21521
0 0.78479 NA
0.99807 0.00193 0.21622
0 0.78378 NA
0.99807 0.00193 0.21622
0 0.78378 NA
0.99998 0.00002
0.5
0
0.5 NA
0.99998 0.00002
0.5
0
0.5 NA
0.98888 0.01112 0.13806
0 0.86194 NA
0.98801 0.01199 0.13827 0.00446 0.85727 0.83333
0.98525 0.01475 0.17269 0.00362 0.82369 0.91837
0.98589 0.01411 0.14515 0.07004 0.78481 0.88536
0.98665 0.01335 0.13732 0.06908 0.7936 0.88099
0.98697 0.01303 0.15239
0 0.84761 NA
0.98795 0.01205 0.14801 0.0019 0.85009 0.85714
0.98621 0.01379 0.16226 0.00638 0.83136
0.9
0.98647 0.01353 0.15723 0.00359 0.83917 0.88571
0.98652 0.01348 0.15371 0.00618 0.84011 0.8871
0.99041 0.00959 0.11262
0 0.88738 NA
0.99041 0.00959 0.11262
0 0.88738 NA
0.99041 0.00959 0.11262
0 0.88738 NA
0.99041 0.00959 0.11262
0 0.88738 NA
0.99041 0.00959 0.11262
0 0.88738 NA
0.99041 0.00959 0.11262
0 0.88738 NA
0.99041 0.00959 0.11262
0 0.88738 NA
0.99041 0.00959 0.11262
0 0.88738 NA
0.99041 0.00959 0.11262
0 0.88738 NA
0.99041 0.00959 0.11262
0 0.88738 NA
0.99136 0.00864 0.16756
0 0.83244 NA
0.99217 0.00783 0.15178 0.00215 0.84607
0.8
0.99214 0.00786 0.15032 0.00746 0.84222 0.90667
0.99048 0.00952 0.15377 0.08113 0.76509 0.8929
0.99126 0.00874 0.15119 0.0583 0.79051 0.85986
0.99059 0.00941 0.15577 0.07788 0.76635 0.88379
0.99169 0.00831 0.16164
0 0.83836 NA
0.99183 0.00817 0.1549 0.00527 0.83983 0.85294
0.99192 0.00808 0.15263 0.00947 0.83789 0.86765
0.99136 0.00864 0.16774
0 0.83226 NA
0.99136 0.00864 0.16774
0 0.83226 NA
0.99136 0.00864 0.16774
0 0.83226 NA
0.99136 0.00864 0.16774
0 0.83226 NA
0.99224 0.00776 0.15119 0.00216 0.84665 0.66667
0.99136 0.00864 0.16774
0 0.83226 NA
0.99136 0.00864 0.16774
0 0.83226 NA
TPKLOSS Model Data
Save Me as sg12.csv:
case
1
1
1.5
1.5
2
2
2.5
2.5
3
3
3.5
3.5
4
4
4.5
4.5
5
5
5.5
5.5
6
6
6.5
6.5
7
7
1
1
1.5
1.5
2
2
2.5
2.5
3
3
3.5
3.5
4
4
4.5
4.5
5
5
5.5
5.5
6
6
filename
SD_cbr.10
SD_cbr.10
SD_cbr.15
SD_cbr.15
SD_cbr.20
SD_cbr.20
SD_cbr.25
SD_cbr.25
SD_cbr.30
SD_cbr.30
SD_cbr.35
SD_cbr.35
SD_cbr.40
SD_cbr.40
SD_cbr.45
SD_cbr.45
SD_cbr.50
SD_cbr.50
SD_cbr.55
SD_cbr.55
SD_cbr.60
SD_cbr.60
SD_cbr.65
SD_cbr.65
SD_cbr.70
SD_cbr.70
SD_cbr.cus
SD_cbr.cus
SD_cbr.def
SD_cbr.def
SD_cbr.out
SD_cbr.out
HD_cbr.10
HD_cbr.10
HD_cbr.15
HD_cbr.15
HD_cbr.20
HD_cbr.20
HD_cbr.25
HD_cbr.25
HD_cbr.30
HD_cbr.30
HD_cbr.35
HD_cbr.35
HD_cbr.40
HD_cbr.40
HD_cbr.45
HD_cbr.45
HD_cbr.50
HD_cbr.50
HD_cbr.55
HD_cbr.55
HD_cbr.60
HD_cbr.60
codec
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
SDv
SDa
HDv
HDa
HDv
HDa
HDv
HDa
HDv
HDa
HDv
HDa
HDv
HDa
HDv
HDa
HDv
HDa
HDv
HDa
HDv
HDa
HDv
HDa
c11
c13
c14
1139247
1335
23252
29
1120130
1808
22838
66
1082650
2324
22143
108
1053271
2565
21772
139
1019370
2802
20934
191
979391
2974
20213
216
937170
3166
19797
235
890657
3211
18958
262
845211
3191
18127
317
806496
3205
17240
321
765127
3188
17792
326
715532
3136
15796
347
665303
3040
15438
355
1075823
2435
22352
99
1049164
2528
21693
139
1020622
2770
21248
170
1127794
1404
40226
61
1106839
1797
39620
113
1074102
2211
38852
164
1042369
2533
37648
252
1006719
2745
37146
277
958750
2931
35443
353
924324
3068
34700
406
864614
3092
33123
455
827925
3105
32064
496
773416
3092
31052
543
742750
3093
30514
557
c22
4
163
2
207
1
259
0
244
1
259
3
268
2
249
0
241
2
214
1
207
1
228
0
172
1
153
0
234
1
255
0
258
1
309
3
347
0
366
0
414
3
433
2
418
2
426
1
419
1
399
3
372
4
381
17599
231
31639
514
61716
1054
85861
1333
113680
2018
148617
2624
184588
2966
225431
3676
264340
4325
296890
5126
335914
4592
376641
6312
421722
6617
70530
902
91226
1412
113849
1745
18797
392
35163
825
62000
1434
87358
2352
117953
2713
159729
4172
188947
4725
242110
6039
272832
6933
321927
7741
347260
8154
c23
c33
300
28
539
73
1039
125
1455
184
2022
263
2590
343
3293
408
4095
506
4851
643
5596
714
6324
672
7266
955
8152
1003
1324
119
1933
186
2001
253
314
54
581
120
1025
190
1484
309
2020
376
2778
575
3376
665
4268
843
4970
991
5895
1144
6518
1225
9828
6
13779
11
19751
20
23817
37
29014
42
32786
45
37886
53
42647
66
47678
82
52541
101
54527
99
60734
127
64835
142
19600
3
24572
24
27631
35
10032
27
13623
44
18636
63
23622
93
27510
124
32872
108
36734
146
42225
189
46645
185
51289
217
55933
238
p11
p13
p31
p32
p33
0.99883 0.00117 0.11646 0.02617 0.85737
0.99875 0.00125 0.46032 0.44444 0.09524
0.99839 0.00161 0.11212 0.03342 0.85446
0.99712 0.00288
0.44 0.48667 0.07333
0.99786 0.00214 0.10055 0.04495
0.8545
0.99515 0.00485 0.42688 0.49407 0.07905
0.99757 0.00243 0.09214 0.05227 0.85559
0.99366 0.00634 0.38611 0.51111 0.10278
0.99726 0.00274 0.08281 0.05976 0.85744
0.99096 0.00904 0.38508 0.53024 0.08468
0.99697 0.00303 0.07755 0.06754 0.85492
0.98943 0.01057 0.35762 0.56788
0.0745
0.99663 0.00337 0.07139 0.07426 0.85435
0.98827 0.01173 0.33764 0.58621 0.07615
0.99641 0.00359 0.06428 0.08198 0.85374
0.98637 0.01363 0.31415 0.60671 0.07914
0.99624 0.00376 0.05727 0.08706 0.85567
0.98281 0.01719 0.30422 0.61708 0.07869
0.99604 0.00396 0.05225 0.09123 0.85653
0.98172 0.01828 0.28257 0.62852 0.08891
0.99585 0.00415 0.04978 0.09875 0.85147
0.98201 0.01799 0.29717 0.61258 0.09025
0.99564 0.00436 0.04408 0.10214 0.85377
0.9785
0.0215 0.24283
0.6683 0.08887
0.99545 0.00455 0.03999 0.10723 0.85279
0.97752 0.02248 0.23667 0.66867 0.09467
0.99774 0.00226 0.10424 0.05668 0.83908
0.99559 0.00441 0.44796 0.53846 0.01357
0.9976
0.0024 0.08707 0.06658 0.84635
0.99363 0.00637 0.39828 0.53295 0.06877
0.99729 0.00271 0.08549 0.06176 0.85276
0.99206 0.00794 0.37118
0.5524 0.07642
0.99876 0.00124 0.11949 0.02672 0.85379
0.99849 0.00151 0.42958 0.38028 0.19014
0.99838 0.00162 0.11231 0.03631 0.85138
0.99716 0.00284 0.40794 0.43321 0.15884
0.99795 0.00205 0.10109 0.04686 0.85205
0.9958
0.0042 0.39329 0.45564 0.15108
0.99758 0.00242 0.09165 0.05369 0.85466
0.99335 0.00665 0.38532 0.47248
0.1422
0.99728 0.00272 0.08505 0.06259 0.85236
0.9926
0.0074
0.3565 0.48391 0.15959
0.99695 0.00305 0.07597
0.072 0.85203
0.99014 0.00986 0.34073 0.55502 0.10425
0.99669 0.00331 0.07105 0.07819 0.85076
0.98844 0.01156 0.33361 0.54643 0.11997
0.99644 0.00356 0.06236 0.08607 0.85157
0.98645 0.01355 0.30599 0.56691
0.1271
0.99626 0.00374 0.05674 0.09083 0.85243
0.98477 0.01523 0.29665
0.5927 0.11065
0.99602 0.00398
0.0513
0.0978
0.8509
0.98281 0.01719 0.28519 0.60084 0.11397
0.99585 0.00415 0.04719 0.09944 0.85337
0.98207 0.01793 0.27574 0.60644 0.11782
13
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
Pairwise P-Plot
TIA-921 Model
tpkloss
14
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
Pairwise Component Plot
TIA-921 Model
tpkloss
15
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION
16
COPYRIGHT © 2011 ALCATEL-LUCENT. ALL RIGHTS RESERVED.
ALCATEL-LUCENT —USE PURSUANT TO COMPANY INSTRUCTION