Transcript 11-15-0789
July 2015 doc.: IEEE 802.11-15/0789r1 Proposed changes to Evaluation Methodologies Date: 2015-07-13 Authors: Name Affiliations Address Phone email Allan Jones Activision (310) 2552000 allan.jones@ activision.com Malcolm Dowse Activision (Demonware) +353 1 247 6700 [email protected] Pat Griffith Activision 3100 Ocean Park Blvd., Santa Monica, CA 90405 King’s Inn House, Parnell St Dublin 1, Ireland 3100 Ocean Park Blvd., Santa Monica, CA 90405 (310) 2552000 [email protected] Yingpei Lin Huawei [email protected] Phillip Barber Huawei pbarber@broadbandmobiletech .com Submission Slide 1 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Abstract The purpose of this presentation is to provide details around suggested changes to the Evaluation Methodologies document (IEEE 802.11-14/0571r9[1]) in Appendix 2 – Traffic model descriptions for the Gaming Traffic Model. These suggested changes will reflect a better model based on the traffic observation of modern FPS games detailed in the FPS Network Traffic Model submission (IEEE 802.11-15/0061r6) Submission Slide 2 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Proposed Changes to Evaluation Methodologies Original Distribution proposal from IEEE 802.11-14/0595r0 Distribution Parameters Component Initial packet arrival (ms) PDF DL UL DL UL Uniform Uniform a=0, b=40 a=0, b=40 f ( x) 1 a xb ba 1 xa b f ( x) e b e e , b 0 b X a b ln( ln Y ) xa Packet arrival time (ms) Largest Extreme Value Largest Extreme Value a=50, b=4.5 a=40, b=6 Y U (0,1) 1 x b a e b f ( x) e e ,b0 b X a b ln( ln Y ) 22* x a Packet size (Byte) Submission Largest Extreme Value Largest Extreme Value a=330, b=82 a=45, b=5.7 Y U (0,1) Slide 3 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Proposed Changes to Evaluation Methodologies Current Model vs. Observed Distributions (Uplink Arrival) 7.00E-02 FPS3 uplink Packet Arrival Interval 6.00E-02 5.00E-02 4.00E-02 p d f 3.00E-02 FPS3 Observed Original LEV 2.00E-02 1.00E-02 2 8 14 20 26 32 38 44 50 56 62 68 74 80 86 92 98 104 110 116 122 128 134 140 146 152 158 164 170 176 182 188 194 200 0.00E+00 ms Submission Slide 4 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Proposed Changes to Evaluation Methodologies Current Model vs. Observed Distributions (Uplink Framelength) 0.09 FPS3 Uplink Packet Size 0.08 0.07 0.06 p 0.05 d f 0.04 FPS3 Observed Original LEV 0.03 0.02 0.01 7 28 49 70 91 112 133 154 175 196 217 238 259 280 301 322 343 364 385 406 427 448 469 490 511 532 553 574 595 616 637 658 679 700 0 bytes Submission Slide 5 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Proposed Changes to Evaluation Methodologies Current Model vs. Observed Distributions (Downlink Arrival) 0.25 FPS3 Downlink Packet Arrival Interval 0.2 0.15 p d f FPS3 Observed Original LEV 0.1 0.05 1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 58 61 64 67 70 73 76 79 82 85 88 91 94 97 100 0 ms Submission Slide 6 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Proposed Changes to Evaluation Methodologies Current Model vs. Observed Distributions (Downlink Framelength) 0.009 FPS3 Downlink Packet Size 0.008 0.007 0.006 p 0.005 d f 0.004 FPS3 Observed Original LEV 0.003 0.002 0.001 10 40 70 100 130 160 190 220 250 280 310 340 370 400 430 460 490 520 550 580 610 640 670 700 730 760 790 820 850 880 910 940 970 1000 0 bytes Submission Slide 7 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Proposed Changes to Evaluation Methodologies Suggested changes to the table Distribution Parameters Component Initial packet arrival (ms) PDF DL UL DL UL Uniform Uniform a=0, b=20 a=0, b=20 f ( x) 1 a xb ba 1 xa b f ( x) e b e e , b 0 b X a b ln( ln Y ) xa Packet arrival time (ms) Largest Extreme Value Largest Extreme Value a=15, b=7 a=23.5, b=10.5 Y U (0,1) 1 x b a e b f ( x) e e ,b0 b X a b ln( ln Y ) 22* x a Packet size (Byte) Submission Largest Extreme Value Largest Extreme Value a=390 b=89 a=158, b=26.2 Y U (0,1) Slide 8 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Proposed Changes to Evaluation Methodologies Proposed Model vs. Observed Distributions (Uplink Arrival) 4.00E-02 FPS3 Uplink Packet Arrival Interval 3.50E-02 3.00E-02 2.50E-02 p d 2.00E-02 f FPS3 Observed Proposed LEV 1.50E-02 1.00E-02 5.00E-03 2 8 14 20 26 32 38 44 50 56 62 68 74 80 86 92 98 104 110 116 122 128 134 140 146 152 158 164 170 176 182 188 194 200 0.00E+00 ms Submission Slide 9 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Proposed Changes to Evaluation Methodologies Current Model vs. Observed Distributions (Uplink Framelength) 0.025 FPS3 Uplink Packt Size 0.02 0.015 p d f FPS3 Observed 0.01 Proposed LEV 0.005 7 28 49 70 91 112 133 154 175 196 217 238 259 280 301 322 343 364 385 406 427 448 469 490 511 532 553 574 595 616 637 658 679 700 0 bytes Submission Slide 10 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Proposed Changes to Evaluation Methodologies Proposed Model vs. Observed Distributions (Downlink Arrival) 0.25 FPS3 Downlink Packet Arrival Interval 0.2 0.15 p d f FPS3 Observed Proposed LEV 0.1 0.05 1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 58 61 64 67 70 73 76 79 82 85 88 91 94 97 100 0 ms Submission Slide 11 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Proposed Changes to Evaluation Methodologies Proposed Model vs. Observed Distributions (Downlink Framelength) 0.09 0.08 0.07 0.06 P 0.05 d f 0.04 FPS3 Observed Proposed LEV 0.03 0.02 0.01 10 40 70 100 130 160 190 220 250 280 310 340 370 400 430 460 490 520 550 580 610 640 670 700 730 760 790 820 850 880 910 940 970 1000 0 bytes Submission Slide 12 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Proposed Changes to Evaluation Methodologies Strawpoll: Do you agree to change the parameters in Appendix 2 Gaming Traffic Model of the Evaluation Methodologies document (IEEE 802.11-14/0571r9) as: Yes: No: Abstain: Component Parameters Parameters DL UL DL UL Initial packet Uniform Uniform Uniform Uniform arrival (ms) a=0, a=0, b=20 b=20 a=0, a=0, b=20 b=20 Largest Largest Packet arrival Extreme Extreme time (ms) Value Value Largest Largest Extreme Extreme Value Value a=15, a=15, b=7 b=7 a=23.5, a=23.5, b=10.5 b=10.5 Largest Largest Extreme Extreme Value Value Largest Largest Extreme Extreme Value Value a=390 a=362 b=89 b=129 a=158, a=158, b=26.2 b=26.2 Packet size (Byte) Submission Distribution Distribution DL UL DL UL Slide 13 PDF PDF Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 Proposed Changes to Evaluation Methodologies Motion: Do you agree to change the parameters in Appendix 2 Gaming Traffic Model of the Evaluation Methodologies document (IEEE 802.11-14/0571r9) as: Yes: No: Component Distribution Parameters DL UL DL UL Uniform Uniform a=0, b=20 a=0, b=20 Largest Packet arrival Extreme time (ms) Value Largest Extreme Value a=15, b=7 a=23.5, b=10.5 Largest Extreme Value Largest Extreme Value a=390 b=89 a=158, b=26.2 Initial packet arrival (ms) PDF Abstain: Packet size (Byte) Submission Slide 14 Allan Jones, Activision July 2015 doc.: IEEE 802.11-15/0789r1 References [1] 802.11ax Evaluation methodology - IEEE 802.11-14/0571r9 802.11/dcn/14/11-14-0571-08-00axevaluation-methodology [2] FPS Network Traffic Model - IEEE 802.11-15/0061r6 802.11/dcn/15/11-15-0061-06-00ax-fpsnetwork-traffic-model [3] Edits on Some Traffic Content for HEW SG Simulation Scenarios - IEEE 802.11-14/0595r0 802.11/dcn/14/11-14-0595-00-00ax-edits-on-some-traffic-content-for-hew-sg-simulation-scenarios Submission Slide 15 Allan Jones, Activision