Transcript SESSION CODE: VOC203 TWITTER HASH TAG: #VOC203 David Connors Managing Director Codify Pty Ltd [email protected] @davidconnors Ben Parker Infrastructure Consultant Codify Pty Ltd [email protected] @parker_ben TECHED BACKSTAGE 2011 WWW.TECHEDBACKSTAGE.NET (c) 2011 Microsoft.

SESSION CODE: VOC203
TWITTER HASH TAG: #VOC203
David Connors
Managing Director
Codify Pty Ltd
[email protected]
@davidconnors
Ben Parker
Infrastructure Consultant
Codify Pty Ltd
[email protected]
@parker_ben
TECHED BACKSTAGE 2011
WWW.TECHEDBACKSTAGE.NET
(c) 2011 Microsoft. All rights reserved.
Agenda
Building a 3000+ person enterprise in 3 weeks
► General Overview: Who are you?
► How’s our driving: Facts and Figures from 2011
► PART 1: TCP/IP Performance and getting your
bucks worth
► PART 2: cloud.auteched.net
– Hardware
– Network services and vlan provisioning
– VMM 2012
(c) 2011 Microsoft. All rights reserved.
Who’s who in the zoo
► Lots of vendors (80?)
► Relevant to this talk:
– JMW = MS global AoR for events
– Jomablue = Logistics & project management for
technology (and nagging)
– Codify = Infrastructure engineering and
propelloryhead bits
(c) 2011 Microsoft. All rights reserved.
Wins
► Keynote
– ~900 concurrent wifi clients + 1-2ms pings back to
GigabitEthernet1-8.cha30.Brisbane.telstra.net at the same
time
► Current wifi peak: 1781 concurrent
► IP transit: Very fast/diverse
► ~200 session VMs provisioned for sessions ondemand
► ~12 private networks provisioned across the
building on-demand for sessions
► 0 network faults (touch melamine)
(c) 2011 Microsoft. All rights reserved.
IP Transit Providers
► Telstra – Premier Sponsor
– Telstra Internet Direct Service
– 1000mbps e-line terminating at Telstra CHA exchange
– IPv4
► Over The Wire – Plan B in case something goes sproing
– Pipe Networks fibre terminating at Pipe DC2
– 500mbps
– IPv4 + IPv6
(c) 2011 Microsoft. All rights reserved.
Wifi
TechEd 2011
Australian Partner
Conference 2011
Thursday Peak
1781 associations
Tuesday Keynote
871 associations
(c) 2011 Microsoft. All rights reserved.
random wifi dissassociations
► 20-40 random disassociations/sec (for < 10ms)
► Resolved just prior to APC with Cisco TAC
(firmware upgrade with no fixes in the release notes O_o)
(c) 2011 Microsoft. All rights reserved.
Other random IP bits
► IPv4 – None left, we are all going to die…
Dear David,
Thank you for your email reply.
There is no IPv4 address space available for temporary allocation.
[ ... blah blah blah ... ]
Kind Regards
Tom Do
Internet Resource Analyst, APNIC
► BGP Routing
aut-num:
as-name:
descr:
descr:
descr:
descr:
descr:
descr:
descr:
country:
AS9984
MICROSOFT-TECHED-AS-AP
Microsoft Tech Ed Australia 2011
for Microsoft Tech Ed conference
http://australia.msteched.com/
Gold Coast Convention and Exhibition Centre
Cnr Gold Coast Highway & T.E. Peters Drive
Broadbeach
Queensland 4218
AU
► IPv6 again – standard operating procedure now
(c) 2011 Microsoft. All rights reserved.
tech•ed 201 1
Microsoft®
Pipe Networks
Single Mode Fibre Service
500mbps
Charlotte St
Telstra Internet Direct
IPv4
Pipe DC2
Over The Wire
IPv4 + IPv6
Gold Coast Convention and Exhibition Centre
Pipe CPE
Telstra E-Line
Single Mode Fibre Service
1 gbps
MDF Design
Version: 4
Last Updated: 21 July 2011 1800
1000BASE-T
Cable: Cat6 from stock
Catalyst 3750 SERIES
1
SYST
RPS
MASTR
STAT
DUPLX
SPEED
STACK
MODE
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
1X
15X 17X
31X 33X
47X
2X
16X 18X
32X 34X
48X
1
3
2
4
Console
Mgmt
Telstra Internet Direct CPE
Cisco 3750G-48TS or equiv.
1
2
1000BASE-T
Cable: Cat6 from stock
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
32
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
Over The Wire CPE
Brocade NI-CER-2048FX-RT-AC
2 gbps LACP Trunk
2 x 1000BASE-T
Cable: Cat 6 Cross Over Patch, 1m, Qty: 2
1000BASE-T, Cable: Cat6 from stock
1000BASE-T, Cable: Cat6 from stock
microsoftevent.localdomain IPv4 NAT
1000BASE-T, Cable: Cat6 from stock
show.localdomain IPv4 NAT
spare
spare
1000BASE-T, Cable: Cat6 from stock
CATALYST 3550
SYSTEM
RPS
1
3
5
7
9
2
4
6
8
10
MODE
11
STAT
UTIL
DUPLX
SPEED
12
core1
2 gbps LACP Trunk
Cable: 50/125m (OM3) Fibre, SC-LC, Len: 5m, Qty: 2
GCCEC
Corporate Network
(patch for wifi)
CATALYST 3550
SYSTEM
RPS
2 gbps LACP Trunk
2 x 1000BASE-T
Cable: Cat 6 Cross Over Patch, 1m, Qty: 2
1
3
5
7
9
2
4
6
8
10
MODE
11
STAT
UTIL
DUPLX
SPEED
12
Cable: 62.5/125m (OM1) Fibre, SC-SC, Len: 5m, Qty: 1
Cable: 62.5/125m (OM1) Fibre, SC-SC, Len: 5m, Qty: 1
Cable: 62.5/125m (OM1) Fibre, SC-SC, Len: 5m, Qty: 1
Cable: 62.5/125m (OM1) Fibre, SC-SC, Len: 5m, Qty: 1
core2
2 gbps LACP Trunk
2 x 1000BASE-T
Cable: Cat 6 Cross Over Patch, 1m, Qty: 2
Cable: 62.5/125m (OM1) Fibre, SC-SC, Len: 5m, Qty: 1
Cable: 62.5/125m (OM1) Fibre, SC-SC, Len: 5m, Qty: 1
Cable: 62.5/125m (OM1) Fibre, SC-SC, Len: 5m, Qty: 1
Cable: 62.5/125m (OM1) Fibre, SC-SC, Len: 5m, Qty: 1
MDF Patch to L1
1
C I S CO
2
3
4
5
1X
SYST
RPS
STAT
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
Catalyst 2960 Series PoE-8
24
11X
13X
23X
12X
14X
24X
1
DUPLX
2X
POWER
MODE
OVER
ETHERNET
Roadcase Distribution Switch
MDF Patch to L3
CATALYST 3550
SYSTEM
RPS
1
3
5
7
9
2
4
6
8
10
MODE
STAT
UTIL
DUPLX
SPEED
CATALYST 3550
SYSTEM
RPS
1
3
5
7
STAT
UTIL
DUPLX
SPEED
11
2
4
6
8
12
12
10
spare
MDF Patch to EH1
core3
11
MDF Patch to L4
9
MODE
2
SPEED
PoE
MDF Patch to L2
Cable: 62.5/125m (OM1) Fibre
SC-SC, Len: 5m, Qty: 1
Cable: 62.5/125m (OM1) Fibre
SC-SC, Len: 5m, Qty: 1
Cable: 50/125m (OM3) Fibre
SC-SC, Len: 5m, Qty: 1
Cable: 50/125m (OM3) Fibre
SC-SC, Len: 5m, Qty: 1
Cable: 62.5/125m (OM1) Fibre
SC-SC, Len: 5m, Qty: 1
MDF Patch to EH2
MDF Patch to EH3
MDF Patch to EH4
MDF Patch to G1
MDF Patch to G2
MDF Patch to G3
MDF Patch to G4
MDF Patch to A1
Cable: 62.5/125 (OM1) Fibre, SC-LC, Len: 5m, Qty: 1
100BASE-TX, Cable: Cat6 from stock
Parts List:
<part>: <use> + <spares> = <total>
Cisco 3550-12G: 3 + 1 = 4
Cisco WS-G5484 MM Fibre GBIC: 16 + 2 = 18
Cisco WS-G5483 Copper GBIC: 13 + 2 = 15
50/125m OM3 Patch Lead, SC / LC Connectors, 5 metres: 2 + 1 = 3
62.5/125m OM1 Patch Lead, SC / SC Connectors, 5 metres: 11 + 2 = 13
50/125m OM3 Patch Lead, SC / SC Connectors, 5 metres: 2 + 1 = 3
Cat 6 Cross Over Patch (for LACP stack trunks), 1 metre: 6 + 4 = 10
High Perf NAT Boxes: 2 + 2 = 4
All copper patch leads assumed to be coming from existing stock.
All Catalyst 2970 switches assumed to be coming from existing stock.
All TID and OTW CPE and SFPs assumed to be coming from them.
4
5
6
7
8
9
10
11
12
13
11X
14
15
16
17
18
19
20
21
22
23
23X
25
26
27
STATUS
RADIO
11
12
13
11X
14
15
16
17
18
19
20
21
22
23
23X
25
26
27
ETHERNET
zA
zA
zA
2 4G
2 4G
2 4G
C.
A.
B.
A
A
A
zA
zA
zA
2 4G
2 4G
2 4G
.
.
.
C.
A.
A
B.
zA
Patch
Port
? to ge
0/3
C.
Tx
NTENN
Rx
Rx
Tx
Rx
Tx
Tx
NTENN
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
NTENN
1
Patch Port ? to ge0/4
CI S C O
CI S C O
ETHERNET
STATUS
RADIO
ETHERNET
STATUS
SERIES
Rx Tx
B.
NTENN
A.
Rx Tx
A
C.
A.
B.
A
A
A
zA
zA
zA
2 4G
C.
A.
B.
A
A
A
zA
zA
zA
2 4G
2 4G
Tx
2 4G
2 4G
.
.
Rx
Tx
NTENN
2 4G
.
.
.
C.
A.
A
B.
B.
A
NTENN
Rx
Tx
C.
B.
NTENN
A.
to
ge
0/
4
A
-
Catalyst 2970
Rx Tx
A
Tx
NTENN
.
Rx
Tx
A
A
Rx
Tx
Rx
A
A
zA
zA
zA
2 4G
2 4G
Rx
.
zA
Tx
.
A
Tx
Tx
NTENN
.
zA
2 4G
2 4G
2 4G
.
.
Rx
.
-
AP18
Rx Tx
NTENN
Rx
Tx
NTENN
2 4G
Pa
tch
Po
rt
?
Rx
Rx
Tx
NTENN
C.
B
C
A
-
NTENNA
.
A.
NTENNA
.
.
Single-mode Fibre
H
A
NTENN
NTENNA
H
No Fibre
Tx
Rx
Tx
NTENN
A
IDF Design
Version: 4
Last Updated: 21 July 2011 1800
?t
og
e0
/2
RADIO
H
62.5/125nm (OM1) Multi-mode
Fibre
STATUS
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
A
NTENN
Rx
zA
Gold Coast Convention and Exhibition Centre
ge
0/
1
CI S C O
ETHERNET
NTENN
Rx
Tx
NTENN
zA
Pa
tch
Po
rt
23 24
Rx
Rx
2 4G
to
Rx Tx
NTENN
NTENN
zA
.
Tx
.
Tx
NTENN
2 4G
Tx
NTENN
2 4G
Po
rt
?
2 .4GHz
A
.
Rx
Tx
Rx Tx
2 .4GHz
A
.
-
AP19
Rx Tx
2 .4GHz
A
.
NTENNA
Rx
-
Tx
-
B
19 20
NTENNA
C
15 16
21 22
Rx
NTENN
Tx
NTENNA
A
-
11 12
17 18
.
B
C
A
Rx Tx
7 8
13 14
Rx Tx
RADIO
.
NTENNA
.
.
.
-
AP36
Rx Tx
3 4
9 10
STATUS
.
NTENNA
H
-
Single-mode Fibre
X
5 6
Rx Tx
CI S C O
ETHERNET
H
RADIO
H
B
C
A
No Fibre
AP3
X
Rx Tx
H
STATUS
In Use In Use
1 2
AP17
GLC-SX-MM
Patch Ports 9&10 to ge0/28 w/
GLC-SX-MM SFP
62.5/125m OM1 patch
min. 2 metres
SC / LC Connectors
PRDSW99
Location: L1 (Signed as FC-01)
3
0/
ge
H
NTENNA
H
.
.
.
62.5/125nm (OM1) Multi-mode
Fibre
H
-
-
2 .4GHz
A
CI S C O
ETHERNET
NTENNA
tech•ed 201 1
NTENNA
Pa
tc
h
2 .4GHz
A
23 24
to
e0/2
to g
2 .4GHz
A
19 20
-
Rx Tx
2 .4GHz
A
15 16
21 22
Rx Tx
2 .4GHz
A
2 .4GHz
A
11 12
17 18
rt ?
?
rt
Po
tch
Pa
B
7 8
13 14
C
NTENNA
-
9 10
-
AP37
Rx Tx
RADIO
H
H
-
3 4
A
NTENNA
STATUS
-
NTENNA
.
CI S C O
ETHERNET
X
5 6
NTENNA
.
X
1 2
NTENNA
.
In Use In Use
h Po
Patc
Rx Tx
RADIO
H
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
rt
Po
tch
Pa
STATUS
H
B
C
A
-
Rx Tx
Rx Tx
CI S C O
ETHERNET
H
.
.
.
Rx Tx
AP50
Rx Tx
2 .4GHz
A
NTENNA
H
-
AP2
GLC-SX-MM
Patch Ports 9&10 to ge0/28 w/
GLC-SX-MM SFP
62.5/125m OM1 patch
min. 2 metres
SC / LC Connectors
PRDSW95
Location: G1 (Signed as GC-01)
/3
e0
og
?t
2 .4GHz
A
NTENNA
H
H
-
Rx Tx
e0/2
to g
-
24X
14X
NTENN
rt ?
-
16X
12X
2X
MODE
2 .4GHz
A
h Po
Patc
RADIO
16X
24X
14X
.
zA
zA
zA
2 4G
2 4G
2 4G
.
.
.
-
16X
12X
MODE
Tx
Rx Tx
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
NTENNA
STATUS
RADIO
NTENNA
NTENN
Rx Tx
CI S C O
ETHERNET
B.
STATUS
NTENNA
B
AP1
A
C.
28
C
16X
2X
Rx Tx
Rx Tx
24
13X
A
Tx
zA
10
Rx
zA
9
Rx
NTENN
zA
8
.
Rx
2 4G
7
.
Rx
2 4G
6
.
-
Rx
2 4G
5
H
.
4
H
-
B
C
A
.
3
H
.
.
.
.
2
STAT
DUPLX
SPEED
NTENNA
H
B
C
A
-
NTENNA
H
.
.
.
-
H
H
H
H
-
Rx Tx
SERIES
CI S C O
1
1X
SYST
RPS
NTENNA
Tx
C.
C.
ETHERNET
28
A
A.
Patch Port ? to ge0/1
24
13X
NTENN
NTENN
A
3
STAT
DUPLX
SPEED
Rx
B.
A.
NTENN
A.
B.
A
A
A
NTENN
NTENN
2
2 .4GHz
A
Catalyst 2970
SERIES
CI S C O
1
1X
SYST
RPS
NTENNA
2 .4GHz
A
A
Rx Tx
2 .4GHz
A
Patch Port ? to ge0/1
RADIO
NTENNA
Microsoft®
Rx Tx
2 .4GHz
A
A
Rx Tx
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
A
Rx Tx
NTENN
Rx Tx
Catalyst 2970
STATUS
NTENN
Rx Tx
CI S C O
ETHERNET
NTENNA
NTENN
Rx Tx
RADIO
2
3
4
5
6
7
8
9
10
11
12
13
11X
1X
14
15
16
17
18
19
20
21
22
23
24
23X
13X
25
26
27
28
SYST
RPS
STAT
DUPLX
SPEED
16X
zA
zA
2 4G
CI S C O
SYST
RPS
ETHERNET
STATUS
RADIO
1
2
3
4
5
6
7
8
9
10
11
12
13
11X
1X
14
15
16
17
18
19
20
21
22
23
23X
25
26
27
NTENN
.
C.
B.
2 4G
2 4G
.
.
C.
A.
A
A
zA
zA
21 22
19 20
-
NTENNA
2 4G
2 4G
2 4G
17 18
.
.
zA
zA
zA
2 4G
2 4G
2 4G
.
.
.
C.
A.
B.
A
A
zA
C.
A.
B.
A
A
C.
zA
zA
zA
2 4G
2 4G
2 4G
Tx
A
A
zA
zA
zA
Tx
NTENN
NTENN
NTENN
Rx
zA
zA
2 4G
Tx
NTENN
A.
B.
A
NTENN
.
.
2 4G
2 4G
.
Rx
.
Rx
Tx
.
Rx
NTENN
2 4G
NTENN
Rx
Tx
2 4G
NTENN
Rx
.
NTENN
Rx
Tx
.
Rx
Tx
2 4G
Rx
Tx
A
Tx
Rx
Tx
Rx
.
Rx
Tx
.
NTENN
Rx
15 16
Tx
13 14
B
11 12
-
-
? to ge
NTENN
Tx
NTENN
Tx
NTENN
C.
A.
B.
A
A
A
zA
zA
zA
zA
zA
2 4G
2 4G
2 4G
.
.
.
.
Rx
Rx
.
Rx
2 4G
2 4G
2 4G
.
.
Rx
Tx
Tx
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
Tx
Tx
Tx
-
-
23X
13X
25
26
27
A.
C.
STATUS
zA
zA
zA
zA
zA
2 4G
2 4G
2 4G
.
.
NTENN
Rx
Rx
Tx
NTENN
Rx
Tx
NTENN
Tx
NTENN
.
Rx Tx
Rx Tx
Rx
Tx
zA
zA
zA
zA
Rx
Tx
Rx
Tx
Rx
.
C.
Rx Tx
B.
-
A.
Tx
zA
C.
A.
B.
A
A
A
zA
zA
zA
2 4G
2 4G
2 4G
C.
B.
A
A
zA
zA
2 4G
2 4G
.
.
C.
19
20
21
22
23
SERIES
24
23X
25
26
27
28
16X
24X
50/125m OM3 patch
min. 2 metres
SC / LC Connectors
X
1 2
X
5 6
3 4
9 10
7 8
11 12
13 14
15 16
17 18
19 20
21 22
23 24
zA
zA
zA
2 4G
2 4G
2 4G
.
.
.
2
3
4
5
6
7
8
9
10
11
12
13
11X
1X
14
15
16
17
18
19
20
21
22
23
/3
ge0
? to
A
A
NTENN
NTENN
RADIO
zA
NTENNA
2 4G
2 4G
2 4G
.
.
.
-
.
Rx
.
Rx
.
B
C
A
Tx
-
NTENNA
H
zA
STATUS
H
H
zA
ETHERNET
NTENNA
Tx
-
Tx
C.
B.
A
A
Rx Tx
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
NTENN
A
Rx Tx
NTENN
A.
AP48
Rx Tx
NTENN
CI S C O
RADIO
zA
NTENNA
2 4G
2 4G
Tx
AP49
.
.
Rx
Rx
.
B
C
A
-
Tx
2 4G
.
.
.
-
NTENNA
H
zA
STATUS
H
H
zA
ETHERNET
NTENNA
Rx
Rx
Tx
NTENN
CI S C O
Rx
Tx
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
AP34
-
rt
Po
o
?t
4
0/
ge
C.
A.
B.
A
A
A
SERIES
24
23X
13X
25
26
27
28
SYST
RPS
16X
12X
24X
14X
zA
zA
zA
2 4G
2 4G
2 4G
zA
zA
2 4G
A.
zA
h
tc
Pa
2 4G
2 4G
Tx
2 4G
2 4G
Rx
.
Rx
.
Tx
2 4G
17
18
19
20
21
22
23
STATUS
RADIO
24
23X
25
26
27
28
NTENNA
NTENNA
.
-
AP47
NTENNA
Rx
.
2 4G
2 4G
Tx
.
C.
A.
A
Tx
-
2
? to ge0/
to
ge
0/
5
2 4G
2 4G
Tx
NTENN
2 4G
Rx
.
Rx
-
.
NTENN
.
B
C
A
-
NTENNA
.
.
.
.
.
.
C.
A.
B.
A
A
A
zA
zA
zA
2 4G
2 4G
2 4G
.
.
.
A.
C.
A
A
B.
zA
zA
NTENNA
H
zA
rt
Po
ch
Pat
RADIO
H
zA
NTENNA
H
2 4G
A
zA
zA
C.
A.
B.
A
A
A
zA
zA
zA
2 4G
2 4G
2 4G
.
.
.
C.
A.
B.
A
A
A
zA
zA
zA
2 4G
2 4G
2 4G
.
.
A
zA
zA
zA
2 4G
2 4G
2 4G
.
.
STATUS
Pa
tch
Po
rt
?
NTENN
.
0/7
C.
B.
A
A
A.
A
C.
B.
A
NTENN
A
NTENN
zA
2 4G
2 4G
NTENN
2 4G
.
.
NTENN
Rx
Tx
C.
? to ge
.
C.
B.
A.
NTENN
Rx
Tx
NTENN
A.
Rx Tx
A
A
A
NTENN
Patch
Port
Rx Tx
Tx
Rx
B.
Pa
tch
Po
?t
rt
og
?t
e0
/5
og
e0
Patc
/4
h Po
rt ?
to g
e0/
6
AP46
Rx Tx
Rx
A
-
NTENN
Pa
tch
Po
rt
Tx
Tx
NTENN
A.
NTENN
Rx
Tx
A
NTENN
Rx
Tx
A
NTENN
Rx
Tx
NTENN
A
rt
Patch Po
NTENNA
Rx
Rx
Tx
NTENN
zA
16
Tx
Rx
zA
Tx
Tx
NTENN
zA
NTENN
Rx
Tx
2 4G
NTENN
Rx
Tx
NTENN
2 4G
15
zA
NTENN
Rx
Tx
2 4G
NTENN
Rx
NTENN
.
14
13X
zA
NTENN
Rx
Tx
.
Rx
.
18
.
zA
zA
zA
2 4G
.
.
C.
B.
NTENN
A.
Tx
.
13
11X
2 4G
Tx
C.
12
2 4G
Rx
Tx
B.
11
STAT
DUPLX
SPEED
-
16X
12X
2X
e0/2
to g
rt
Po
tch
Pa
o
?t
0 /3
ge
GLC-SX-MM
Patch Ports 9&10 to ge0/28 w/
GLC-SX-MM SFP
50/125m OM3 patch
min. 2 metres
SC / LC Connectors
PRDSW93
Location: EH-4 (Signed as FC-05)
In Use In Use In Use
X
1 2
X
3 4
5 6
X
7 8
9 10
11 12
13 14
15 16
17 18
19 20
21 22
-
24X
In Use
X
1 2
3 4
62.5/125nm (OM1) Multi-mode
Fibre
No Fibre
Single-mode Fibre
-
23 24
50/125nm (OM3) Multi-mode Fibre – TODO confirm from Siemens
9F5LB1-12D-Optical Fibre Cable E244435-03 Multimode specs
(Top Patch Panel)
AP33
16X
14X
MODE
PRDSW94
Location: Arena 1 (Arena 1 Biobox)
NTENNA
.
Rx
Tx
A.
C.
C.
A.
B.
A
A
A
zA
zA
zA
2 4G
2 4G
2 4G
.
.
zA
zA
2 4G
zA
zA
Rx
Tx
zA
zA
2 4G
2 4G
2 4G
Tx
2 4G
2 4G
.
Rx
.
Rx
Tx
.
Rx
Tx
A
10
B
A
9
C
-
2 .4GHz
A
A
8
A
Rx Tx
RADIO
NTENNA
2 .4GHz
A
zA
7
.
STATUS
2 .4GHz
A
zA
6
.
-
B
Tx
zA
5
.
Rx Tx
CI S C O
ETHERNET
NTENNA
C
2 4G
4
Rx
3
H
Rx Tx
Single-mode Fibre
B
2 4G
17
SERIES
ETHERNET
2
H
No Fibre
Rx Tx
C
A
2 4G
16
CI S C O
Catalyst 2970
1
1X
.
B
.
? to ge
0/1
Tx
Rx
Tx
.
.
Rx
Tx
Tx
NTENN
-
H
.
C
Rx
.
Rx
Tx
NTENNA
NTENN
Rx
Tx
A
Tx
-
H
62.5/125nm (OM1) Multi-mode
Fibre
-
Rx Tx
2 .4GHz
A
NTENNA
Patch
Port
AP45
RADIO
NTENNA
B
C
A
AP16
AP27
-
Rx Tx
2 .4GHz
A
-
23 24
A
STATUS
H
.
.
.
-
Rx Tx
2 .4GHz
A
NTENNA
RADIO
.
NTENNA
H
-
-
B
21 22
rt ?
NTENNA
C
19 20
NTENNA
A
17 18
h Po
Patc
.
15 16
Rx Tx
RADIO
.
.
13 14
NTENNA
STATUS
H
11 12
Rx Tx
H
9 10
AP31
Rx Tx
H
7 8
.
X
AP32
2 .4GHz
A
ETHERNET
NTENNA
H
-
15
50/125nm (OM3) Multi-mode Fibre – TODO confirm from Siemens
9F5LB1-12D-Optical Fibre Cable E244435-03 Multimode specs
(Top Patch Panel)
23 24
In Use
Rx Tx
CI S C O
RADIO
NTENNA
A
-
.
.
.
C.
A.
B.
A
A
A
zA
.
C.
2 4G
2 4G
2 4G
.
21 22
Single-mode Fibre
B.
19 20
-
2 .4GHz
A
5 6
STATUS
.
Rx Tx
2 .4GHz
A
STATUS
H
.
.
.
.
-
14
14X
NTENNA
A
17 18
A
15 16
No Fibre
A
13 14
SYST
RPS
2 .4GHz
A
NTENNA
H
NTENNA
H
H
H
-
rt
Po
tch
Pa
.
Tx
NTENN
2 4G
2 4G
11 12
2 .4GHz
A
X
3 4
RADIO
NTENNA
13
13X
12X
In Use In Use
Patch Port ? to ge0/1
B.
Rx
Tx
NTENN
A
Rx
.
9 10
7 8
NTENN
5 6
-
NTENN
3 4
2 .4GHz
A
X
1 2
Rx Tx
ETHERNET
.
Rx Tx
CI S C O
STATUS
12
Rx Tx
RADIO
NTENNA
CI S C O
H
Rx Tx
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
Rx
2 .4GHz
A
Rx
In Use In Use
Rx Tx
CI S C O
Rx Tx
ETHERNET
-
11
CI S C O
CI S C O
ETHERNET
NTENNA
10
11X
1
STATUS
ETHERNET
H
B
C
A
Rx
PRDSW98
Location: G4 (Signed as GC-04)
ETHERNET
Rx Tx
9
16X
62.5/125nm (OM1) Multi-mode
Fibre
H
.
.
.
-
- Tx
8
2X
-
A
Rx
Tx
NTENN
A
Rx
28
Rx Tx
CI S C O
ETHERNET
NTENNA
Tx
27
2 .4GHz
A
NTENNA
H
-
- Tx
7
Catalyst 2970
Rx Tx
Rx
26
GLC-SX-MM
Patch Ports 9&10 to ge0/28 w/
GLC-SX-MM SFP
62.5/125m OM1 patch
min. 2 metres
SC / LC Connectors
2 .4GHz
A
RADIO
NTENNA
AP7
- Tx
6
B
25
2 .4GHz
A
STATUS
H
H
-
5
STAT
DUPLX
SPEED
24X
14X
B
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
CI S C O
ETHERNET
NTENNA
4
MODE
16X
12X
-
C
X
1 2
NTENN
In Use
A
23X
13X
-
24
Tx
23
NTENN
Rx
22
C
B
C
A
-
Rx Tx
3
NTENNA
zA
Rx
Tx
NTENN
21
-
2 4G
NTENN
.
Rx
Tx
NTENN
20
A
.
.
.
Rx Tx
B.
A.
zA
NTENN
.
Rx
Tx
NTENN
19
.
NTENNA
H
-
AP6
-
.
C.
A.
B.
zA
zA
zA
2 4G
.
C.
A.
B.
A
A
A
zA
zA
2 4G
zA
Tx
NTENN
.
Rx
18
Tx
17
Rx
16
Tx
15
.
NTENNA
H
H
-
Rx Tx
2
.
14
.
RADIO
23 24
RADIO
NTENNA
.
13
11X
.
12
H
NTENNA
STATUS
21 22
H
11
H
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
ETHERNET
e0/2
to g
3
0/
ge
to
?
rt
Po
tch
Pa
STATUS
H
10
H
9
H
Rx Tx
19 20
2 .4GHz
A
8
2 .4GHz
A
Rx Tx
CI S C O
17 18
AP30
2 .4GHz
A
7
-
2 .4GHz
A
6
2 .4GHz
A
B
C
A
Rx Tx
15 16
B
5
2 .4GHz
A
.
.
.
AP4
NTENNA
Rx Tx
C
4
-
AP39
SERIES
NTENNA
A
-
B
H
H
H
-
13 14
CI S C O
GLC-SX-MM
Patch Ports 9&10 to ge0/28 w/
GLC-SX-MM SFP
62.5/125m OM1 patch
min. 2 metres
SC / LC Connectors
NTENNA
C
A
NTENNA
GLC-SX-MM
Patch Ports 9&10 to ge0/28 w/
GLC-SX-MM SFP
62.5/125m OM1 patch
min. 2 metres
SC / LC Connectors
24X
14X
.
.
.
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
-
28
16X
12X
PRDSW102
Location: L4 (Signed as FC-04)
H
3
2X
rt ?
h Po
Patc
RADIO
NTENNA
27
.
2
e0/
to g
.
rt ?
.
h Po
Patc
RADIO
NTENNA
H
2
1X
B
STATUS
26
H
STATUS
NTENNA
H
1
16X
C
A
-
25
24X
GLC-SX-MM
PRDSW92
Patch Ports 9&10 to ge0/28 w/
Location: EH-3 (Door unmarked, best of luck J)
GLC-SX-MM SFP
/3
ge0
? to
28
ETHERNET
16X
2X
-
Rx Tx
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
Catalyst 2970
CI S C O
ETHERNET
NTENNA
A
A
A
27
H
Rx Tx
MODE
Rx Tx
zA
zA
zA
26
Rx Tx
B.
Rx Tx
H
Rx Tx
AP25
.
.
.
Rx Tx
2 4G
2 4G
2 4G
25
H
H
H
Rx Tx
.
.
.
23X
13X
-
AP29
24
Rx
2 4G
zA
A.
23
Tx
2 4G
zA
A
22
Rx
.
2 4G
zA
21
Rx
.
2 4G
2 4G
20
Tx
.
.
.
19
-
SERIES
A.
18
A
17
A
16
A
15
NTENN
C.
.
1X
14
NTENNA
-
23X
16X
Catalyst 2970
/4
e0
og
?t
Rx
B.
2 4G
13
11X
NTENN
A.
.
12
Rx
A
.
C.
A.
B.
A
A
A
C.
A.
11
Tx
C.
B.
NTENN
A.
B.
A
A
A
NTENN
A
NTENN
A
NTENN
A
10
NTENN
Rx
Tx
NTENN
C.
9
STAT
DUPLX
SPEED
-
SERIES
24
MODE
B
B
C
-
Patch Port ? to ge0/1
RADIO
NTENNA
23
Rx
Rx
Tx
NTENN
B.
8
Rx
NTENN
A.
7
Tx
A
.
0/7
Patch Po
rt
NTENN
Rx
A
6
NTENNA
C
-
AP38
.
.
STATUS
22
Rx
2 4G
2 4G
? to ge
NTENN
Pa
tch
Po
rt
NTENN
.
.
Tx
5
NTENN
NTENNA
A
-
NTENNA
H
A
-
Rx Tx
AP5
21
16X
SYST
RPS
SYST
RPS
-
20
RADIO
NTENNA
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
ETHERNET
NTENNA
NTENNA
Rx
4
Tx
NTENNA
.
STATUS
H
.
B
C
-
AP24
CI S C O
11 12
2X
2 .4GHz
A
3
2 .4GHz
A
Patch Port ? to ge0/1
2
2 .4GHz
A
1
NTENN
Catalyst 2970
CI S C O
Rx Tx
Rx Tx
t
Por
ch
Pat
RADIO
B
Rx Tx
RADIO
.
NTENNA
H
.
.
-
ETHERNET
Rx Tx
-
C
STATUS
.
ETHERNET
NTENNA
H
A
-
19
CI S C O
RADIO
NTENNA
H
.
B
C
A
AP12
-
STATUS
A
AP
H
STATUS
NTENNA
H
.
.
.
-
NTENNA
.
Rx Tx
CI S C O
H
ETHERNET
NTENNA
H
H
H
-
Rx Tx
.
A
NTENNA
.
CI S C O
RADIO
NTENNA
-
H
Rx Tx
- Tx
H
STATUS
18
MODE
RADIO
NTENNA
Rx
Tx
A
Pa
tch
Po
?t
rt
og
?t
e0
/5
og
e0
Patc
/4
h Po
rt ?
to g
e0/
6
Rx Tx
STAT
DUPLX
SPEED
CI S C O
ETHERNET
-
STATUS
ETHERNET
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
A
-
AP28
ETHERNET
NTENNA
Patch Po
CI S C O
NTENNA
Tx
zA
23 24
NTENN
Rx
Tx
NTENN
zA
21 22
19 20
0/2
rt ? to ge
Single-mode Fibre
H
Rx
17
STAT
DUPLX
SPEED
Rx
Rx
Tx
NTENN
zA
17 18
No Fibre
NTENN
Rx
2 4G
15 16
Tx
Tx
NTENN
2 4G
13 14
Rx
NTENN
2 4G
11 12
Tx
NTENN
.
9 10
7 8
H
Rx
16
SYST
RPS
Rx Tx
2 .4GHz
A
Rx
- Tx
15
to ge0/1
1
Rx Tx
NTENN
NTENN
Rx
Tx
.
X
5 6
3 4
62.5/125nm (OM1) Multi-mode
Fibre
-
NTENN
NTENN
Rx
Tx
.
X
1 2
23 24
Single-mode Fibre
NTENNA
Rx
Tx
No Fibre
-
CI S C O
- Tx
9 10
7 8
1X
Rx Tx
ETHERNET
62.5/125nm (OM1) Multi-mode
Fibre
Patch Port
?
RADIO
NTENNA
Tx
Rx
Tx
AP41
STATUS
AP26
Rx
Rx
Tx
In Use In Use
-
2 .4GHz
A
Rx
- Tx
14
14X
CI S C O
ETHERNET
NTENNA
2 .4GHz
A
Rx
- Tx
13
13X
Rx Tx
B
C.
Rx
-
Tx
NTENNA
NTENN
-
Rx Tx
Rx
RADIO
NTENNA
Rx Tx
Tx
GLC-SX-MM
Patch Ports 9&10 to ge0/28 w/
GLC-SX-MM SFP
62.5/125m OM1 patch
min. 2 metres
SC / LC Connectors
PRDSW101
Location: L3 (Signed as FC-03)
NTENN
?
Rx
rt
h Po
Patc
C
Rx
- Tx
12
62.5/125nm (OM1) Multi-mode Fibre
(Top Patch Panel)
2 .4GHz
A
Rx
- Tx
X
5 6
3 4
24X
14X
Tx
21 22
NTENN
19 20
NTENN
17 18
Rx
NTENN
Rx
Tx
15 16
STATUS
2 .4GHz
A
Rx
- Tx
11
16X
12X
NTENN
Rx
13 14
Tx
11 12
Rx
9 10
7 8
Tx
X
5 6
3 4
Rx
X
1 2
-
2 .4GHz
A
Rx
- Tx
10
12X
X
1 2
28
A
B.
27
.
A.
26
.
A
25
.
A
23X
H
A
SERIES
24
H
zA
23
H
zA
22
2 .4GHz
A
zA
21
2 .4GHz
A
2 4G
20
2 .4GHz
A
2 4G
19
B
2 4G
18
C
.
17
A
.
16
.
B
C
A
.
15
.
.
.
.
-
14
13X
.
NTENNA
H
-
13
11X
H
RADIO
NTENNA
AP11
12
H
STATUS
H
H
-
11
H
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
ETHERNET
NTENNA
9
2 .4GHz
A
Rx Tx
10
2 .4GHz
A
Rx Tx
CI S C O
9
2 .4GHz
A
B
C
A
AP10
Rx Tx
8
B
.
.
.
-
7
2X
- Tx
C
NTENNA
H
-
Rx
A
RADIO
NTENNA
6
.
STATUS
H
H
-
8
11X
MODE
e0/2
to g
CI S C O
ETHERNET
NTENNA
.
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
CI S C O
ETHERNET
NTENNA
In Use In Use
Rx
.
Rx Tx
5
H
Rx Tx
3
0/
ge
to
- Tx
H
B
C
A
AP9
Rx Tx
?
rt
Po
tch
Pa
- Tx
H
.
.
.
-
-
2 .4GHz
A
NTENNA
H
-
4
16X
2 .4GHz
A
RADIO
NTENNA
-
AP40
2 .4GHz
A
STATUS
H
H
-
GLC-SX-MM
Patch Ports 9&10 to ge0/28 w/
GLC-SX-MM SFP
62.5/125m OM1 patch
min. 2 metres
SC / LC Connectors
PRDSW97
Location: G3 (Signed as GC-03)
-
B
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
CI S C O
ETHERNET
NTENNA
?
7
NTENNA
C
A
Rx
rt
h Po
Patc
3
.
Rx
- Tx
NTENNA
.
24X
14X
.
Rx
- Tx
6
H
16X
12X
H
16X
2X
MODE
2
e0/
to g
2
Rx
NTENNA
H
B
C
A
-
5
STAT
DUPLX
SPEED
.
.
.
-
AP8
- Tx
1
1X
SYST
RPS
H
H
H
-
Catalyst 2970
Patch Port ? to ge0/1
RADIO
NTENN
A
B.
A
A
ETHERNET
4
In Use In Use
Rx Tx
28
NTENN
A
Rx Tx
24
CI S C O
11X
STAT
DUPLX
SPEED
NTENN
NTENN
A
Rx Tx
A
SERIES
NTENN
7
NTENN
6
NTENN
5
3
PRDSW91
Location: EH-2 (Signed as GF-06)
B
C
A
4
1X
SYST
RPS
NTENNA
23 24
MODE
NTENNA
.
3
2 .4GHz
A
2
2 .4GHz
A
1
2 .4GHz
A
Catalyst 2970
Patch Port ? to ge0/1
RADIO
NTENNA
21 22
RADIO
NTENNA
.
.
-
Rx Tx
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
STATUS
19 20
16X
H
zA
STATUS
H
H
Rx Tx
CI S C O
ETHERNET
2
2X
AP23
NTENNA
17 18
STAT
DUPLX
SPEED
.
zA
zA
Tx
zA
Rx
Tx
2 4G
Rx
Tx
2 4G
Rx
2 4G
NTENN
CI S C O
NTENNA
Rx
.
NTENN
Single-mode Fibre
Tx
No Fibre
ETHERNET
Rx Tx
15 16
Catalyst 2970
1
1X
? to ge0/2
Patch Port
Rx
B
-
AP44
AP15
13 14
Rx Tx
2 .4GHz
A
NTENNA
C
A
-
B
C
A
-
Rx Tx
2 .4GHz
A
NTENNA
.
-
.
.
.
-
2 .4GHz
A
NTENNA
.
Single-mode Fibre
.
H
No Fibre
62.5/125nm (OM1) Multi-mode
Fibre
NTENN
Rx Tx
RADIO
H
NTENNA
STATUS
H
NTENNA
H
H
-
ETHERNET
H
NTENNA
62.5/125nm (OM1) Multi-mode
Fibre
RADIO
11 12
SYST
RPS
CI S C O
STATUS
9 10
7 8
0/1
AP22
23 24
CI S C O
ETHERNET
3 4
62.5/125nm (OM1) Multi-mode Fibre
(Top Patch Panel)
Patch Po
rt
RADIO
NTENNA
C
A
STATUS
A
C.
NTENN
ETHERNET
NTENNA
.
9 10
7 8
X
5 6
Rx Tx
.
X
5 6
3 4
Rx Tx
X
1 2
CI S C O
.
X
1 2
23 24
In Use In Use
H
B.
Tx
In Use In Use
Rx Tx
H
A.
Rx
Tx
3
0/
ge
to
H
A
-
2 .4GHz
A
A
-
AP21
2 .4GHz
A
GLC-SX-MM
Patch Ports 9&10 to ge0/28 w/
GLC-SX-MM SFP
62.5/125m OM1 patch
min. 2 metres
SC / LC Connectors
PRDSW100
Location: L2 (Signed as FC-02)
2 .4GHz
A
Rx Tx
/2
ge0
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
A
B
C
Rx Tx
A
AP43
Rx Tx
?
rt
Po
tch
Pa
? to
62.5/125m OM1 patch
min. 2 metres
SC / LC Connectors
.
-
.
.
-
-
NTENNA
H
B
C
A
21 22
NTENNA
.
19 20
Rx Tx
RADIO
NTENNA
.
17 18
15 16
.
13 14
STATUS
H
11 12
Rx Tx
H
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
9 10
7 8
-
24X
14X
NTENNA
H
zA
NTENNA
16X
12X
2X
ort
hP
Patc
CI S C O
ETHERNET
NTENNA
H
X
5 6
3 4
-
2 .4GHz
A
X
1 2
-
2 .4GHz
A
In Use In Use
Rx Tx
2 .4GHz
A
Rx Tx
3
0/
ge
to
t?
or
P
tch
Pa
-
AP42
GLC-SX-MM
Patch Ports 9&10 to ge0/28 w/
GLC-SX-MM SFP
62.5/125m OM1 patch
min. 2 metres
SC / LC Connectors
PRDSW96
Location: G2 (Signed as GC-02)
B
Rx Tx
C
A
B
C
A
AP14
Rx Tx
/2
ge0
GLC-SX-MM
PRDSW90
Patch Ports 9&10 to ge0/28 w/
Location: EH-1 (Signed as “Comm’s Area”)
GLC-SX-MM SFP
MODE
.
.
.
.
-
.
NTENNA
H
H
H
-
.
RADIO
NTENNA
? to
rt
h Po
Patc
NTENNA
H
STATUS
NTENNA
H
Rx Tx
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
-
NTENNA
H
Rx Tx
CI S C O
ETHERNET
NTENNA
16X
B
C
A
Rx Tx
24X
14X
MODE
.
.
.
-
e0/5
to g
RADIO
SYST
RPS
16X
12X
2X
NTENNA
H
H
H
-
A
A
STATUS
H
NTENNA
AP13
rt ?
28
STAT
DUPLX
SPEED
16X
-
h Po
Patc
CI S C O
24
13X
ETHERNET
STAT
DUPLX
SPEED
NTENNA
zA
zA
zA
2 4G
2 4G
2 4G
28
A
A.
27
zA
26
zA
25
2 4G
23X
.
C.
A.
B.
A
Patch Port ? to ge0/1
24
B.
23
A
22
zA
21
.
20
A
C.
A.
B.
A
A
NTENN
A
NTENN
A
19
Rx
18
Tx
17
NTENN
16
Rx
15
13X
Rx
Tx
NTENN
14
NTENN
13
11X
NTENN
12
NTENN
11
NTENN
10
-
Rx Tx
Tx
Tx
Tx
9
.
Tx
.
Rx
Tx
8
-
Rx Tx
2 .4GHz
A
7
SERIES
2 .4GHz
A
6
Rx
Rx Tx
2 .4GHz
A
5
B
C
A
4
Catalyst 2970
Rx Tx
2 .4GHz
A
3
2 .4GHz
A
RADIO
2
1X
NTENNA
.
.
.
-
AP20
Rx Tx
Rx
2 4G
2 4G
NTENNA
H
Rx Tx
NTENN
Rx
.
Rx
.
NTENNA
H
SERIES
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
2 .4GHz
A
STATUS
1
Patch Port ? to ge0/1
CI S C O
ETHERNET
Catalyst 2970
Rx Tx
24X
14X
Rx
-
H
Rx Tx
Tx
.
B
C
A
-
AP35
Rx Tx
16X
12X
2X
MODE
.
.
.
-
NTENNA
H
H
H
zA
NTENNA
Rx
NTENNA
GLC-SX-MM
Patch Ports 9&10 to ge0/28 w/
GLC-SX-MM SFP
50/125m OM3 patch
min. 2 metres
SC / LC Connectors
Parts List:
<part>: <use> + <spares> = <total>
Cisco GLC-SX-MM: 13 Allocated + 2 Spare = 15
50/125m OM3 Patch Lead, SC / LC Connectors, 2 metres: 3 + 2 = 5
62.5/125m OM1 Patch Lead, SC / LC Connectors, 2 metres: 11 + 2 = 13
All copper patch leads assumed to be coming from existing stock.
All Catalyst 2970 switches assumed to be coming from existing stock.
Tx
Part 1
IP Transit – Getting what you paid for.
(c) 2011 Microsoft. All rights reserved.
IP Transit: What we want
► Great performance for typical usage scenarios
► Significantly exceed commonly expected
performance
► Delegeeks (and APC sales drones) must ♥ the
APC/TechEd network
► Matter of brand value for Microsoft
► Matter of pride for the TechOps team
(c) 2011 Microsoft. All rights reserved.
A few primers
► Ethernet: Chuck data at a wall and see what
sticks
– IEEE 802.3 is CSMA/CA
– Simple and clever design  Self-clocking
– Useless if congested
► Internet Protocol Suite
– The Internet is powered by a suite of protocols
– Different protocols support different usage scenarios
(c) 2011 Microsoft. All rights reserved.
TCP congestion management
► Works like magic!
► Have you noticed downloading a file and the
transfer starts off slow then speeds up?
► This is congestion management at work.
► Not very deterministic but the Internet wouldn’t
work otherwise.
(c) 2011 Microsoft. All rights reserved.
Typical Internet Usage Scenario
10gbps
1gbps
1gbps
www.4chan.org
Some Fancy IP
Transit
Provider
80mbps
Some Dodgy IP
Transit Provider
10gbps
10gbps
Some Fancy IP
Transit
Provider
Some Fancy IP
Transit
Provider
10gbps
ISP core
10gbps
ISP core
Data centre
cross-connect
10mbps
0.8mbps
Resi-grade DSL
“Router”
161 millisecond round-trip time
Some observations:
• The trip from AB is on a different path to BA
• Couple of dodgy providers in the mix – How do we stop the 80mbps and
10mbps links on the red path getting smashed?
• In reality there are 15 hops between us an 4chan
• Ye cannay change the laws of physics
(c) 2011 Microsoft. All rights reserved.
How TCP doesn’t work
HTTP Request for naked picture of Miranda Kerr
ACK
www.4chan.org
ACK
ACK
161 millisecond round-trip time
(c) 2011 Microsoft. All rights reserved.
Old-mate just had
a disappointing
user experience
How TCP DOES work
HTTP Request for naked picture of Miranda Kerr
www.4chan.org
ACK
ACK
ACK
ACK
161 millisecond round-trip time
• TCP tunes itself to make use of bandwidth without smashing links
• Latency affects the number of packets that can be in flight at once
• This is called the bandwidth delay product (BDP)
Old-mate just had
an AWESOME
user experience
All of this is true but it is not a get out of jail free card for performance problems
(c) 2011 Microsoft. All rights reserved.
Common myths
► EVERY supplier uses BDP as an excuse
► iperf and UDP are their weapons of choice
– Great if DNS was the primary use case for perf #fail
– Most deep packet inspection happens on TCP streams
(i.e. you’ll find traffic policing issues there)
► Get a BDP calculator and tell them to get back in
their box
(c) 2011 Microsoft. All rights reserved.
Bestest excuses ever
► “Ping is irrelevant for measuring latency! It is a
UDP protocol!”
– Anonymous muppet at TechEd 2011
(c) 2011 Microsoft. All rights reserved.
Bestest excuses ever
► “You can’t use FTP for bandwidth testing because
it is adaptive”
– ISP on Hamilton Island
(c) 2011 Microsoft. All rights reserved.
Bestest excuses ever
► [ Walks in with a smashed Netcomm NB9 resigrade DSL modem with an antenna hanging out
the back ]
► “I am here to install your 6 meg link”.
(c) 2011 Microsoft. All rights reserved.
Bestest excuses ever
► 2 am, pouring rain in the middle of a golf course
► Linesman turns up
► “I am here to fix a problem with an ATM.”
► CAN YOU SPOT THE DIFFERENCE?
(c) 2011 Microsoft. All rights reserved.
#1 Bestestestiest excuse ever
► Name server returns NXDOMAIN RCODE for a
domain the delegates rely on
► “Could be due to hurricane Irene.”
(c) 2011 Microsoft. All rights reserved.
Part 2
cloud.auteched.net
(c) 2011 Microsoft. All rights reserved.
DemoNet
What is it?
► Private cloud supporting demonstrations during
the event
► Showcase latest MS and HP technology
► Sitting in the middle of the Expo hall
(c) 2011 Microsoft. All rights reserved.
DemoNet
Stats
►28 of clouds
–238 VMs
–9 hosts dedicated to session
–8 networks (+reuse)
(c) 2011 Microsoft. All rights reserved.
DemoNet
How do you get on it?
► Communicated during Speaker registration
► Capture requirements upfront
► VMs imported on-site, via USB HDD
► Capture requirements (again)
(c) 2011 Microsoft. All rights reserved.
DemoNet
The conditions in which we work
► Unstable environmental conditions
– Power outs
– Muppets with pliers
– People kicking over beers
► Layout vs. purpose
– Showcase not really
a data centre
► Physical access
(c) 2011 Microsoft. All rights reserved.
(c) 2011 Microsoft. All rights reserved.
(c) 2011 Microsoft. All rights reserved.
DemoNet
Logistics
► SYD/SIN > BNE
– Codify HQ (2nd August)
– Environment build (firmware, OS, core infra)
– Hosted on same IP space as event before going on
site
► BNE > GCCEC
– Showcase
– Go-live (Friday 26th August)
– Plug it in and it ‘just works’
(c) 2011 Microsoft. All rights reserved.
DemoNet
Logistics
► Showcase hardware unpacking in action
(c) 2011 Microsoft. All rights reserved.
DemoNet
Design rational
► Highest level resilience for the environment
–
–
–
–
Hyper-V Clusters
Failover network design
Storage RAID6 (not RAID0)
Power – Single 32A 3phase
► Shared Services
(c) 2011 Microsoft. All rights reserved.
DemoNet
Hardware
► 24 x HP BL460c G7 (4 Enclosures, 2 Racks)
– ServerEngines and Virtual Connect
► HP EVA HSV300
– 45 x SAS 450 GB
– 11 x FATA 1 TB
– 79% allocated
(c) 2011 Microsoft. All rights reserved.
DemoNet
Hardware
► DEMO
(c) 2011 Microsoft. All rights reserved.
DemoNet
Hardware (cont.)
(c) 2011 Microsoft. All rights reserved.
DemoNet
Management
► SCVMM 2012 Beta
– Bare Metal Builds
•
•
•
•
•
WinPE + HP SmartStart + WDS
Windows 2008 R2
Enable Hyper-V role
Proliant Support Pack (HP NCU)
SAN tools/mgmt
(c) 2011 Microsoft. All rights reserved.
DemoNet
Management
► SCVMM 2012 Beta
– VM templates
• WIM2VHD + unattend.xml
– SSP
(c) 2011 Microsoft. All rights reserved.