Transcript Art of Peering Preso

The Art of Peering: The Peering
Playbook
William B. Norton
Co-Founder & Chief Technical Liaison
Equinix, Inc.
<[email protected]>
NaMeX Member Meeting
October 7, 2005
Rome, Italy
What is Equinix?
• One of the largest Carrier-Neutral
Colocation Providers in the world
• Operate Dominant IXes in the U.S.
(Ashburn Flagship IX)
• 15 Internet Business Exchanges across U.S.
and Asia (HK, TK, SG, SYD)
• 200+ Networks across IBXes
• ~50Gbps aggregate traffic
6yrs Internet Researcher
• 90% externally focused
• Document Internet Operations Practices –
Interconnect/Peering/IXes/etc.
• Research with the community
– Write White Paper version M.m
– Walk throughs & Feedback
– Fix/Update Paper
• 200 Walkthroughs later – a document reflecting
community Internet Operations knowledge
So far 10 White Papers
Internet Operations White Papers
1)
2)
3)
4)
5)
6)
7)
8)
9)
10)
“Interconnection Strategies for ISPs”
“Internet Service Providers and Peering”
“A Business Case for Peering”
“The Art of Peering: The Peering Playbook”
“The Peering Simulation Game”
“Do ATM-based Internet Exchanges Make
Sense Anymore?”
“Evolution of the U.S. Peering Ecosystem”
“Asia Pacific Peering Guidebook”
“A Business Case for Peering in 2004”
“The Great Public vs. Private Peering Debate:
Peering at 10Gig”
Freely available. See Web site or send e-mail to [email protected]
Or Google for “William B. Norton”
Myths…
Research “The Art of Peering”
• Follow up to the first three white papers.
Q: When e-mail to peering@<ispdomain>.net generates no
response, what do Seasoned Peering Coordinators do?
• Smartest Peering Coordinator: “Tricks of the Trade”
• 20 Tactics successfully used to obtain Peering where you
otherwise might not be able to.
Disclaimer: These are NOT recommended tactics…I am
simply documenting what has been successfully used in
the field to obtain peering.
Language.Graphical notation to describe the tactics
Graphical Notation of Tactics
To Portray Peering Plays Pictorially…
A
P?=Peering Request w/
APC
Peering Coordinator
B
ISP Initiator ISP Target
P?
BPC
P?
Peering Negotiation
ISP B
ISP A
Customers Customers
APC
BPC
T?
$
A
B
T?=Transit Request
To Sales Person
APC
BS
T?
Transit Negotiations
Larger Circle=More Customer Prefixes
Thicker Lines=More Traffic
$
APC
BS
Transit and Peering Sessions
A
A
T $
T $
B
T=Established Transit Session
(Selling Access to entire Internet)
Size indicates effective size of transport
Supporting the session
B
Represents “the rest of the Internet”
P
A
B
P
A
P=Established Peering Session
(Reciprocal Access to each others customers)
Size indicates effective size of transport
Supporting the session
B
Graphical Display of Routing Announcements
Traffic over Transit and Peering
Sessions
T $
A
A
B
T $
B
P
A
B
P
A
B
Traffic showed as directed lines
Thickness of line indicates amount of
Traffic in relevant direction
Other Variations
P->T = Transition of Relationship
P | T = Either Peering or Transit apply
= Traffic destined anywhere
= Fictitious Traffic
= Packet Loss ridden Traffic
= Traffic destined to green network
= Traffic destined to brown network
Other Graphical Symbols
Peering
Point
Tied or
with
Exchange Point,
Telco Hotel
Indicates two or more
Elements tied with
relationship
Indicates a ordering:
a sequence to be followed
in the Peering Tactic
1)
The Direct Approach uses peering@<ispdomain>.net ,
phone calls, face to face meetings, or otherwise direct
interactions with Peering Coordinators to establish peering.
P?
P?=Peering Request
To Peering Coordinator(s)
APC
BPC
P?
Peering Negotiation
APC
BPC
Leading to
{null}
-orP
Peering Session
A
B
{“No”,null}
2) The Transit with Peering Migration tactic leverages an
internal advocate to buy transit with a contractual migration
to peering at a later time.
T?
T->P?
$
APC
BS
$
APC
BS+BPC
T?
$
APC
BS
Transit Negotiations with Sales
leads to Peering
(…if peering prerequisites be met…)
A
T->P $
B
P
A
B
3) The End Run Tactic minimizes the need for transit by
enticing a direct relationship with the target ISP’s largest
traffic volume customers.
T?/P?
$
APC
B
T?/P?
6) Paid Peering as a maneuver is positioned by some as a
stepping stone to peering for those who don’t immediately
meet the peering prerequisites.
P
A
$
B
P
A
B
7) In the Partial Transit tactic, the routes learned at an
exchange point are exchanged with the peer for a price
slightly higher than transport costs.
C
D E
F
G
H
pt
A
$
B
Peering
Point
M
Geographically
Remote Router
I
J
L
K
Routing Announcements
Forwarding all customer & Peering Pt Routes
(almost peering – maybe costs less)
8)
The Chicken tactic involves de-peering in order to make
the other peer adjust the relationship.
P
A
T
B
X $
$
A
or
B
T
T
$ Y
P
A
B
Who will blink first?
A<->B Traffic has to go somewhere
http://66.249.93.104/search?q=cache:NOS3HJhX9jcJ:www.merit.edu/mail.archives/nanog/msg11606.htm
l+level3+network+status+cogent&hl=it
Example occurred on Wednesday!
What tactic is this?
http://scoreboard.keynote.com/scoreboard/Main.aspx?Destination=Level3
http://www.merit.edu/mail.archives/nanog/msg12221.html
The Nature of Web Traffic
• Asymmetric Traffic
Client
(Browser,
Peer2peer
client)
Small Requests
Generate Large Responses
Service
(Web Server,
Peer2peer
client)
9) In the Traffic Manipulation tactic, ISPs or content
players force traffic along the network path that makes
peering appear most cost effective.
$ L
T
A
T
P
B
T
CH ISP
i.e.Yahoo!
T
$
$ G
$ L
$ L
T
A
B
T
P
P
T
$
$ G
B hears A’s route
A forces traffic
‘for free’ through Peer L Over B’s transit
P?
APC
T
BPC
T
$
$ G
1 MONTH LATER
Contact PC-We should Peer!
9b) For Access Heavy Guys…In the Traffic Manipulation tactic,
Access ISP
a) stop announcing routes, or
b) insert Target AS# into announcement to trigger BGP Loop
Suppression to force traffic along the network path that makes peering
appear most cost
effective.
$ L
L
$
$ L
T
A
T
P
B
T
$
T
Access ISP $ G
i.e. Verizon
T
A
B
T
P
P
T
$
$ G
B hears A’s route
A forces traffic
‘for free’ through Peer L Over B’s transit
P?
APC
T
BPC
T
$
$ G
1 MONTH LATER
Contact PC-We should Peer!
10) The Bluff maneuver is simply overstating future traffic
volumes or performance issues to make peering appear more
attractive.
P?
A
B
Overstating Traffic Futures “You better peer with me now cause…
P
G
L
$
T
A
$
T
Fictitious
Performance
Problems
B
Lots of transit fees
coming otherwise!”
11) The Wide Scale Open Peering Policy as a tactic signals
to the Peering Coordinator Community the willingness to
peer and therefore increases the likelihood of being contacted
for peering by other ISPs.
P?
APC
To anyone who will listen!
From the highest mountain
“We will Peer with Anyone!”
12) The Massive Colo Build tactic seeks to meet the
collocation prerequisites of as many ISPs as possible by
building POPs into as many exchange points as possible.
C
M
Eastern
Pacific
IX
TimeZone
IX
TimeZone
IX
A
A
A
IX
IX
IX
A
IX
IX
A
A
A
A
IX
IX
IX
A
A
A
IX
IX
A
A
IX
IX
A
A
“Meet us in 3 Time Zones”
14) Friendship-based Peering leverages contacts in the
industry to speed along and obtain peering where the process
may not be in place for a peering.
P?
BPC
APC
Forums to meet Peering Coordinators
GPF
NANOG
APRICOT
RIPE
IETF
:
15) The Spam Peering Requests tactic is a specific case of
the Wide Scale Open Peering tactic using the exchange
point contact lists to initiate peering.
P?
IX Participants List
IX Participants List
APC
IX Participants List
:
:
17) Purchasing Legacy Peering provides an immediate set
of peering partners.
A
P
G
A
Purchases
G and P
P
P
GA
U
A
P
U
A
B
Legacy (early Internet day) Peering
P
PA
B
19) The False Peering Outage tactic involves deceiving an
ill-equipped NOC into believing a non-existing peering
session is down.
ANOC
X
Peering
Point
BNOC
ANOC: Hey – Emergency!
ANOC: Our Peering Session with you Went Down!
BNOC: Strange. <looks on router> I don’t see it configured.
ANOC: It was. Don’t make me escalate to <famous person>
BNOC: Ah – I bet is was that last config run that trashed it.
BNOC: Give me a few minutes to fix it on both ends.
20) The Leverage Broader Business Arrangement takes
advantage of other aspects of the relationship between two
companies to obtain peering in exchange for something else.
P?
APC
BS
P
P?
APC
BS
A
B
Tied
with
A
B
Other
Peering
Tied with
“Other”
+Fiber deal
+Dial-in deal
+Racks
+Transport
+Strategic deal
:
Summary
• These are the “Tricks of the Trade”
• Comments/Additions welcome !
• Copies of the “Art of Peering: The Peering
Playbook” are freely available
– Send e-mail to [email protected] or
– Most white papers (except this one) are on-line
at http://www.equinix.com/
– Or <google search “William B. Norton”>
Some differences between European
and U.S. Model Internet Exchange
European IXes
U.S. IXes
1.
2.
3.
4.
1.
2.
3.
4.
5.
6.
7.
8.
9.
Are Non-Profit Associations
Have “Members”
Run best quality Switches
Are Colo-Neutral: Some
University Grade Colo
Member Meetings and Voting
on changes to policies and fees
Fixed contracts and fees
Modest Capital and Operating
Budget
Low Price
24/7 on-call support
5.
6.
7.
8.
9.
Are Commercial Corporations
Have “Customers”
Run best quality Switches
Own Financial/Commercial
Grade Colo infrastructure
Follow interests of Customers,
Stockholders, Employees
Negotiable Contracts and fees
Large Capital and Operating
Budget
High(er) Price
24/7 on-site support w/backup
processes