Transcript Experiments with Grid-enabled Network Control Plane in the
Experiments with Grid-enabled Network Control Plane in the PHOSPHORUS test-bed
Bartosz Belter [email protected]
Poznan Supercomputing and Networking Center TERENA Networking Conference 2009 Malaga, Spain
AGENDA
From GMPLS to G 2 MPLS: • • The GMPLS protocol stack Introduction to G 2 MPLS The PHOSPHORUS test-bed Validation of the G 2 MPLS protocol stack • The TNC 2009 demonstrations Summary TERENA Networking Conference 2009, Malaga, Spain 1
FROM GMPLS… TO G2MPLS
TERENA Networking Conference 2009, Malaga, Spain 2
The GMPLS protocol stack
Based on Quagga The prototype released in the form of a XEN virtual machine • Includes also all the needed system packages (libs and apps) • a “plug – configure – play” approach for the user • Available at the PHOSPHORUS web-site: http://www.ist-phosphorus.eu/files/deliverables/g2mpls_controller_prototype_v02.tar.gz
Four different kinds of controllers can be run depending just on the node configuration • GMPLS border controller • • • GMPLS edge controller GMPLS core controller GMPLS UNI-C controller TERENA Networking Conference 2009, Malaga, Spain
The PHOSPHORUS GMPLS w.r.t standards
ASON architecture OIF Network Interfaces (UNI and E-NNI) IETF (CCAMP) Protocol Controllers + some architectural aspects PHOSPHORUS GMPLS
TERENA Networking Conference 2009, Malaga, Spain
FROM GMPLS… TO G
2
MPLS
TERENA Networking Conference 2009, Malaga, Spain 5
What is G
2
MPLS?
uniform interface for the Grid-user
to trigger Grid & network resource actions
single-step provisioning
of Grid and network resources (w.r.t. the dual approach Grid brokers + NRPS-es) adoption of
well-established procedures
for traffic engineering, resiliency and crankback exposes
services interfaces specific for Grid
made of a set of
extensions to the standard GMPLS
• JSDL schema v1.3 (GMPLS signalling) • GLUE schema v1.3 (GMPLS routing)
G.O-UNI G 2 G 2 G.I-NNI G 2 NRPS Grid site B
TERENA Networking Conference 2009, Malaga, Spain
Grid site A G 2 G.E-NNI G 2 MPLS G.O-UNI Grid site C
THE PHOSPHORUS TEST-BED
•
Transport Plane
• Control Plane • Middleware and Applications TERENA Networking Conference 2009, Malaga, Spain 7
G
2
MPLS test-bed – Transport Plane [1]
ADVA FSP 3000RE-II (Lambda Switch) • • • 15 pass through ports 6 local ports 3 physical units Calient Diamond Wave (Fibre Switch) • • 60 ports 1 physical unit / 4 logical units (switch virtualization) TERENA Networking Conference 2009, Malaga, Spain
G
2
MPLS test-bed – Transport Plane [2]
Foundry XMR NetIron 8000 (Ethernet Switch) • • • 2 x 4-port 10GE modules (XFP) 1 x 24-port 1GE module (SFP) 3 physical units Allied Telesis AT-8000/S (Fast Ethernet Switch) • Low-cost managed stackable Fast Ethernet switch • PoE connectivity at the edge for VoIP phones and wireless access points • 10/100 TX x 24 ports Allied Telesis AT-9424T (Gigabit Ethernet Switch) • • 10/100/1000T x 24 ports 2 SFP bays TERENA Networking Conference 2009, Malaga, Spain
G
2
MPLS test-bed – Transport Plane [4]
The PHOSPHORUS test-bed in PSNC Grid site Allied Telesis AT-8000S The Ethernet domain The LSC domain ADVA FSP 3000 Foundry XMR ADVA FSP 3000 ADVA FSP 3000 ROADM ROADM Foundry XMR Allied Telesis AT-9424T Foundry XMR CALIENT Diamond Wave CALIENT Diamond Wave CALIENT Diamond Wave CALIENT Diamond Wave Grid site GÉANT2 network The FSC domain Grid site Grid site
TERENA Networking Conference 2009, Malaga, Spain
G
2
MPLS test-bed – Transport Plane [4]
The PHOSPHORUS test-bed in UESSEX CALIENT Diamond Wave CALIENT Diamond Wave CALIENT Diamond Wave CALIENT Diamond Wave The FSC domain GÉANT2 network
TERENA Networking Conference 2009, Malaga, Spain
THE PHOSPHORUS TEST-BED
• Transport Plane •
Control Plane
• Middleware and Applications TERENA Networking Conference 2009, Malaga, Spain 12
G
2
MPLS test-bed – Control Plane [1]
The Control Plane implemented by a set of
G 2 MPLS node controlers
• Each of them operates
exclusively
derived from partitioning) on a Transport Network element (real or • Each controller is interfaced to the Transport Network equipment (Southbound Interface) through
TL1
(ADVA, CALIENT),
CLI
(Allied Telesis) and
SNMP
(Foundry XMR) • Node controllers run on i386 32-bit platform with Gentoo Linux distribution Signaling Control Network (SCN) • To transport signaling messages between the CP components • Each G 2 MPLS exposes at least an interface on the Signaling Communication Network (SCN) over which the G 2 MPLS protocol messages flow • SCN is IP-based with addresses from the private scope. IP tunnelling is used for out of band connectivity between controllers.
TERENA Networking Conference 2009, Malaga, Spain
G
2
MPLS test-bed – Control Plane [2]
The configuration of the G 2 MPLS CP requires
mapping
of actual
physical topology
into the
configuration files
associated with each of the G2MPLS processes TERENA Networking Conference 2009, Malaga, Spain
THE PHOSPHORUS TEST-BED
• Transport Plane • Control Plane •
Middleware and Applications
TERENA Networking Conference 2009, Malaga, Spain 15
G
2
MPLS test-bed – GRID Middleware: UNICORE6
UN iform I nterface to CO mputing RE sources
seamless, secure, and intuitive Initial development started in two German projects funded by the German ministry of education and research (BMBF) Continuous development since 2002 in several European projects Core developers today from Europe: CINECA, ICM, Intel, FLE,
FZJ
TERENA Networking Conference 2009, Malaga, Spain
G
2
MPLS test-bed – Applications [1]
KoDaVis
: Making Atmospheric Processes visible
WISDOM
: Wide In Silicio Docking on Malaria
TOPS
:Technology for Optical Pixel Streaming
SAGE
: Scalable Adaptive Graphics Environment
DDSS
: Backup/archive copies with TSM (Tivoli Storage Manager) TERENA Networking Conference 2009, Malaga, Spain
G
2
MPLS test-bed – Applications [2]
KoDaVis
: Making Atmospheric Processes visible simulations of physical and chemical processes in the atmosphere help to understand the effect of human activities on the climate: data sets ~ 1000 GigaByte visualization of data provides insight into processes TERENA Networking Conference 2009, Malaga, Spain
G
2
MPLS test-bed – Applications [3]
KoDaVIS
in Phosphorus: • Adapt application to Phosphorus environment to make scheduled synchronous reservations of its resources via the UNICORE middleware • Deploy at FZJ, FHG, PSNC to evaluate new Phosphorus services Communication requirements: • • • At visualisation sites: 700 Mbit/s, 10 msec latency At data-server site(s): n x 700 Mbit/s Traffic characteristics: 30 Mbit/s video (continuous) + bursty transfer of 3.3 MB data-slices
HoloBench, (3D-Wall)
Client Site A
CAVE, WorkBench
Client Site B
~ 700 Mbit/s
Data & collaboration server (FZJ) TERENA Networking Conference 2009, Malaga, Spain Client Site C
EXPERIMENTS WITH THE G2MPLS PROTOCOL STACK
•
The TNC09 demo: Integration of KoDaVIS with G 2 MPLS
• The TNC09 demo: DDSS Backup TERENA Networking Conference 2009, Malaga, Spain 20
Experiments with KoDaVIS, UNICORE and G
2
MPLS
Main building blocks: • • • Application: KoDaVIS Grid Middleware: UNICORE Grid-aware Network Control Plane: G 2 MPLS
KoDaVIS Client KoDaVIS Server UNICORE6 G 2 MPLS KoDaVIS Server
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 KoDaVIS demo – Transport Plane
Allied Telesis AT-8000S Allied Telesis AT-8000S KoDaVIS Server UNICORE6 KoDaVIS Server UNICORE6 Allied Telesis AT-8000S Allied Telesis AT-9424T KoDaVIS Client UNICORE6
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 KoDaVIS demo – Control Plane
G.UNI
ClientCtrl
RID: 192.168.156.20
TEL 2.20.1.2/30 CCID TNA 0x220 20.20.20.1/24 TEL 2.20.1.1/30 G 2 MPLS EdgeCtrl TEL 2.3.1.1/30 CCID TEM 0x23 100 G 2 MPLS EdgeCtrl CCID TNA
RID: 192.168.102.2
TEL 1.2.1.2/30 C TE M C ID TE 10 L 2 0x 00 .4
24 .1
.1
/3 0 CCID TEM 0x12 100 TEL 1.2.1.1/30 TE L 1.
3.
1.
1/ 30 TEL 2.3.1.2/30 TE L 1.
3.
1.
2/ 30 C C ID TE M TE L 2 .4
.1
.2
/3 0
RID: 192.168.102.3
0x 13 10 0 CCID TEM 0x34 500 TEL 3.30.1.1/30 TEL 3.4.1.1/30 TEL 3.4.1.2/30 TEL 3.30.1.2/30 0x330 30.30.30.1/24 G 2 MPLS CoreCtrl
RID: 192.168.102.1
TEL 1.4.1.1/30 CCID TEM 0x14 100 TEL 1.4.1.2/30 G 2 MPLS EdgeCtrl
RID: 192.168.102.4
CCID TNA TEL 4.40.1.2/30 0x440 40.40.40.1/24 TEL 4.40.1.1/30 G.UNI
ClientCtrl
RID: 192.168.156.30
G.UNI
ClientCtrl
RID: 192.168.156.40
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 demo – application scenarios [1]
Scenario 1: „Reduced” overlay mode
Scenario 2: Overlay mode
Scenario 3: Integrated mode
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 demo – application scenarios [2]
Scenario 1: „Reduced” overlay mode
No routing information about the network layer in Grid Middleware The scheduler just asks for a network path from the application client to server
UNICORE client MSS
Request for network QoS from
client
to
server
Network Reservation Request
G.OUNI
gateway KoDaVIS Session Manager KoDaVIS client KoDaVIS Data server
Activity endpoint Create Network SLA Monitor SLA Create new session Load the visualisation connect TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 demo – application scenarios [3]
Scenario 2: Overlay mode
Grid Layer has both, Grid and network routing knowledge Grid scheduler responsible for initiation and coordination of the reservation process through the participating Grid sites and the network G 2 MPLS acts as an e2e information bearer for network and Grid resources information TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 demo – application scenarios [4]
Scenario 2: Overlay mode (cont.) UNICORE client MSS G.OUNI
gateway KoDaVIS Session Manager
Request for network QoS from
client
to
any server
Request for routing information
KoDaVIS client
Routing information Selection of data server Network Reservation Request Create Network SLA Monitor SLA Create new session Load the visualisation Activity endpoint connect
KoDaVIS Data server
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 demo – application scenarios [5]
Scenario 3: Integrated mode
Most of the functionalities for resource advance reservation and co allocation are moved to the Network Control Plane G 2 MPLS acts as an e2e information bearer for network and Grid resources information TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 demo – application scenarios [6]
Scenario 3: Integrated mode (cont.) UNICORE client MSS G.OUNI
gateway G 2 MPLS CP KoDaVIS Session Manager
Request for network QoS from
client
to
any server
Network Reservation Request to
any server
Select a server and reserve the network QoS
KoDaVIS client
Create Network SLA Monitor SLA Create new session Load the visualisation Activity endpoint Publish the server address connect
KoDaVIS Data server
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 KoDaVIS demo
TERENA Networking Conference 2009, Malaga, Spain
EXPERIMENTS WITH THE G2MPLS PROTOCOL STACK
• The TNC09 demo: Integration of KoDaVIS with G 2 MPLS •
The TNC09 demo: DDSS Backup
TERENA Networking Conference 2009, Malaga, Spain 31
The TNC2009 DDSS demo (1)
Main building blocks: • • • Application: DDSS - GridFTP Grid Middleware: none Grid-aware Network Control Plane: G 2 MPLS
DDSS Client DDSS Server G 2 MPLS DDSS Server
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 DDSS demo (2)
The G 2 MPLS Control Plane handling requests of the Distributed Data Storage System (DDSS) application: • • The multi-domain and multi-technology test-bed Two network domains: – LSC domain (3 x ROADM ADVA FSP 3000RE-II) – PSNC – FSC doman (4 virtualized nodes based on Calient DiamondWave FiberConnect) – UESSEX – Domains interconnected with the 1 Gbit/s GÉANT2 data plane link The DDSS application offers the large files backup service using Grid FTP (part of the Globus toolkit) The DDSS client application is located in PSNC and remotely connected to the TNC09 booth DDSS uses the
anycast
feature of G 2 MPLS (
Integrated
mode) TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 DDSS demo (3)
TERENA Networking Conference 2009, Malaga, Spain
ACKNOWLEDGMENTS AND CONCLUSIONS
TERENA Networking Conference 2009, Malaga, Spain 35
Acknowledgments
G 2 MPLS development team • •
Nicola Ciulli
,
Gino Carrozzo
,
Giacomo Bernini, Francesco Salvestrini, Giodi Giogi, Giada Landi
for their hard work on the G 2 MPLS control plane design and development
Damian Parniewicz
,
Kuba Gutkowski
,
Łukasz Łopatowski
,
Krzysztof Dombek
,
Artur Juszczyk
for their significant input to design and development and all testbed-related activities •
Eduard Escalona
,
Reza Nejabati
for their support and the gateways development Grid Middleware and Application team •
Bjorn Hagemeier
and
Karl Catewicz
for their support with the UNICORE6 and KoDaVIS integration •
Adam Zawada
for his involvement and hard work on the DDSS demonstration TERENA Networking Conference 2009, Malaga, Spain
Summary
Currently, the Open Source G Ethernet •
The stack is extendable
2 MPLS protocol stack supports the representatives from three main technology areas: LSC, FSC and : quick and simple development of the extensions in support of different vendors and equipment • Extensions for
low-cost Ethernet switches
tested has just been developed and PHOSPHORUS G 2 MPLS is backward compatible with • • Provides
ASON/GMPLS „legacy” ASON/GMPLS transport services and procedures
This compliance fosters the possible integration of Grids in operational and/or commercial networks G 2 MPLS allows to run any kind of applications, even not bridged by Grid Middleware. It is possible to connect the application directly to the network through G.OUNI, bypassing existing gateways developed for UNICORE •
Corba interfaces
allow easy G 2 MPLS framework
plug&play
of external applications in the TERENA Networking Conference 2009, Malaga, Spain
Thank you. Questions?
Bartosz Belter [email protected]
TERENA Networking Conference 2009 Malaga, Spain, June 8 th – 11 th 2009