Transcript Introduction to FEDERICA

WWW.FP7-FEDERICA.EU
FEDERICA
Federated e-Infrastructure supporting research experiments
on new Internet architectures and protocols
Status and Experience
Mauro Campanella - GARR
[email protected]
TNC2010 - Vilnius 1st June 2010
Agenda
WWW.FP7-FEDERICA.EU
–
FEDERICA brief overview, framework & architecture
–
Infrastructure status
–
Service model, reproducibility
–
Initial analysis of users
–
Challenges and conclusions
TNC2010, VILNIUS, 2nd June 2010
2
FEDERICA at a glance
WWW.FP7-FEDERICA.EU
What:
European Community co-funded project in its 7th Framework
Program in the area “Capacities - Research Infrastructures”,
3.7 MEuro EC contribution, 461 Person Months
When:
1st January 2008 - 34 October 2010 (30 months)
Who:
20 partners, based on stakeholders on network research and
management:
11 National Research and Education Networks, DANTE
(GÉANT), TERENA, 4 Universities, Juniper Networks, 1
small enterprise (MARTEL), 1 research centre (i2CAT) Coordinator: GARR (Italian NREN)
Where: Europe-wide e-Infrastructure, open to external connections
TNC2010, VILNIUS, 2nd June 2010
3
FEDERICA
WWW.FP7-FEDERICA.EU
Deploy and manage an e-Infrastructure (FEDERICA) based on
virtualization in both computers and network elements as a
fundamental tool/playground for researchers on current and Future
Internet, its uses and technologies.
It allows researchers a complete control
of their set of resources (a “slice”),
poses a minimum number of constraints and enables disruptive
experiments at all communication
layers over a realistic substrate.
Router/Switch
Host for Virtual
nodes
Particular focus is placed
in reproducibility of the
experiments and
in the avoidance
of complexity.
TNC2010, VILNIUS, 2nd June 2010
4
FEDERICA Framework
WWW.FP7-FEDERICA.EU
The infrastructure requirements brought to 2 key framework
choices for the infrastructure, at the core of design:
1. The simultaneous presence of computing and network
physical resources. These resources form the substrate of
the infrastructure.
2. The use of virtualization technologies applied both to
computing and network resources.
Virtualization will allow creating virtual, un-configured
resources.
Framework is compatible with the Infrastructure as a Service
(IaaS) used in “clouds”, including network layers and it may
offer other services (e.g. Platform aaS and Software aaS).
TNC2010, VILNIUS, 2nd June 2010
5
FEDERICA - Current Architecture
WWW.FP7-FEDERICA.EU
Two levels:
1. The virtualization substrate. The physical infrastructure which contains
all the hardware and software capable to create the virtual resources.
2. The level containing all virtual infrastructures (slices). Each slice
contains a set of virtual resources and their network topology.
Two elementary resource entities:
1. Connectivity. In form of a bit pipe (point to point circuit) with or without
capacity guarantees and with or without a data link protocol.
2. A computing element and its attributes, offering the equivalent of a
computer hardware containing at least RAM, CPU and one network
interface, mass storage is optional. The computing element is capable
of hosting various operating systems and perform also functionalities
(e.g. routing). This differs from some “Clouds” where storage is
considered an independent entity.
TNC2010, VILNIUS, 2nd June 2010
6
Architectural layers (pictorial)
WWW.FP7-FEDERICA.EU
The Resources
Router/Switch
Host for Virtual
nodes
Raw Ethernet
1Gbps (Fiber later)
The first order slices are vertical to indicate that there is no hierarchy
between them. Virtual resources in different slices may be created in
the same physical resource.
TNC2010, VILNIUS, 2nd June 2010
7
Agenda
–
–
–
–
–
WWW.FP7-FEDERICA.EU
FEDERICA brief overview, framework & architecture
Infrastructure status
Service model, reproducibility
Initial analysis of users
Challenges and conclusions
TNC2010, VILNIUS, 2nd June 2010
8
Infrastructure Status
Up and operational (with users)
WWW.FP7-FEDERICA.EU
KTH
SE
SUNET
NORDUN
ET
HEAnet
IE
SWITCH
CH
DFN
DE
PSNC
PL
GARR
IT
CESNET
CZ
Red.es
ES
FCCN
PT
GRNET
ICCS
GR
i2CAT
ES
Hungarnet
HU
All links are 1 Gbps Ethernet
Each PoP hosts one or more large
PC and a network switch/router
TNC2010, VILNIUS, 2nd June 2010
9
FEDERICA Core PoP
WWW.FP7-FEDERICA.EU
Other
FEDERICA
PoPs
Out-Of-Band
Terminal server
INTERNET
GEANT
FEDERICA
V-Node
FEDERICA
V-Node
FEDERICA
Juniper
MX480
BGP
Peering
NREN
Production
Network
Notes:
- Each V-Node has 7+1network
interfaces at 1 Gbps Ethernet
- OOB is not mandatory
Legenda
1 Gbps Ethernet
RS-232
TNC2010, VILNIUS, 2nd June 2010
10
The Core Substrate - HW and IP
Router / Switch: Juniper MX480, Dual
CPU, 1 line card with 32 ports at 1Gb
Ethernet. Virtual and logical routing,
MPLS, VLANs, IPv4, IPv6, 2 of the 4
line cards have hardware QoS packetbased capabilities
V-Nodes: each is a 2 x Quad core
AMD @ 2GHz, 32GB RAM, 7+1
1000/100/10 Ethernet NICs, 2x500GB
disks, VMware ESXi 3.5
WWW.FP7-FEDERICA.EU
Single IP Autonomous System:
AS 47630 :
(public, no transit,
the 4 core nodes peer with local
NRENs which announce the AS to
GN2 and Global Internet) active
IP v4 active
IPv6 (under tests)
NRENs and
Global Internet
FEDERICA substrate
TNC2010, VILNIUS, 2nd June 2010
11
Monitoring: the whole system
WWW.FP7-FEDERICA.EU
G3 system from
CESNET, including
Nagios, enhanced
(e.g. for QinQ).
Monitors all circuits
and nodes (> 50K
entities monitored),
all slices
Dynamic interval
time, usually in
‘relaxed’ mode
(longer delay
between measures)
TNC2010, VILNIUS, 2nd June 2010
12
12
WWW.FP7-FEDERICA.EU
8 CPUs each 1775 MHz = 14,2 GHz
TNC2010, VILNIUS, 2nd June 2010
13
Substrate behavior
WWW.FP7-FEDERICA.EU
Network circuits and nodes can use all available capacity. Systematic measurement
are ongoing and results will be published for the substrate.
TNC2010, VILNIUS, 2nd June 2010
14
Substrate behavior - V-Nodes
WWW.FP7-FEDERICA.EU
The current set-up of the slices ensures there is no overbooking and behaviour
of V-Nodes is stable.
TNC2010, VILNIUS, 2nd June 2010
15
Agenda
–
–
–
–
–
WWW.FP7-FEDERICA.EU
FEDERICA brief overview, framework & architecture
Infrastructure status
Service model, reproducibility
Initial analysis of users
Challenges and conclusions
TNC2010, VILNIUS, 2nd June 2010
16
The basic service model
WWW.FP7-FEDERICA.EU
The FEDERICA basic service is the creation of “virtual
infrastructures” with full user control. It is only lightly dependent on
the underlying architecture.
The project made a choice to have two characteristics of the
service that imply manual intervention in the initial phase of user
access :
- the User Policy Board to accept, register, prioritize and counsel
the users’ proposals (AAI is included here)
- the reproducibility requirement which (up to now) is a manual
mapping from physical to virtual resources. Advanced
brokers / technologies / over provisioning may overcome this
limit (see ongoing work in clouds).
The user receives then full control of the slice.
TNC2010, VILNIUS, 2nd June 2010
17
Virtual to Physical resource mapping
WWW.FP7-FEDERICA.EU
Virtual Internet
The step to map to the
physical resources the
virtual resources has been
chosen to be performed
manually in FEDERICA.
The motivations are:
- ensure reproducibility
when requested
- optimization of the use
of the infrastructure.
TNC2010, VILNIUS, 2nd June 2010
18
FEDERICA versus other projects
Project:
Feature:
Allowed Operating
system
Control of lower
layers
IP
Choice of physical
delay and capacity
reproducibility
guarantees
User access
limitations
Cost
Scalability
WWW.FP7-FEDERICA.EU
Onelab2/
Planetlab
Emulab
FEDERICA
fixed
fixed
User’s choice
(almost any)
No
emulation
control down to
raw Ethernet
Mandatory
used to connect
then emulation
Used to connect,
then not needed
No, unless in SW
emulation
Yes
(up to 1 Gb)
No
emulation
Yes
Almost none,
at any time
Almost none,
at any time
initially regulated by
a User Policy Board
limited
none
none
medium/large
large
medium/limited
TNC2010, VILNIUS, 2nd June 2010
19
Offering “Slices” for “any” Research
WWW.FP7-FEDERICA.EU
Using Virtualization technologies the FEDERICA e-Infrastructure
creates “slices” composed by virtual resources (circuits, nodes,
routers)
The slices are configured
according to users’
requests
Possible use cases:
- new routing protocols
- behavior on the network
of distributed
applications
Global Internet
- Inter-domain
services
FEDERICA substrate (only core is shown)
TNC2010, VILNIUS, 2nd June 2010
20
Reproducibility
WWW.FP7-FEDERICA.EU
FEDERICA ensures reproducibility of the behaviour of a single
virtual resource as a key requirement for quantitative evaluations of
new ideas through experimentation.
As an example, a virtual circuit may not be capable of offering a
constant, fixed amount of bit per second, and a virtual computer
image may not provide a constant CPU percentage and/or a constant
disk access capacity.
The project does not instead aims at providing QoS for sets of
connected resources, or entire slices, as this is a research area still.
Most of the projects/experiments do not request reproducibility in
those cases a ‘good’ resources behaviour is provided anyway (see
next slide).
TNC2010, VILNIUS, 2nd June 2010
21
Reproducibility - How to
WWW.FP7-FEDERICA.EU
The project engineered the substrate so that:
- there is a high level of network physical meshing at 1Gbps
- router/switches perform at line rate
- CPUs assist virtualization in HW
- Each V-Node has
- a large number of physical network interfaces
- at 32 GB RAM (4 GB for each core)
- multiple disks in separate channels
Rules are followed when creating resources(strictly when
reproducibility is requested, preferably in the other cases):
- only one virtual host runs in each core
- RAM is statically partitioned
- Each virtual host receives a dedicated physical network interface
- The circuits are never over-subscribed
TNC2010, VILNIUS, 2nd June 2010
22
Agenda
–
–
–
–
–
WWW.FP7-FEDERICA.EU
FEDERICA brief overview, framework & architecture
Infrastructure status
Service model, reproducibility
Initial analysis of users
Challenges and conclusions
TNC2010, VILNIUS, 2nd June 2010
23
Resource Usage per slice
R < 10:
10 < R < 40:
Feasibility study,
Functionality,
WWW.FP7-FEDERICA.EU
40 < R < 100:
100 < R:
Validation,
Scalability
Resources (R)
Requested
TNC2010, VILNIUS, 2nd June 2010
24
Slice requested time duration
WWW.FP7-FEDERICA.EU
Slice Lease
Time
TNC2010, VILNIUS, 2nd June 2010
25
Motivation of research
–
–
–
–
WWW.FP7-FEDERICA.EU
ICT research on networking
ICT research on applications/services
ICT research on both applications/services and networking
Applied-ICT research on applications/services (eg medecine)
TNC2010, VILNIUS, 2nd June 2010
26
Rationale od the use of FEDERICA
–
–
–
–
Economical:
Opportunity:
Technical:
Federated:
WWW.FP7-FEDERICA.EU
Renting vs. Buying
Exploit large number of resources and/or fast provisioning
Exploit new functionalities
Exploit interconnection of infrastructures
TNC2010, VILNIUS, 2nd June 2010
27
Agenda
–
–
–
–
–
WWW.FP7-FEDERICA.EU
FEDERICA brief overview, framework & architecture
Infrastructure status
Service model, reproducibility
Initial analysis of users
Challenges and conclusions
TNC2010, VILNIUS, 2nd June 2010
28
Research areas (Challenges)
WWW.FP7-FEDERICA.EU
There are a some key challenges for the evolution of the
project and tightly connected to virtualization :
1. “Real” versus “Virtual”, i.e. reproducibility/QoS
2. Virtualization service definition and automation of
procedures, in particular resource mapping.
3. Federation
4. Complexity (virtualization may be recursive)
TNC2010, VILNIUS, 2nd June 2010
29
User Support Challenges
WWW.FP7-FEDERICA.EU
There are key challenges to provide a smooth and easily
accessible service to researchers.
Some lesson learned from experience:
1. The user access should be as simple and convenient as much
possible (reduce formal needs, automate proposal, provide
examples and instruction). Needs substantial programming
effort.
2. Basic tasks should be automated both for the noc and for the
users (circuit and V-Node provisioning, configuration, sample preconfigured nodes, …)
3. Support of research is different from support of a production
environment and more time-consuming (more complex
questions and requests)
TNC2010, VILNIUS, 2nd June 2010
30
Conclusions
WWW.FP7-FEDERICA.EU
For Future (and present) Internet research and evolution, FEDERICAlike infrastructures, enable innovative paths, exploiting virtualization
both in computers and networks.
FEDERICA creates virtual infrastructures, behaving almost like real
ones, which can be seen as generalised, “cloud” infrastructures. The
user access is simple from any place connected to Internet.
Universities, Private Enterprises even schools may benefit from such
ready-to-use environment.
Many challenges and research areas are still to be explored,
analyzed to create a common set of standards.
Virtualization facilitates and draws a smoother path to federation too.
FEDERICA can start federating with other facilities.
TNC2010, VILNIUS, 2nd June 2010
31
More Information
WWW.FP7-FEDERICA.EU
Main source of information is http://www.fp7-federica.eu
(all deliverables and documents, user access portal redirection)
1.
Dae Young Kim, Laurent Mathy, Mauro Campanella, Rick Summerhill, James
Williams, Shinji Shimojo, Yasuichi Kitamura, Hideaki Otsuki, "Future Internet:
Challenges in Virtualization and Federation," aict, pp.1-8, 2009 Fifth Advanced
International Conference on Telecommunications, 2009, Venice/Mestre, Italy, May
24-May 28, ISBN: 978-0-7695-3611-8
2.
P. Sezgedi, S. Figuerola, M. Campanella, V. Maglaris, C. Cervello-Pastor: "With
Evolution for Revolution: Managing FEDERICA for Future Internet Research", IEEE
Communications Magazine Vol.47 No.7 pp. 34-39, July 2009
3.
M.Campanella, "The FEDERICA Project: creating cloud infrastructures", In
Proceedings of Cloudcomp 2009 (CloudComp), October 19-21, 2009, Munich,
Germany. ISBN 978-963-9799-77-6,
4.
M.Campanella, V.Maglaris, M.Potts “Virtual Infrastructures in Future Internet”, in
“Towards the Future Internet - Emerging Trends from European Research”, IOS
press, April 2010, ISBN 978-1-60750-538-9
TNC2010, VILNIUS, 2nd June 2010
32
FEDERICA Consortium
National Research & Education Networks
CESNET
Czech Rep.
DFN
Germany
FCCN
Portugal
GARR (coordinator) Italy
GRNET
Greece
HEAnet
Ireland
NIIF/HUNGARNET
Hungary
NORDUnet
Nordic countries
PSNC
Poland
Red.es
Spain
SWITCH
Switzerland
Small Enterprise
Martel Consulting
WWW.FP7-FEDERICA.EU
NRENs organizations
TERENA The Netherlands
DANTE United Kingdom
Universities - Research Centers
i2CAT
Spain
KTH
Sweden
NTUA (ICCS)
Greece
UPC
Spain
PoliTO
Italy
System vendors
Juniper Networks
Ireland
Switzerland
TNC2010, VILNIUS, 2nd June 2010
33
WWW.FP7-FEDERICA.EU
Thank you
for your attention
TNC2010, VILNIUS, 2nd June 2010
34