Transcript NOVI Partners VC

FEDERATED VIRTUALIZED INFRASTRUCTURES
AND FUTURE INTERNET RESEARCH:
The NOVI Experience
Vasilis Maglaris
Professor of Electrical & Computer Engineering, NTUA
Chairman, NREN Policy Committee - GÉANT Consortium
[email protected]
NETCLOUD Workshop
IEEE CloudCom 2011
November 30th 2011, Athens, Greece
A FIRE Research Project: NOVI
Networking innovations Over Virtualized
Infrastructures
Virtual
Slice 1
Virtual
Slice 2
• EC FP7 – Cooperation
(DG INFSO-F, FIRE Unit)
g
c
rin es
o
nti e
t
i tur
a
n
em ourc n
Mo itec
S
s
tio
ch
Re crip
Ar
s
De
NOVI
INNOVATION
CLOUD
PlanetLab
Europe
l
tua rce
r
i
V ou g
s
n
Re keri
o
Br
Security Aware Access
FEDERICA
FUTURE INTERNET (FI)
FEDERATED FACILITY
2
ed
rat tion
e
d
a
Fe aliz gies
lo
tu
Vir chno
Te
• 13 Partners (NRENs,
Academic & Research
Institutions, Industry)
• 30 Months (starts Sept.
2010)
Other FI
Platforms,
GÉANT, GENI
The NOVI Consortium
1.
2.
3.
4.
5.
6.
7.
National Technical University of Athens - NTUA (Coordinator, Greece)
Martel GmBH (Switzerland)
Université Pierre & Marie Curie - UPMC (France)
Consortium GARR (Italy)
Universiteit van Amsterdam - UvA (Netherlands)
Fundació i2CAT (Spain)
DFN Verein (Germany)
+ Universität Erlangen - Nürnberg
8. Institut National de Recherche en Automatique et Informatique - INRIA
(France)
9. Eötvös Loránd Tudományegyetem - ELTE (Hungary)
10. Poznan Supercomputing and Networking Center - PSNC (Poland)
11. Cisco Systems International B. V. (Netherlands)
12. Fraunhofer Gesellschaft zur Förderung der angewandten Forschung (Germany)
13. Universitat Politècnica de Catalunya – UPC (Spain)
3
NOVI’s Mission within the Future
Internet (FI) Ecosystem
• FI emerges as a complex ecosystem, offering holistic services to
users over shared federated interconnected platforms.
• NOVI targets innovative research in a bottom-up approach,
addressing a critical area in FI services: How FI users
(including Data Center Managers & Cloud Service
Providers) securely share a multi-domain networking
substrate.
• NOVI aspires to develop a framework (information model, test
tools and algorithms) that will empower FI users to discover,
view, monitor, control and provision isolated/virtualized
networking resources within a federated networking substrate,
thus complementing their distributed storage & computing
service baskets with interconnection-specific resources.
4
NOVI Research Goals
• How to federate different kinds of resources in virtualized eInfrastructures
• How to formally describe virtualized network and cloud objects in a
complex environment, assisted by semantic methods. What
ontologies are best suited to describe resources of different kinds
• How to build combined slices of virtualized infrastructure at the data,
control, monitoring and provisioning planes. How to describe their
relationships and technical attributes
• How to (co-) allocate resources with QoS attributes and how to set up
the monitoring system to allow for accountable, predictable FI
services; multi-domain virtual network embedding
• How to enrich FI experimental platforms (PaaS) with federated models
and methods enabling comprehensive and reproducible experiments
5
The NOVI Information Model Background
Various efforts
form the basis of
the NOVI
Information and
Data Models
6
NOVI Control & Management (C&M)
Architecture – Spiral 1
NOVI C&M
Communication
SM: Slice Manager
AM: Aggregate Manager
CM: Component Manager
Reg: Registry
(MyPLC)
Reg
SFA calls
FED calls
SM
SM
AM
AM
Reg
PlanetLab
FEDERICA WS
CM
FEDERICA
7
Innovative C&M Services
Building on Slice Federation Architecture - SFA
• Intelligent Resource Mapping Service to embed user requests for virtual
network overlays (slices) within the physical substrate.
• Discovery Service able to efficiently discover resources (slivers) based on
their context.
• Resource Allocation Service to instruct Platform Slice/Aggregate
Managers to commit
• Monitoring Service to assess behavior of resources depending on roles.
• Policy Management Service that governs the intra and the inter domain
behavior of the NOVI federation, including role-based user access control.
• Database Service with entities defined within NOVI Information Model
including their semantic attributes.
• Request Handler Service for service & virtual resource requests.
8
NOVI Federated Slice Creation
Generic Steps
1. A user registered in Platform_A requests a combined
slice with slivers (virtual resources) in Platform_A,
Platform_B…. via the NOVI Portal/API
2. The NOVI Resource Discovery Service checks availability
of slivers from Platform_A, Platform_B….
3. NOVI’s Intelligent Resource Mapping Service suggests
intelligent multi-domain composition of user slice
4. NOVI’s Resource Allocation Service instructs
Platform_A, Platform_B… to commit slivers to user
consistent with their local policies
9
Federated Data Plane Connectivity
NOVI Virtual Switch (NSwitch) – Spiral 1
10
NOVI’s Positioning in European &
Global FI Research
• NOVI’s research is aligned with mainstream research efforts in
Europe (EC FIRE Initiative), the US (NSF GENI Initiative), Asia
Pacific (NICT – Japan, CERNET - China, KOREN Korea,
NICTA - Australia...)
• NOVI partners combine expertise from
•
•
•
•
•
Advanced networking platforms (GÉANT, NRENs, GLIF…)
FI experimental facilities (FEDERICA, PlanetLab Europe…)
Advanced industrial solutions in virtualized environments (Cisco Nexus
1000V)
ICT/FI RTD projects (Phosphorus, Manticore, OneLab, Panlab,
GEYSERS, BonFire, G-Lab…)
FI coordination actions (FIRESTATION, FIREworks, INFINITY - FI PPP…)
• NOVI interacts with standardization bodies and disseminates its
findings in scientific events and global FI initiatives; it assists on
developing the FIRE facility at the FIRE Architecture Board
11
Sustainability of FI Experimental Research
• A concern in the times of crisis but FI Research is a high-risk
strategic investment
• Advanced Internet-based e-Infrastructures perceived as
creative commons and a stimulus to recovery: Obama’s
initiative & EU FI PPP…
• Some problem areas:
– Subsidiarity between Federal (EC) & National policies
– Selection of Projects based on periodic peer reviews (spirals), old
boys networks
– Synergies with major vendors (Cisco, Juniper, NEC, HP…) and Cloud
SPs (IBM, Google, SAP...); IPRs & openness
– Emphasis on attracting end-users: EU Living Labs & FIRE Integrated
Projects Open Calls (up to 250 K Euros/year per “user”)
8
Sustainability Factors (1/2)
• Sustainability depends on active endorsement of diverse user
communities (beyond ICT researchers)
• Users need to understand (and appreciate) the benefits and
economic incentives in using multifaceted FI experimental
platforms
• Priorities, requirements and budgetary constraints of users
need to guide planners/providers of FI experimental
platforms (e.g. user-friendly open interfaces, policies for
reproducibility of experiments)
9
Sustainability Factors (2/2)
• FI experimental platforms should attract users by developing –
deploying user friendly tools, based on efficient resource
allocation algorithms (e.g. Virtual Network Embedding),
monitoring schemes (slice and substrate oriented) and novel
information models (e.g. ontologies assisting users to locate
and compose virtualized resources in a distributed FI
environment)
• Operational costs should be assured, required for seamless
infrastructure support (and hardware – software upgrades)
• Well defined SLAs and broadly acceptable pricing models are
required, in line with legacy Service Provider practices
14
Federation is tightly related with Sustainability
The FI will be a shared multi-domain ecosystem where:
•
•
•
Users should be able to run their applications/experiments by
dynamically selecting diverse slivers within a slice (basket) of the
federated FI facility
Federated FI facilities should be able to upgrade their scope by
incorporating additional testbeds, thus attracting a wider user
base: Need for open, scalable federation architectures (bases:
PlanetLab SFA, Panlab Teagle)
Exploit synergies with established advanced R&E e-Infrastructures
should be exploited:
–
–
–
•
In the US Internet2, NLR are used as backbone facilities for GENI
infrastructures – e.g. OpenFlow testbeds, VINI…
In Europe, NRENs - GÉANT can provide support for advanced
connectivity services amongst European virtualized infrastructures
In Asia-Pacific advanced R&E networks provide virtualized platforms,
interconnecting FI testbeds
Plan towards a global federated environment for FI experiments
11
Potential role of GÉANT – NRENs
in the FI Ecosystem
• Provision FI federated platforms (FIRE, FI PPP) with WAN substrate Gigabit+
connectivity at all protocol layers/planes (including Bandwidth on Demand)
& core virtual facilities (systems, logical routers, virtualized data centers…)
• Support virtual resource allocation, scheduling, federated admission
control, roaming AAI & secure operation of isolated communities,
instantiating the concept of Infrastructure as a Service (IaaS)
• Deploy and test early prototype tools to create, monitor and control virtual
resources allocated to FI user communities, towards the Network on
Demand vision
• Complement efforts towards common, context aware descriptions of
heterogeneous virtual networking elements, enabling resource discovery &
provisioning of composite services to meet user demands
• Export NOC functionality to virtual communities to enable scalable
management of virtual resources by stake-holders of federated overlays
16
Virtualization over GÉANT - NRENs
Local Facility A
Local Facility B
NREN
NREN
Federated Services
NOC - Gateway
Internet
GÉANT
NREN
NREN
FIRE Core Facility
GENI Platforms
Local Facility D
Local Facility C
17
Future Internet Experimental Research:
An Opportunity for NRENs
• Requirements:
– Sharing optical backbones & housing for FI experiments
• Emulating real-world conditions
• In isolation from production traffic (slicing, virtualization)
– Interconnection of local testbeds (e.g. OpenFlow, wireless labs)
• NRENs as infrastructure providers & innovation brokers:
– In Europe: FI Private-Pubic Partnership (PPP) & FIRE 
provisioning of NREN – GÉANT facilities (e.g. FEDERICA)
– In the US: GENI experimental platforms  provisioning of
Internet2, NLR, ESnet, RON facilities (e.g. VINI)
– In APAN: SINET (JP), CERNET (CN), KOREN (KR), AARNet (AU),…
18
The GÉANT Service Area
GÉANT COST: 40 M€/year (equally shared
by EC and NRENs)
• Not just the GÉANT backbone
• Federated services via 37 NRENs and
4000+ Campuses to 50 M+ users
Total European R&E Networking Cost:
International (GÉANT) / National (NREN) /
Campus Costs follow the 1/10/100 rule
19
•
GÉANT global connectivity
•AfricaConnect
•GÉANT2
global
connectivity –
February 2009
Key Challenge for NRENs - GÉANT:
A Tsunami of Global High-End Requirements
10 Gig+ NREN – GÉANT Footprint, June 2009
High-End Users (HPC, CERN, ITER,…) require stable production services:
• Provisioning 10-40-100 Gbps networks (DWDM over dark fiber, leased λ)
• Meeting robustness, reliability, security requirements
• Enabling multi-domain e2e monitoring & on-demand hybrid resource allocation
• Managing converging e-infrastructures as a High Performance Computing &
Networking (HPCN) Cloud  Future Internet (FI) Services & Applications
21
Related Public Web Pages
• http://ec.europa.eu/information_society/activities/foi/index_en.htm
(link to EU Future Internet activities)
• http://cordis.europa.eu/fp7/ict/fire/ (link to EU Future Internet
Research & Experimentation activities)
• http://www.fp7-novi.eu/ (link to NOVI site)
• http://www.geant.net/pages/home.aspx (link to GÉANT site)
• http://www.netmode.ntua.gr (link to netmode.ntua.gr laboratory)
22