Transcript Binding Applications to Networks

Mihai Lucian Cristea, on behalf of SCARIe team
University of Amsterdam
TERENA CONFERENCE ‘10, Vilnius, 1 June 2010

eVLBI on the Grid: SCARIe

Problems when running SCARIe on Grid

Workflow management: WS-VLAM

Experiments

Conclusions
Telescopes
Bring the data from telescopes:
Current: 4x256MBps
Mid-target: 16x1Gbps
Future scenario: 32x4Gbps
Input nodes
Requirement:
constant throughput
Correlator nodes
Output node
Correlator
Result
Software Correlator Architecture Research and Implementation for e-VLBI
Jitter due to network congestion
Telescope
NE
Input node
Jitter due to network
overload at ingress
3
1
Correlator nodes
80%
80%
95%
2
80%
Output node
Correlator

Specific services to applications:
◦ Only the App knows how to optimally use the
resources

Solutions to meet the specific network
demands:
◦ Schedule network resources (e.g., parallelize the
link usage, not only the CPU usage, tradeoffs link
connectivity vs. energy budget)
◦ Application controls the network resources
WS-VLAM
2 Scheduler
Actuator
experiment
1
3
GridBroker
GridBroker
-CPU
-CPU
-Storage
-Storage
WS-VLAM
Profiler
NetBroker
NetBroker
-Topology
-Topology
-Bandwidth
-Bandwidth
4
5
App.4
App.2 App.3
App.1
ACs
0
NEs
Grid N
Grid 1
DAS5
DAS7
10.1.0.29
10.1.0.31
10.1.0.33
10.1.0.x
100Mbps Switch
DAS3
10.1.0.27
10.1.0.28
10.1.0.30
10.10.0.31
10.10.0.29
10.10.0.27
DAS4
DAS6
10.1.0.34
10.10.0.34
10.10.0.33
DAS2
10.1.0.32
Network Broker
IXDP2850
1Gbps
DAS1
10.10.0.32
10.10.0.30
10.10.0.28
DAS8
R3
R4
DAS3
DAS5
DAS7
10.1.0.x
100Mbps Switch
R2
DAS1
10.1.0.27
A
10.1.0.29
B
10.1.0.31
C
10.1.0.33
D
10.1.0.28
10.1.0.30
E
10.10.0.31
10.10.0.29
10.10.0.27
DAS4
DAS6
10.1.0.34
10.10.0.34
10.10.0.33
DAS2
10.1.0.32
Network Broker
IXDP2850
1Gbps
R1
10.10.0.32
10.10.0.30
10.10.0.28
DAS8
W1
W2
W3
W4
Playback Demos:
http://staff.science.uva.nl/~gvlam/wsvlam/demos/wsvlam-dynamic-bw.html
http://staff.science.uva.nl/~gvlam/wsvlam/demos/wsvlam-vlc-demo.html



Close interactions between applications and networks enables
better usage of resources
We support it in Grids by enabling networks as a service
When network resources are not transparent to applications,
the interfaces between sensors, networks, and computational
resources in the Grid can be managed in order to achieve an
optimal interworking