Transcript Document 7467723

Pipefitters BOF
Jeff Boote, Eric L. Boyd, Rich
Carlson, Hyungseok Chung
24 May 2016
Pipefitters BOF
BWCTL: Bandwidth Control (Jeff Boote)
Building a Measurement Framework:
Request and Response Schemas (Eric
Boyd)
“Detective”: Integrating NDT and E2E
piPEs (Rich Carlson)
Wise* Trafview: Flow-based
Measurement and Analysis System
(Hyungseok Chung)
5/24/2016
2
Building a Measurement
Framework: Request and
Response Schemas
Eric L. Boyd, Internet2
Reporting on GGF NMWG Activities
24 May 2016
GGF Network Measurement
Working Group
Hierarchy of Network Performance
Characteristics
Request Schema Requirements and
Sample Implementation
5/24/2016
4
Network Performance
Characteristics Sub-WG
Les Cottrell, SLAC
Richard Hughes-Jones, University of
Manchester
Thilo Kielmann, Vrije Universiteit
Bruce Lowenkamp, College of William
and Mary
Martin Swany, University of Delaware
Brian Tierney, LBNL
5/24/2016
5
Hierarchy of Network
Performance Characteristics
Standard set of network characteristics
Network classification hierarchy
Useful for Grid applications and services
Facilitates portability of all measurements
actually taken
Submitted to GGF
http://www-didc.lbl.gov/NMWG/docs/draft-ggfnmwg-hierarchy-02.pdf
5/24/2016
6
Terminology
Network characteristics are the intrinsic
properties of a portion of the network that are
related to the performance and reliability of
the network.
Measurement methodologies are the means
and methods of applying those characteristics
An observation is an instance of the
information obtained by applying the
measurement methodology.
5/24/2016
7
Relationship between Terms
describes
Network Entity
measures
Network
Characteristic
Measurement
Methodology
Singleton
is a result of
Sample
Observation
Statistical
5/24/2016
8
Describing a Network
Measurement
Two Elements:
Characteristic being Measured
Network Entity that the Measurement
Describes
• Nodes
• Paths
5/24/2016
9
Relationship between Node and
Path Network Entities
Network Entity
Network Path
Endpoint
{Ordered}
Router
Host 2
Host Path
Node
Internal
Node
Switch
Hop
Host
Proxy
5/24/2016
10
Characteristics
GGF Discovery and Monitoring Event
Descriptions (DAMED) WG
 <entity type>.<characteristic>.<sub-characteristic>
Examples
• path.delay.oneway
• path.loss.oneway
• path.bandwidth.achievable
5/24/2016
11
Subset of Characteristics
Characteristic
Bandwidth
Delay
Capacity
Utilized
Available
Achievable
Round-Trip
Jitter
One-Way
Delay
Round-Trip
One-Way
5/24/2016
12
Network Topology
Representation
End-to-end are the common case of host-tohost measurements
Links between between routers and switches
are frequently measured for capacity,
availability, latency, and loss
Nodes may report useful information such as
router queue discipline or host interface
speed
Physical vs. Functional Topologies
Nodes: Hosts, Internal Nodes, Virtual Nodes
5/24/2016
13
GGF Network Measurement
Working Group
Hierarchy of Network Performance
Characteristics
Request Schema Requirements and
Sample Implementation
5/24/2016
14
Request Schema Sub-Working
Group
Mark Leese, Daresbury Laboratory
Nicolas Simar, DANTE
Loukik Kudarimoti, DANTE
Jeff Boote, Internet2
Eric Boyd, Internet2
Matt Zekauskas, Internet2
Dan Gunter, LBNL
Tanya Brethour, NLANR/DAST
Paul Mealor, University College London
Warren Matthews, Georgia Tech
5/24/2016
15
Test / Data Request and
Response Protocol
XML request message
(new request schema)
Client/
Requestor
Interim communication
Receiving
System
XML response message(s)
(existing NM-WG schema[1])
5/24/2016
16
Request Schema
Requirements Document:
http://www.gridmon.dl.ac.uk/nmwg/request_schema_r
equirements-01b.rtf
Schema and Examples:
http://www.hep.ucl.ac.uk/~pdm/nmwg/
XML Spy Documentation
http://www.hep.ucl.ac.uk/~pdm/nmwg/Dante-NM-WGRequestSchema2docs/#element_NetworkMeasurementRequest_Link0
28220C0
5/24/2016
17
What: Measurement/Metric Info
Use DAMED-style name
One characteristic / message
Possible to request multiple statistical
data
Extensible to unsupported statistical
data
Number of Results (Positive real
number or “all”)
5/24/2016
18
Where: Source and Destination
Information
Flexible, allow
• Hostnames
• IP Addreses (IPv4 and IPv6)
• Aliases (e.g. “edge router”), if alias file known to
source and destination
Source Address info required
5/24/2016
19
When: Time Information (1)
Target Time
• Target Time (Absolute Time or “now”)
• Relative negative and positive time tolerances
• Negative time tolerance can be (“infinity”)
Time Interval
•
•
•
•
•
Give Start & End Time
Target Time = Start Time
Negative Time Tolerance = 0
Positive Time Tolerance = End Time – Start Time
Max # Results = “all”
Absolute Time
• Seconds since 1970, XML type, or NTP timestamp)
5/24/2016
20
When: Time Information (2)
Evaluate “now” as late as possible
Testing Interval to Control Timing of
Tests
Specified in Seconds, accurate to
microsecond granularity
5/24/2016
21
How: Test Parameters (1)
Allow either:
NMWG-style Predefined Tags
<packetTypeParam>TCP</packetTypeParam>
Or:
Allow Command-Line Tool Parameters
<sourceParameterString>-c –p 501</sourceParameterString>
<destParameterString>-s –w 1024k</destParameterString>
5/24/2016
22
How: Test Parameters (2)
Maintain Parameter Order
Employ Receiving System Parameter
Defaults
Reject Requests if Required Parameter
Cannot be Supported
Ability to Request Measurement
Parameters
Ability to Set Ranges and Preferential
Order for Tool Parameters
5/24/2016
23
Other (Non-)Requirements
Desirable: Ability to add Custon Tags
Non-Requirements: Ability to query
monitoring and data publishing
capabilities
• What network monitoring data available?
• What tools are available?
• What are tool versions?
• What parameters can be used with tools?
5/24/2016
24
Request Schema Example
http://www.hep.ucl.ac.uk/~pdm/nmwg/20
04-01-08-Dante-NM-WGRequestSchema2-examples/Dante-NMWG-RequestSchema2-demo-Iperf.xml
5/24/2016
25
Conclusions
Consensus emerging on network
measurement characteristic definitions
Test/Data Request and Response
Schemas in “Alpha” Form
Future work includes:
• Abstracting commonalities between request and
response schemas into an inherited schema
• Intermediate schemas
• Full-blow “Grid Service” (including Discovery, AA)
5/24/2016
26
5/24/2016
27