Transcript Networking updates

FRGP/UPoP/National
Updates
Colorado CIO
Council
11/1/11
Marla Meehl
Acronym soup
 University Corporation for Atmospheric Research (UCAR;
http://www.ucar.edu)
 National Center for Atmospheric Research (NCAR)
 Front Range GigaPoP (FRGP)
 UCAR Point of Presence (UPoP)
 Bi-State Optical Network (BiSON)
 Local Area Networking (LAN), Metropolitan Area
Networking (MAN), Wide Area Networking (WAN)
 Regional Optical Networks (RONs)
 Questions and discussions throughout please – and as
for acronym soup ingredients, please ask if I miss one or
check a decoder page at http://bit.ly/acronym-soup
Reviews and updates
 Front Range GigaPoP (FRGP)
 UCAR Point of Presence (UPoP)
 Bi-State Optical Networking (BiSON)
 National networking activities
 WRN
 Internet2
 NLR
 XSEDE
 The Quilt, Inc.
 Others/misc
Front Range GigaPoP (FRGP)
 11 years of operation by UCAR Network
Engineering and Telecommunications
Section (NETS)
 13 Members
 Ithaka left
 ARTSTOR became UPoP member
 Internal UCAR audit in progress
 http://www.frgp.net
Front Range GigaPoP (FRGP)
 Increasing traffic
 Level3 (2Gbps/10Gbps), TeliaSonera (TSIC) (0Gbps/10Gbps)

Dropped Century Link (Qwest) service effective 10/8/11 due to cost and only 1Gbps
 TransitRail (TR)/Commercial Peering Service (CPS)
 Moving all TR/CPS to I2 pipes out of Kansas City and Seattle
 Akamai Peering – continuing to grow; looking at going from 2Gbps to 4 or
10Gbps
 8 members connected at 10Gbps
 1 planned
 DYNES with CU Boulder – pending hardware late 2011
 Merged I2, NLR, and ESnet VRFs so all FRGP/UPoP get all these services
 Installed ADVA BiSON switch and Cisco 4900 switch at 910 15th to make it a
full collocation facility
 Jeff Custard attending Colorado Broadband Round Table" meetings on
behalf of FRGP/UPoP
FRGP members













Colorado School of Mines
Colorado State University System
National Oceanic and Atmospheric Administration (NOAABoulder)
State of Colorado
United States Antarctic Program
University Corporation for Atmospheric Research
University NAVSTAR Consortium (UNAVCO)
University of Colorado Boulder
University of Colorado Colorado Springs
University of Colorado Denver
University of Denver
University of Northern Colorado
University of Wyoming
FRGP and WRN
 Western Regional Network (WRN): a multi-state
partnership to ensure robust, advanced, highspeed networking availability for research,
education, and related uses through the sharing
of network services
 Expansion and sharing of network services in
support of advanced research and operations
 Support of academic, economic development,
and inter-regional services
WRN members
 Pacific Northwest GigaPop (PNWGP)
 Front Range GigaPoP (FRGP)
 The University of New Mexico (on behalf of the
State of New Mexico)
 Corporation for Education Network Initiatives in
California (CENIC)
 University of Hawaii – pending
 http://westernregional.net/
WRN states
 Increased potential for shared applications
among communities across the west—
networking services to the following states:
 Alaska
 California
 Colorado
 Hawaii
 Idaho
 Montana
 Nevada
 New Mexico
 Washington
 Oregon
 Wyoming
WRN for FRGP
 Intra-region peering
 NLR and Internet2 services shared and backed-
up
 Back each other up (provide diverse layer 2 and
3 to cover on-net failures)
 Efficient and cost-effective TR/CPS
 Potential place to land for-profits from CTN,
EAGLE-Net, US-UCAN, others?
UPoP
 UCAR Point of Presence
 http://upop.ucar.edu
 4 years of operation
 21 members
UCAR Point of Presence (UPoP) - member and service connection overview
http://upop.ucar.edu
2011-09-06 (JC)
UPoP and
FRGP
members
www.frgp.net statistics
Southern
Colorado Optical
Network for
Education
(SCONE)
UC-Denver colocation
Akamai caching
servers
Rocky Mountain
Internet Exchange
(RMIX - peering)
1200 Larimer Street
Level3 colocation
910 15th Street
Bi-State
Optical
Network
(BiSON)
Level3 colocation
Comcast
(peering)
TeliaSonera
(commodity)
National
LambdaRail
(NLR)
1850 Pearl Street
Level3
(commodity)
Energy Sciences
Network (ESNet peering)
TransitRail/
Commercial Peering
Service (TR/CPS peering)
UPoP and
FRGP
members
Western
Regional
Network
(WRN)
Internet2
UPoP members














ARTstor
Auraria Higher Education Center
Colorado Association of Research Libraries
City of Boulder
City and County of Denver
Colorado Community College System
Colorado Telehealth Network
Community College of Denver
Colorado Department of Higher Education
Colorado Mountain College
Denver Health and Hospital Authority
DIA
EAGLE-Net
EDUCAUSE
UPoP members

Fort Lewis College

Moving to QMOE from PacketRail (went out of business)
Front Range Internet, Inc. (two school districts)
 Metropolitan State College of Denver







2 additional QMOE connections pending
Open Media Foundation
St. Mary's Academy
Science and Technology in Atmospheric Research (STAR)
Institute
University of Colorado Hospital
University Information Systems (UIS)
UPoP – future connections
 Additional school districts
 WICHE - http://www.wiche.edu/
 USAFA
 Frequent discussions with a variety of others
Colorado Telehealth Network
 FCC Rural Health Care Pilot Program (RHCPP)
 Colorado Health Care Connections (CHCC; from
Colorado Hospital Association (CHA))
 Rocky Mountain Healthcare Network (RMHN; from
Colorado Behavioral Healthcare Council (CBHC))
 CTN has FCC RHCPP funding
 CenturyLink (CL) operating network since 6/11
 http://www.cotelehealth.com
 Current list of members available on request
 Internet2 Health Network Initiative:
 http://www.internet2.edu/health/
 NLR: http://www.nlr.net
EAGLE-Net
 Educational Access Gateway Learning Environment
Network
 http://www.co-eaglenet.net/
 BTOP round 2 award received
 Intergovernmental Agency (IGA)
 Rolled out from CBOCES
 Board in place
 Technical Advisory Committee being formed
 Environmental Assessments received summer 2011
 RFIs on the street for fiber opportunities
 Meeting with CDOT on I25 and 36 builds
 Connect all school districts (178) in Colorado
SEGP updates
 Intended to allow expanded access to the Internet2
network for regional education networks
 through sponsorship by Internet2 university members
 State and regional networks connect K-20
educational institutions
 The program began in early 2001 and as of June 2011
there are 39 SEGPs
 Colorado SEGP provides Internet2 services to all
qualified FRGP and UPoP members and costs shared
BiSON partnership
 Bi-State Optical Network (BiSON)
 5 year old partnership between NCAR, NOAA-
Boulder, University of Wyoming , University of
Colorado and Colorado State University
 Goal: create an optical WDM network
connecting Denver, Boulder, Longmont, Fort
Collins, and Laramie
BiSON future plans
 Expand dark fiber plant to include NCAR Wyoming
Supercomputing Center (NWSC)
 Initially at least four 10G circuits will be active
 Expansion to 40G and 100G capability
 Direct connections for High Performance Computing to other
BiSON members also an option
 NOAA NWAVE using BiSON
 CSU and Boulder have 10Gbps waves both directions around
the ring
 UW and CU pending
 CU Boulder to Denver upgraded to 10Gbps
BiSON Capacity
•
System is engineered for 40 individual lambdas
•
Each lambda can be a 10G, 40G, or soon a
100G connection
•
Independent lambdas can be sent each
direction around the ring
•
With a major upgrade system could support 80
lambdas
•
100Gbps * 80 channels * 2 paths = 16Tbps
NWSC
 NCAR Wyoming Supercomputing Center
 http://www.cisl.ucar.edu/nwsc
 Scheduled to be occupied in October 2011
 Certificate of Occupancy received 10/21/11
 Supers RFP out – pending NSF approval - system
delivered 12/11 and open to users 3/12
 NWSC datacenter switch/router RFP out – pending NSF
approval
 BiSON fiber connectivity in progress – north leg in
place and active – south leg due by 11/3/11
Internet2
 Attended Quilt Member Meeting – 4/11 and
10/11
 US UCAN in progress
 Connect Community Anchor Institutions (CAIs)
 100Gbps upgrade to I2 network
 Ongoing discussions with RONs on impacts of
UCAN on RON business and technical models
 http://www.internet2.edu
National LambdaRail (NLR)
 http://www.nlr.net
 Purchased by National Coalition for Health Integration
 Class A members now Class B members
 NLR network upgrade to 100Gbps in planning stage
 Class members control half the capacity – currently 20
north/16 south 10Gbps lambdas
 Still working through details of capacity distribution
 NLR interested in meeting with researchers and health based
entities in Colorado to discuss an oncology network proposal
 Cancer Knowledge Alliance Network (CKAN)
NOAA-WAVE (N-WAVE)
 NOAA building national NOAA research network
called N-WAVE
 Utilizing I2 and NLR 10Gbps lambdas
 Initial sites: NOAA-Boulder, NOAA-DC, GFDL,
ORNL
 Complete
 Secondary sites: Seattle, Florida, Oklahoma
 In-progress
 Used ARRA funds
ESnet
 http://www.es.net/ and http://www.lbl.gov/
 ARRA Advanced Networking Initiative (~$62M)
 100G Prototype Network and Testbed
 DOE scientists are now generating data at the
terabyte scale, and datasets will soon be in the
petabyte range
 LHC: also a very large networking experiment
 Network being constructed on I2/Level3 infrastructure
XSEDE
 NSF funded
 XSEDE is a single virtual system that scientists can use to
interactively share computing resources, data and
expertise. People around the world use these resources
and services — things like supercomputers, collections of
data and new tools — to improve our planet.
 10Gbps network
 Follow-on to Teragrid
 Utilizing NLR 10Gbps FrameNet infrastructure
 https://www.xsede.org/
The Quilt, Inc.
 http://www.thequilt.net
 28 members currently
 Attended 2/11 and 9/11 Quilt Member Meetings
 Non-profit regional network aggregators providing advanced
network services in support of research and education
 Several work groups, lots of tracking, coordination and strategic
planning efforts
 GigU and US Ignite
 Regional Network New Service Roundtable
 FRGP no longer purchases off the Quilt CIS program
 Canceled Qwest 9/30/11
 Purchase Teliasonera via NLR - b/w counts toward Quilt CIS and
NLR/TSIC is an AQP
 Purchase Level3 via WRN - b/w counts toward Quilt CIS
Regional Reports
 A Vision to Connecting to America’s
Future Innovation - Advanced Regional and
State Networks as Key Links to our Broadband Future
 9/30/11
 Report from Envisioning the Future of Advanced Regional
and State Networks in the Broadband Era
 Key points






Broadening the collaboration among ARNS to provide
coherence for users
Developing sustainable and coordinated funding models
Strengthening the partnership and alignment between ARNs
and national organizations
Expanding the leadership and coordination roles of the National
Science Foundation
Increasing collaboration on new and advanced services
Joining forces to inform policy makers at the state, regional, and
national levels
Regional Reports – Cont’d
Research & Education Networks from
a Regional Optical Network
Perspective in 2011:
Wrestling with Expanding
Expectations
Quilt Paper
 Peter O’Neil
 September 14, 2011
Regional Reports – Cont’d












Over the next several years it will be interesting to observe how RONs balance adapting to the disparate networking needs from
a much more diverse spectrum of CAI users. How will the RONs mission, organizational form, staff size and degrees of
specialization, governance, culture, and financial stability evolve over the next five years? What will be the impact on RONs of
assimilating large numbers of new members in a relatively short period of time?
Will RONs develop a scalable way to address CAI needs in house or view many of the functions as one time and outsource
them?
Perhaps it is now prudent for RONs to explore opportunities for new collaborations with the CLECs and telecommunication
carriers in their region as one approach to co-existing and minimizing retaliatory actions.
Considerable effort is spent documenting workflow processes and adding data to steps coupled to algorithms to complete
individual portions. These workflows are sometimes referred to as data driven applications. Such applications can create new
value and are considered products of one kind or another. The question for RONs is how can you use data sets from multiple
sources to add value for your community of users?
To what extent are RONs in control of their own destiny any longer? To what degree would RONs naturally reach out to CAIs
and those community based networks starting to emerge?
What does this new environment mean for the classical three level R&E networking community of backbone, regionals, and
campuses?
What is the proper role for RONs in this new context? Should RONs be involved as a leader in each initiative, a partner, or
perhaps remain on the sideline for some? What criteria will be used to assess the potential tradeoffs of each role?
Five to ten years from now, what form of analysis will we use to look back at the choices made and how the consequences of
those decisions play out? There is an increasing set of expectations and visibility placed on RONs that require new adaptations
and adjustments to survive and remain relevant without as much time to consider what is best before action is necessary.
As I2 and NLR reinvent their missions, organizational structures, network offerings, and pricing models, how will each find
ways to align with RONs?
How should we be thinking about the role of RONs and networking today? Innovation, breadth of networking to those who have
not enjoyed broadband to help promote economic revitalization? Meritorious application needs of high end researchers? A
combination of both? How can we build effective RON organizations to accomplish both functions well? The choices and
decisions we make are significant even if we do them in a pressured way with lots of constraints involving funds and lack full
information.
What produces a healthy mix of services in a RON while recognizing a range of differences and some disparities amongst Quilt
members? How can we produce effective change to enhance the health of US networking? US R&E networking is intimately
involved with the assumptions about how US science policy will be implemented. How we participate in such conversations is
critical in policy debates.
What standards do we have as RONs? Are there a set of best practices we can hold ourselves and our peers to?
Recent Regional Activities
 In July, Access Wisconsin, filed a lawsuit against WiscNet, University of
Wisconsin Board of Regents, CCI Systems and the state Department of
Transportation to stop the Building Community Capacity through
Broadband project. The case was heard in court yesterday and the judge
ruled in our favor, denying the injunction requested by Access Wisconsin.
 The Administration of Louisiana Governor Bobby Jindal (R-LA) has triggered
the termination of an $80.596 million broadband stimulus project by the
U.S. Department of Commerce. The Louisiana Broadband Alliance (LBA)
project was slated to support the major academic institutions of the state
with expanded optical fiber networking capacity, and to provide middle
mile 'big pipes' to numerous unserved communities in rural areas.
 http://www.stimulatingbroadband.com/2011/10/jindal-administration-
triggers-largest.html
 The scenario behind the termination is strikingly similar to that carried out in
February by the administration of Jindal's fellow Republican Governor,
Wisconsin's Scott Walker when the latter returned a $22.978 million BTOP
award. Both administrations chose to turn back federal capital monies
awarded for state construction of state university owned network
facilities in favor of using private carrier leased lines for academic network
expansion.
FCC’s USF and Intercarrier Compensation Reform Decision
 The FCC approved major changes to the Universal Service Fund
(USF) and the Intercarrier Compensation regime October 27,
2011. This decision will transform the way that the FCC distributes
about $4.5 billion in annual subsidies for telecom services in rural
areas and will, over time, reduce to zero the amount that one
telephone carrier pays to another for exchanging traffic.
 Affects High-Cost Fund ($4.5B);
 Over several years and in two phases, the FCC will shift the funds
from the current High-Cost Fund into a new Connect America
Fund (CAF), which will focus on subsidizing broadband networks
for homes, businesses and community anchor institutions in areas
that would not otherwise have broadband.
 For the first time, the FCC will also create a new Mobility Fund
(under the CAF) for mobile broadband in rural areas.
 In the fall of 2012, there will be a nationwide “reverse auction” for
an immediate $300M in subsidies to build 4G wireless broadband
in unserved areas.
Discussion
 Any follow up questions or feedback on items
covered?
 Other items?
Thank you!