Transcript Optical Switching for the OptIPuter Project TeraBurst Networks, Inc.

Optical Switching for the
OptIPuter Project
TeraBurst Networks, Inc.
1289 Anvilwood Ave., Sunnyvale, CA 94089
www.teraburst.com
(408) 400-4100 or (866) TERABURST
LambdaGrid Backbone of e-Science Network
Apps Middleware
Clusters
Dynamically
Allocated
Lightpaths
Switch Fabrics
Physical
Monitoring
C
O
N
T
R
O
L
P
L
A
N
E
Source: Joe Mambretti, NU
Cited: L. Smarr, 10-4-02
Protocol-independent
lambda switch
with intelligent control
Comparison of Optical
Switching technology
Optical Switching
OptIPuter Switching
Granularity
Optical Switching
Granularity
VT1.5
Optical Switching
Technology
OEO
(Digital/
Opaque)
STS-1
OEO
(Digital/
Opaque)
Wavelength
?
Wavebands
& Fiber
OOO
(Photonic/
Transparent)
“Transparent” Optical Switches
Photonic (OOO) Approach
Advantages





High signal bandwidth
High switch density
Bit rate and protocol independent
Low latency
Small footprint
Issues
MEMS switch
MEMsswitch
fabric
Add/drop traffic
Add/drop traffic
–
–
–
–
No performance monitoring
No signal regeneration
No wavelength conversion
High insertion loss
Complex link engineering
“Opaque” Optical Switches
Digital (OEO) Approach
Advantages
Rx
Tx
Rx
Tx
Rx
Tx
Rx
Tx
Rx
Tx
Rx
Tx
Rx
Tx
Rx
Tx




Performance monitoring
Retime, reshape, retransmit
Wavelength conversion
99.999% availability
Issues
–
Fixed switch capacity
•
Digital
Fabric
Add/Drop
Add/Drop
Traffic
Traffic
–
–
–
–
Port count reduces with increased data rate
Max b/w per channel 2.5 Gbps
Protocol dependent fabric
Large footprint
High power consumption
No multi-protocol support
INFLEXIBLE
The TeraBurst Approach
Switching devices are ANALOG & passive
IP
GBE, 10 GigE
Fibre Channel
SONET
Rx
Tx
Rx
Tx
Rx
Rx
Line
rate
Tx
Tx
Rx
Tx
Rx
• Inexpensive alternative to OEO/OOO
Tx
Rx
Rx
• Broadband (up to OC-768)
Electrical
Analog
Switch Fabric
Switching fabric is
• Bit-rate and protocol independent
Tx
• Switching at line-rates
Tx
• System-level switching speed ~ 2 ms
Transparency in switch fabric
Redundant
Add/drop
traffic
Add/dro
p traffic
“TRANSPARENT”
ELECTRICAL
T E C H N O L O G Y
• Low latency
• High bandwidth
OEO technology with the speed and bit
rate independence of OOO technologies
Optical Switch Deployment
Considerations
Optical Switch Deployment
Considerations
1. System Performance
• 3R Regeneration
2. Link Engineering Considerations
• In point deployments: - location of devices and distances to them
• In network deployments: - location of next O/E conversion for 3R regeneration
3. Interconnecting Rings/Other Networks
• Compatibility of transport protocol in adjacent networks
• Demarcation point for fault isolation
4. Add/Drop Traffic Requirements
• Compatibility of OOO and OEO switches to flexible traffic patterns
5. DWDM Interworking Issues
• O/E costs – at network level depend on availability of inexpensive optics
• Parallel optics considerations
Flexibility
Cost
System Performance
Signal Regeneration
OOO
Switch
OOO
Output optical eye
OEO
Input optical eye
Switch
OEO
Output optical eye
“Transparent” Optical Switches
Photonic (OOO) Approach
OOO
OOO
3
1
OEO
2
•
Incoming (red) can be switched to 1,2 or 3
•
Loss in switch (6 – 10 dB) & fiber (attenuation)
•
‘2’ may be too long  bit errors
•
‘3’ is shorter, but no O/E at end  bit errors
OEO
Need to engage in LINK ENGINEERING
Network planning/protection complexities and inflexible design
Optical Switch Issues
Photonic (OOO) Approach
Network #2
Network #1
Optical
Switch
•
No clear demarcation between different networks (difficult to troubleshoot and
perform fault isolation)
•
FEC schemes might be different in both networks (different DWDM systems use
different FEC schemes)
•
Different DWDM systems also use different techniques to communicate with
each other (e.g. overhead bytes)  incompatible with others
Network planning complexities and inflexible design
Optical Networks
Using Intelligent Optical Switches
A
B
C
D
Provision paths through
the network using optical
switches
E
•
•
Add/drop traffic (e.g. at ‘E’)
•
Pass-thru traffic and ‘added’ traffic have different power levels with different
distance capabilities with OOO (need power leveling)
•
With OEO: no difference between pass-thru and added traffic
Protection paths are inefficient with waveband switching
Network planning complexities and inflexible design
DWDM/Switch inter-working
(Physical layer issues)
O/E
O/E
DWDM
TX
DWDM
OEO
TX
RX
RX
At 10 Gbps: Several inexpensive optical interfaces (O/E)
1.12 channel parallel (850nm)
2.Serial (1310nm)
3.4 channel parallel (850nm)
4.Serial (850nm)
MSAs for form, fit, function
Attractive pricing
Interoperability straight-forward
DWDM/Switch inter-working
(Physical layer issues)
O/E
O/E
DWDM
DWDM
OOO
RX
Power (dBm)
TX
Loss thru’
OOO
Laser
Diode
Serial VSR for SMF
10 Gbps serial link
PIN
Diode
- special implementation for OOO switches
- few vendors only
- pricing unattractive
- “universal” VSR interconnect
OOO switches
Can’t handle
parallel optics
DWDM/Switch inter-working
(CapEx issues)
Power $
VSR
OOO
•
OOO switches require higher
SR
OEO
•
OEO switches require only SR/VSR
interfaces on DWDM systems
power lasers on DWDM
systems to compensate for high
insertion loss through fabric
•
CapEx savings on SR/VSR
interfaces compensate for O/E cost
Switched Optical Network
(Ref: L. Smarr, 10-4-02)
Portland
CENIC/Carrier POP
Seattle
UCD
Carrier OpAmp Site
Backbone Carrier Fiber
UCD Med Ctr
Sacramento
UC
B
Optional Carrier Fiber
Emeryville
LBN
L
UCSF
Mission Bay
Stanfo
rd
SLA
C
Campus-MAN Demark
San
Francisco
LLN
L
Palo
Alto
Denver
NASA
Ames
Campus Network MPOE
Resear
ch Park
Sunnyvale
UCSB
Campus Fiber
CalTech
UCLA
Campus
JPL
Last Mile Fiber
Santa
Barbara
Los Angeles
818 W 7th
Future Last Mile Fiber
Backbone 10Gig 
UCR
USC
Pacific Light Rail 10G 
Anaheim
Santa Fe
ISI
UCI
Qwest SD
UCSD
SDSC
Thornton and
VA Hospitals
4 Miles est.
SPAWAR
Pt Loma
1.5 Miles
est. SDSU
Hillcrest
Hospital
Logical Optical Switch locations
Issues: DWDM interworking, signal
regeneration, compatibility of protocol,
demarcation point for fault isolation, link
engineering issues between various paths
TeraBurst’s Optical
Switch Products
Hardware platforms
Transparent OEO Optical Switches
Enterprise
Metro
Core
OMS Link
OMS 2100
OMS 2200
OMS 3100
20 ’s
64 ’s
IQWorx EC
256 ’s
IQWorx EC
IQWorx OS: GMPLS control plane
IQWorx EMS and IQWorx SNMS
Provisioning, protection/restoration
IQWorx Tools: Simulation,
Optimizing and Planning
(future)
1024 ’s
IQWorx EC
OMS Optical Switch Features
OMS 2100
OMS 2200
OMS 3100
Capacity
200 Gbps
640 Gbps
2.56 Tbps
Scalable to
800 Gbps
2.56 Tbps
10.24 Tbps
Switch Size
20 x 20
64 x 64
256 x 256
Footprint
1/3 Rack
1/2 Rack
1 rack
Power
Less than 50% of comparable solutions
High-availability architecture
•
99.999% availability
•
No single point of failure
•
Redundant sub-systems
•
Protection switching
OMS 2100
OMS 2200
OMS 3100
Optical interface cards
“any card in any slot”
< 2.5 Gbps protocol independent
(1G FC, 2G FC, OC-3 to 48, 1GbE)
10 Gbps protocol independent
(10 GbE/Lan/Wan, OC-192 SR)
Protocol specific
(e.g. Short and long range)
OC-3, OC-12, OC-48 (SR)
OC-48 (LR, 80 km, ITU)
OC-192 (SR)
OC-192 (LR, 80 km, ITU)
Optical
Electrical
Optical
RedundantSwitch
Fabric
Line Card
RF
Line Card
RF
Line Card
RF
Switch
Fabric
RF
Line Card
RF
Line Card
RF
Line Card
Control System and Software
• Future technologies accommodated
by line card change
• Switch fabric is future proof
System Availability and Downtime
Subsystem
Availability
Downtime
Switch fabric
1-5.7E -6
2.99683
Digital Subsystem
1-1.21E -9
6.35E-4
Mechanical
System
1-7.2E -11
99.99943
3.78E-5
2.99750
•
•
•
Availability analysis of switch devices
MTBF of other components from suppliers
Telcordia TR-332 Reliability Prediction Procedure
Assumes MTTR of 8
hours for switch & 4
hours for DSS
Minutes/year
Operational Cost Savings
For 2.56 Tbps capacity
% Space consumption
% Power consumption
100
100
80
80
60
60
40
40
20
20
0
0
TeraBurst
(OEO - transparent)
OEO (opaque)
TeraBurst
(OEO-transparent)
• 85% power savings,
• 87% rack space savings
OEO (opaque)
Scalability and Pricing Advantage
Port Count
512
256
Transparent
128
64
Opaque OEO
32
16
OC-48
OC-192
OC-768
Data rate (per channel)
% List Pricing (SYSTEMS)
Note: all prices are LIST for a 256 channel system
Source for OEO/OOO pricing: RHK report: 12/01
100
80
60
40
20
0
• No change in port count
with increase in data rate
OC-48
• Any protocol
List Prices have eroded since 12/01
Percentages have remained the same
OC-192
TeraBurst’s Optical
Switch Products
Software, Management Systems
Element Controller
Alarm Monitoring
Traps
TCP/IP
• Current Alarms
• Historical Alarms
• Event Info
• Synchronization
• Automatic
• Manual
• Missing Alarms
• Out-of-Order Alarms
• Process Duplicates &
Clears
• Alarm Operations
Web/Applet
Network Element Management
• 2-3 clicks away
• User-selectable
–Topology
•Zoom in/zoom out
•Navigation
•
•
•
•
•
Add / Remove / Edit
NE auto-discovery
NE heartbeat monitoring
NE Configuration
Shelf View
–Map types
•svg,gif, jpeg, png
•Transparent views
•Drop down menus
–Drag and drop
End-to-End Provisioning
•
•
Path Provisioning
Topology
•
•
•
•
•
Import
Export
Download
Algorithms
• Base-line
• Min-Blocking
Cost Functions
•
•
•
•
Dynamic
Least Cost
Shortest Distance
Min Hops
Protection & Restoration
OMS V2O
Linear 1 +1
IP Router
ADM
Ring protection
ADM
ADM
ADM
ADM
Mesh restoration
TeraBurst
OMS
< 50 msec
Taking Advantage of Algorithms
(GMPLS Control Plane)
NNI
NMI
E-NNI
IQWorx
SNMS
UNI
1. Unique routing and restoration for mesh networks
2. Enables:-
• Differentiated classes of service
• Dynamic bandwidth on demand
Innovative signaling that is standards-based but enables
us to take advantage of our unique routing algorithms
Standards-based control plane
(ITU)
(IETF/OIF)
G.8070
ASTN
 Signaling
• RSVP-TE extensions – passed WG
Last Call
G.8080
ASON
OIF UNI
G.7713
Signaling
• CR-LDP extensions – passed WG Last Call
 Link Management
G.7715
Routing
• LMP – 2nd WG Last Call
 Routing
G.7713.1
PNNI
G.7713.2
RSVP
G.7713.3
CR-LDP
GMPLS
• OSPF & IS-IS with extensions – WG drafts
+
Draft
Recommendation
TeraBurst implementation
Minimum blocking
algorithm from TeraBurst
SG15
Consent
Network Planning Tools
Optimized Network
IQWorx
Simulator
New
Topology
Analyzed &
Validated
Existing
Topology
IQWorx
SNMS
IQWorx
Optimizer
Existing
Topology
New
Topology
Simulator
Optimizer
• Provisioning
• Re-optimize existing networks
• Protection and
restoration
• Flexible optimization
Innovative tool-set that utilizes the same
unique routing algorithms
Comparison of Optical
Switching technology
Optical Switching
OptIPuter Switching
Granularity
Optical Switching
Granularity
VT1.5
Optical Switching
Technology
OEO
(Digital/
Opaque)
STS-1
OEO
(Digital/
Opaque)
Wavelength
Wavebands
& Fiber
?
OOO
(Photonic/
Transparent)
OEO
(Transparent)
TeraBurst
Comparison of technologies
FEATURE
Transparent –
Photonic
(OOO)
OpaqueElectrical
(OEO)
Transparent
– Electrical
(OEO)
High bandwidth (not fixed)
X
X
Linearity (line-rate switching)
X
X
Low latency fabric
X
X
Scalable (datarate w/o loss of ports)
X
X
Protocol independent fabric
X
X
Bit-rate independent fabric
X
X
Low Power consumption
X
X
Small footprint
X
X
STS-1 grooming
X
Performance Monitoring (e.g. SONET)
X
X
3R regeneration
X
X
Low insertion loss
X
X
 conversion
X
X
Long range lasers
X
X
For wavelength-level switching requirements, the TeraBurst solution (transparent,
analog switch fabric) combines the benefits of current OEO and OOO technologies
OptIPuter Applications
OptIPuter Applications
Virtual metacomputer =
processors
memory
peripherals
widely
distributed
clusters
large
distributed
data
repositories
very-large
scientific
instruments,
visualization
displays and/or
sensor arrays
OptIPuter will help scientists collaborate on data-intensive
applications including earth sciences and bioscience
motherboard
standard IP
delivered over
multiple
dedicated
lambdas
Wide Area Visualization Solution
(WAVS )
TM
A tool for collaboration from
Scientific Visualization
Typical visualization theater:
- Projection/Screen systems (Barco, Panoram, etc)
- High-end graphics/video server (e.g. SGI, SUN, CLUSTERS)
- Other video switchers, splitters, blenders, etc
No true real-time visual
collaboration tool exists
today for
• 3D stereoscopic video
• High-end graphics
• Long distances
Collaborative Visualization
Challenges of True
Visual Collaboration
 High Bandwidth Video (3D)
– Gbps range
 Integrated Audio, Data
Oil/Gas
Bio-Medical
– Synchronized with video
 High-Fidelity Video Reproduction
– High end applications
 Latency
Automotive
University
Military/Govt.
Aerospace
– Must be low (less than few hundred msec)
 Global reach
– Intercontinental connectivity
Wide Area Visualization Solution
(Requirements for collaboration)
Real Time 3D stereo –
graphic collaboration
Data
Security
1. Video
– RGBHVS
1280x1024 pixels with 8 bit color
Hardware
Independent
Transmission
Reliability
– Stereographic
96Hz (48 frames/sec each eye)
= 3.01 Gbps
Remote
Control
Application
Independent
2. Audio (Industry Standard)
3. LAN (10/100 Ethernet)
4. Keyboard/mouse control
Single Data
Locations
Low Latency
(Wide Area)
Single channel / synchronized signal
Standard telecom transport protocol
TeraBurst’s WAVS Solution
Audio
LOCAL
LAN
OC 48
V2O
Video to optical interface
GLOBAL
OMS 2100
Optical switch
(SONET/
SDH)
Video (RGBHVS)
Yes
Few, H-W based
Application
Independent
No
Several, S/W based
Short
Few, S/W based
Distance
Long
The V2O System
Red Video
Green Video
Blue Video
Blue Video
Green Video
Red Video
Bi-directional 10/100 LAN
OC-n
Audio
OPTICS
V Sync.
H Sync.
Stereo Emitter
V Sync.
H Sync.
Stereo Emitter
Configurations
Single database, dual projector system– up to 10 km
Local
Remote
SINGLE FIBER
CONNECTION
Server
V2O
Local mouse
Audio over optics
Video over optics
Analog electrical
Remote control
= video switch
V2O
• 10 km separation
• 1310nm single-mode optics
• Single database – 2 viewing locations
Microphone
Remote mouse
Configurations
Multiple databases, multiple projector systems – public networks
Network Access Point
Carrier A
Carrier B
Carrier C
V2O
Public Network
V2O
OMS 2100
Chicago, Ill
V2O
V2O
V2O
DWDM
San Diego, CA
OMS 2100
Austin, TX
Interconnecting Visualization Centers over the Public Network
Proven Interoperabilty
Servers
Graphics
Rates
SGI
Infinite Reality 2,
Infinite Reality 3
1024 x 768 @ 96 Hz
1280 x 1024 @ 60 Hz
1280 x 1024 @ 72 Hz
1280 x 1024 @ 96 Hz
SUN Microsystems
Creator 3D
Expert 3D
Elite 3D & XVR
1280 x 1024 @ 67 Hz
1280 x 1024 @ 76 Hz
DWDM
Rates
Comments
Hitachi Telecom
OC-48, OC-192
Long Haul
transmission
Cisco ONS 15540
OC-48
Metro transmission
Projection
Systems
Type
Comments
BARCO
909, 1209
Customized
Panoram
Technologies
GVR-120E
Briefing Center
10 – 100 people
V2O Showcase
66 Km fiber
From COX
V2O
Projector
V2O
Projector
San Diego Supercomputing Center
San Diego State University
5 Km
Scripps Institute
Of Oceanography
University of California, San Diego
Featured on ABC syndicated show “BUSINESS NOW”
V2O Long Range Test
(18,000 km)
REMOTE
LOCAL
LAN
Hitachi DWDM
(AMN 6100)
V2O
4
Line Amplifiers
1
Optical Switch
(OMS 2100)
REMOTE
Hitachi Mux’
(AMN 7100)
LAN
Audio
V2O
LOCAL
18,000 km of fiber
3
2
(loop back of 6000 km spans)
LATENCY,
 Jitter (SONET spec)
 Application layer tests
V2O Performance
Latency over global distances
~ 400 ms
_______
Milliseconds of latency
36
OMS 2100 switch
V2O system x2
Other equipment
Light propagation
<150 ms
____
~100 ms
____
<1
36
<1
36
60
50
15
3000
125
<250 ms
_______
<1
36
100
90
240
30
6000
18000
Kilometers of fiber
48000
Public Network
Customer Experience
1.
Successful trials of OMS 2100/2200
• Cox Communications (San Diego),
• Telx (Collocation, 60 Hudson Street, NY)
2.
Interoperability with DWDM vendors
• Hitachi Telecom AMN 7100, Sorrento Networks Gigamux, Cisco ONS 15540
3.
Installation
• UCSD, Telx, ARL (SC 2002 show)
4.
V2O trials at several sites
• UCSD, University of TX Austin, OIL/GAS supermajor, Army Research Labs
5.
V2O showcase viewed by several
• Boeing, Navy, Lockheed Martin, BP, Univ Colorado, Army
6.
CUSTOMER
• Oil/Gas Supermajor - SHIPPING
• Univ. of Texas, Austin
7.
Partners
• SGI, SUN
• Mechdyne, Panoram Technologies
TERABURST NETWORKS, INC.
1289 Anvilwood Ave
Sunnyvale, California 94085
www.teraburst.com
1-866-TERABURST
Thank You