SubOptic 2013 Masterclass Tutorial

"OTN & Mesh Networking"

Tuesday April 23, 2013

13:30-15:00

• Chairperson / Moderator:

• Dr Steve Grubb, Fellow & VP Advanced Optical

Development, Infinera

• Participants:

• Antti Kankkunen, Vice President Product Planning, Infinera

• Andy Lumsden, Chief Technology Officer, Pacnet

• Dr Michael Enrico, Chief Technology Officer, DANTE

San Francisco Paris

• Submarine Networks historically considered

only as point to point links

• Service Providers are having to compete in

turning up new international services rapidly

• Rapid restoration and provisioning becoming more critical to service providers

OTN Feature Comparison

OTN Switching

Virtualized optical networking

Meshed based architecture

Rapid Provisioning

Multipath protection

Circuit based management

Maximum Network

Efficiency

OTN Transport

• Pt to Pt architecture

• Client protocol

transparency

• Universal transport

protocol

• OAM&P

Functionality

• 1+1 Protecion

OTN as Percentage of the Market

All Images

and assets

should be

contained within

these boundaries Reduce to here when

there is a title

Source: Infonetics Research, “OTN and Packet Optical Hardware”, 2013

• Chairperson / Moderator:

• Dr Steve Grubb, Fellow & VP Advanced Optical

Development, Infinera

• Participants:

• Antti Kankkunen, Vice President Product Planning, Infinera

• Andy Lumsden, Chief Technology Officer, Pacnet

• Dr Michael Enrico, Chief Technology Officer, DANTE

OTN and Mesh Networking

April 23, 2013

Presenter: Antti Kankkunen

Company: Infinera

Presenter Profile

Antti Kankkunen is VP, Product Planning at

Infinera Corporation (Nasdaq: INFN) and

since 2008 has been responsible for leading

the long term product roadmap development

at Infinera. Antti has more than 20 years of

experience in the communications industry

and has worked in both small startup

companies and large established equipment

providers. He has held senior executive

positions with responsibilities covering

product planning, product strategy,

technology strategy, business development,

product marketing and product development.

He spent 12 years at Tellabs and among

other things held the roles of director of

Tellabs 8100 product line and CTO of Tellabs

International. Antti graduated from Helsinki

University of Technology in 1991 with M.Sc.

in Electrical Engineering.

• Name: Antti Kankkunen

• Title: VP, Product Planning

• Email: akankkunen@infinera.com

What We’ll Discuss Today

• OTN technology overview

• Purpose

• Functional description

• Overhead and payloads

• Multiplexing

• Compare/contrast with SDH

• Adoption and evolution (future)

• Mesh Networking

• Purpose/Mesh topologies

• Functional description of various protection mechanisms

• Efficiency vs. dedicated protection

• Summary

PURPOSE

Purpose of OTN

Replace SDH

• Transport technology with support for rates of 1Gbps - 100Gbps and beyond

Designed for DWDM

• Digital wrapper with FEC for high performance optical transmission

Multi-Service

• Timing and bit transparent transport of any client signal

• Multiplexing and switching for network efficiency

Enhanced OAM and Protection

• TCM

• Linear, Ring and Mesh Protection

Properties of OTN

Most cost efficient

switching technology for

services ≥1Gbps

Transparent services with

low and constant latency

Multi-vendor/carrier

interoperability for all

services: Ethernet,

SONET, SDH, OTN, SAN

G.709 standard OA&M

tools for trouble shooting

and ODUk E2E monitoring

GMPLS Control Plane

enables rapid ODUk circuit

provisioning, protection,

and 50ms restoration

Efficient grooming

minimizes the cost of

optical layer

NxODUk <->

(NxODU4<->

NxOTUk

NxOTU4)

OTN DWDM Transport

OTN Control Plane & OAMP

GMPLS, ASON,

WSON

ODUj

(ODU2)

ODUj

(ODU2)

OTN Switching

ODUj <-> ODUk

(ODU2 <-> ODU3)

OTN Multiplexing

client ODUj

OTN

OTN

OTN

OTN

OTN

OTN Adaption

(10GbE -> ODU2e)

FUNCTIONAL DESCRIPTION

Network View IP Layer – Routers

Links between routers realized via Transport network

IP

Electrical: Client Mapping,

Connection Multiplexing, Switching, Monitoring, Protection/Restoration

OTN

DWD

M

Optical Layer:

Add/Drop, Express, Protection/Restoration

OTN Adaptation

• Service–agnostic digital wrappers

• End-to-end bit and timing transparency

• 1Gb/s to 100Gb/s clients mapped into OTN

containers

• Higher rates (400Gb/s, 1Tb/s, ...) will be

accommodated as new client interfaces emerge

Properties

Adaptation

Non-OTN

client ODUk Non-OTN

client

NxODUk <->

(NxODU4<->

NxOTUk

NxOTU4)

OTN DWDM Transport

OTN Control Plane & OAMP

GMPLS, ASON,

WSON

ODUj

(ODU2)

ODUj

(ODU2)

OTN Switching

ODUj <-> ODUk

(ODU2 <-> ODU3)

OTN Multiplexing

client ODUj

OTN

OTN

OTN

OTN

OTN

OTN Adaption

(10GbE -> ODU2e)

Common Transport Layer for All Services

OTN Switching

1 2 3 4

1 2 3 4

2 4

1 3

1 3

2 4

2 4 1 3

1 3 2 4

ODUk Switching with 1.25Gb/s granularity Properties • Typically ~1Tb/s – 5Tb/s today with scalability to

Nx10Tb/s in the future

• Fully non-blocking

• Often with Integrated DWDM

• 1.25Gb/s (ODU0) granularity optimized for 1Gbps

and higher rate services

NxODUk <->

(NxODU4<->

NxOTUk

NxOTU4)

OTN DWDM Transport

OTN Control Plane & OAMP

GMPLS, ASON,

WSON

ODUj

(ODU2)

ODUj

(ODU2)

OTN Switching

ODUj <-> ODUk

(ODU2 <-> ODU3)

OTN Multiplexing

client ODUj

OTN

OTN

OTN

OTN

OTN

OTN Adaption

(10GbE -> ODU2e)

Switching = Network EFFICIENCY

* In addition to multiplexing into OTN DWDM Line-side

OD

U3

O

H

ODU3

OTN Multiplexing O

DU

2e

OH

10G

ODU2 muxed into

ODU3

OD

U2

O

H 10G

OD

U2

O

H 10G

2nd ODU2e muxed into

ODU3 OD

U1

O

H 2.5G

ODU1 muxed into same

ODU3

OD

U1

OH

2.5G O

DU

2

OH

10G

OTN Multiplexing • G.709 defines multiplexing of LO ODUj into HO

ODUk (j<k; j=0,1,2,2e,3,flex; k=1[j≠flex],2,3,4)

• Typically 1 or 2 stages of OTN multiplexing

• ODU0 -> ODU4

• ODU0 -> ODU2-> ODU4

• Enables use of high-speed interfaces for lower

speed services

NxODUk <->

(NxODU4<->

NxOTUk

NxOTU4)

OTN DWDM Transport

OTN Control Plane & OAMP

GMPLS, ASON,

WSON

ODUj

(ODU2)

ODUj

(ODU2)

OTN Switching

ODUj <-> ODUk

(ODU2 <-> ODU3)

OTN Multiplexing

client ODUj

OTN

OTN

OTN

OTN

OTN

OTN Adaption

(10GbE -> ODU2e)

EFFICIENT Aggregation of Services to Fully Fill Wavelengths

OTN DWDM Transport Properties

• Typically 8Tb/s – 9.6Tb/s per extended C-band.

• All Long Haul DWDM systems are based on proprietary OTUkV

format (proprietary FEC mechanisms and coherent detection

algorithms). There is no line side interoperability.

• PM-QPSK with 2bit/s/Hz spectral efficiency dominates terrestrial

applications

• In subsea applications special formats with spectral efficiencies in

the range 1bit/s/Hz – 3+bit/s/Hz (PM-BPSK – PM-8QAM, <50GHz

spacing)

NxODUk <->

(NxODU4<->

NxOTUk

NxOTU4)

OTN DWDM Transport

OTN Control Plane & OAMP

GMPLS, ASON,

WSON

ODUj

(ODU2)

ODUj

(ODU2)

OTN Switching

ODUj <-> ODUk

(ODU2 <-> ODU3)

OTN Multiplexing

client ODUj

OTN

OTN

OTN

OTN

OTN

OTN Adaption

(10GbE -> ODU2e)

Multi-Terabit SCALE

OTN Control Plane & OAMP

Digital processing at every OTN node

Digital OAM • OTUk PM • ODUk PM • Service interface PM

• TCM

Topology Auto-Discovery

Auto-Provisioning

OTN Control Plane & OAMP • G.709 defines enhanced OAM tools based on

SDH OAM

• GMPLS/ASON/WSON-based control planes

provide auto-discovery of resources and auto-

provisioning of services for ease of operation

• Digital OTN PMs at OTN switching nodes ensure

service visibility

NxODUk <->

(NxODU4<->

NxOTUk

NxOTU4)

OTN DWDM Transport

OTN Control Plane & OAMP

GMPLS, ASON,

WSON

ODUj

(ODU2)

ODUj

(ODU2)

OTN Switching

ODUj <-> ODUk

(ODU2 <-> ODU3)

OTN Multiplexing

client ODUj

OTN

OTN

OTN

OTN

OTN

OTN Adaption

(10GbE -> ODU2e)

OAMP Tools for End-to-End Monitoring and Provisioning

OVERHEAD AND PAYLOADS

OTN Architecture

Client OH Optical Payload Unit (OPUk)

(transparent client signal transport)

OPUk OH

FEC OH ODUk

Optical Data Unit (ODUk)

Optical Transport Unit (OTUk)

Optical Channel (OCh)

OMSn

OTSn

Optical Multiplex Section (OMS)

Optical Transport Section (OTS)

Multi-Service Clients

Dig

ita

l

Do

ma

in

Op

tic

al

Do

ma

in

SONET/SDH SAN Ethernet

OCh

OCh

. . . . . . . . . . .

(k = 1/2/3/4 for 2.5/10/40/100G)

FEC – Enhanced optical reach

No

n

Asso

cia

ted

OH

(O

SC

) A

sso

cia

ted O

H

OTUk, ODUk and OPUk OH 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

1 FAS MFAS SM GCC0 RES

OPU Specific 2 RES PM&

TCM

TCM

ACT TCM6 TCM5 TCM4 FTFL

3 TCM3 TCM2 TCM1 PM EXP

4 GCC1 GCC2 APS/PCC RES PSI

OPU

Spec

.

G.709 2012-02, Cor. 1 2012-10, Amd. 1 2012-10

ACT Activation/deactivation control

channel PCC Protection Communication Control channel

APS Automatic Protection Switching

Coordination channel PM Path Monitoring

EXP Experimental Bits PSI Payload Structure Identifier

FAS Frame Alignment Signal RES Reserved

FTFL Fault Type & Fault Location SM Section Monitoring

GCC General Communication Channel TCM Tandem Connection Monitoring

MFAS Multi-Frame Alignment Signal

Client Signal Mappings

Transported

ODUk

Client Interfaces

G.Sup43

12/2008

G.709

2012-02 1GE

STM-16, OC-48

OC-192/STM-64

10GE WAN PHY

10GE LAN PHY

10G FC

STM-256, OC-768

40GE

4G FC

100GE

ODU0

ODU1

ODU2

ODU1e

ODU2e

ODU4

ODU3

ODUflex

TTT+GMP

AMP, BMP

AMP, BMP

AMP, BMP

AMP, BMP

16FS+BMP

GFP-F

TTT+16FS+BMP

BMP

BMP

1G FC

STM-1/4, OC-3/12

GMP

2G FC GMP

GMP

Mapping

8G FC

BMP

TTT+GMP

GMP

G.7041

2011-04

Nominal

Rate

1.25G

2.5G

10G

10G

10G

100G

40G

Nx1.25G

Client Signal Mappings

Transported

ODUk

Client Interfaces

G.709

2012-02

SBCON/ESCON

CM_GPON

CM_XGPON

CPRI Option 4/5/6

ODU0

ODU1

ODU2

ODUflex

AMP

AMP

DVB_ASI, SDI

CPRI option 1/2

GMP

CPRI Option 3 GMP

Mapping

IB SDR/DDR/QDR

BMP

Nominal

Rate

1.25G

2.5G

10G

Nx1.25G

1.5G SDI

3G SDI

Mapping of cell/packet clients

G.709 Mapping of

ATM cell stream into

OPUk (k=0,1,2,3)

ATM

Mapping of GFP frames into OPUk (k=0,1,2,3,4,flex)

IP Ethernet MPLS

Any packet streams

encapsulated in GFP-F

MULTIPLEXING

G.709/G.Sup43 Multiplexing Hierarchy

ODU0

ODUflex

ODU1

ODU2

ODU3

ODU3e1

ODU3e2

ODU4

ODU3e1

ODU3e2

ODU1 Muxing

ODU2 Muxing

ODU3 Muxing

ODU4 Muxing

ODU3e1/2 Muxing

ODU1

ODU2

ODU2e

ODU3

Low-Order ODUj High-Order ODUk

ODU1

ODU2

ODU3

ODU4

2 8 32 80

4

8 32 80

16 40

4 10

3 10

2

4

OTN Multiplexing Example

10GbE OTU3

OTU4 OTU4

ODU2e

muxed into

ODU3

ODU2e

muxed into

ODU4

10GbE mapped

into ODU2e

ODU2e

is switched

ODU2e

muxed into

ODU4

ODU2e

is switched

STM-64/OC-192

mapped into ODU2

OTU4

OD

U2e

OH

10G 10

G

OD

U2e

OH

10G

OD

U4

OH

OD

U2e

OH

10G

OD

U2e

OH

10G

OD

U4

OH

OD

U2e

OH

10G

OD

U2e

OH

10G

OD

U3

O

H

OD

U2

OH

10G 10

G

OD

U2

OH

10G

OD

U4

OH

OD

U2

OH

10G

OD

U2

OH

10G

OD

U2

O

H 10G

ODU2

muxed into same

ODU3

ODU2

OH

10G

ODU3

OH

ODU4

OH

Client service

ODU2 encapsulation

ODU3 encapsulation

ODU4 encapsulation

Legend

ODU2e

OH ODU2e encapsulation

STM-64/

OC-192

COMPARE/CONTRAST WITH

SDH

OTN vs. SDH

OTN SDH

DWDM Part of the basic framework Not part of SDH

Efficiently mapped client rates

1Gbps - 100Gbps

(higher rates will be standardized in the future)

2Mbps (1.5Mbps for SONET) to

40Gbps (no standardization plans for higher rates)

FEC Supported by the basic frame

format Not supported

TCM 6 Layers – Cleanly defined 1 Layer – Complex definition

Standardized Protection Linear, Ring

Mesh is work in progress Linear and Ring

Client Signal Transparency Bit and timing Bit and timing

Synchronization of transport

nodes Free running

Typically part of synchronization

hierarchy

ADOPTION AND EVOLUTION

(FUTURE)

OTN Adoption

OTN equipment had 58% share of optical

equipment spending in 2012 and this is forecast to grow to 78% by 2017*

Spending in Mesh Networking equipment

(OTN switching) was 14% of total OTN spending in 2012 and it is growing to

21% by 2017*

OTN has established itself as the state of the art transport technology

*Infonetics Report: OTN and Packet Optical Hardware, March 2013

OTN Future

Higher Client Rates

400Gbps Ethernet,1Tbps

Ethernet, ...

Higher Line Rates

OTUCn

n x OTU4

(n x 100G)

ODUk Shared Mesh

Protection

50ms Protection with Shared Backup

Resources

What We’ll Discuss Today

• OTN technology overview

• Purpose

• Functional description

• Overhead and payloads

• Multiplexing

• Compare/contrast with SDH

• Adoption and evolution (future)

• Mesh Networking

• Purpose/Mesh topologies

• Functional description of various protection mechanisms

• Efficiency vs. dedicated protection

• Summary

PURPOSE/MESH TOPOLOGIES

North American Long-Haul Network Model

• 36,382km fiber network with 82 total add/drop nodes

• 7 data centers (dual nodes), 21 Tier 1 cities, 10 Tier 2 cities, 34 Tier 3 cities, 352 x optical line amplifier sites

0

5

10

15

20

25

30

35

40

45

50

0.831 1.308 1.874 3.079 4.342

5.6 9.3 14.7 25.7 50.3

2012 2013 2014 2015 2016

Tota

l Tra

ffic

Vo

lum

e (

Tb/s

)

100G

40G

10G

2.5G

1G

Avg. Link

Total

Traffic

Realistic Fiver Year Network and Traffic Model

Srinivasan Ramasubramanian

Suresh Subramaniam

Satyajeet Ahuja, Steven Hand

Economic Comparison

Muxponder Muxponder +

OXC

Integrated OXC

+ DWDM

Architectures

Compared

No OTN Switching OTN Switching

Vs.

0%

20%

40%

60%

80%

100%

120%

2012 2013 2014 2015 2016

Cumulative CAPEX

Muxponder

Muxponder + OXC

Integrated OXC & DWDM

0

100

200

300

400

500

600

2012 2013 2014 2015 2016

OPEX - Space Bays

Muxponder

Muxponder + OXC

Integrated OXC & DWDM

0.0

500.0

1000.0

1500.0

2000.0

2500.0

3000.0

3500.0

4000.0

2012 2013 2014 2015 2016

OPEX - Power kW

Muxponder

Muxponder + OXC

Integrated OXC & DWDM

Integrated OXC & DWDM is the Most Cost Efficient Architecture

FUNCTIONAL DESCRIPTION

OF VARIOUS PROTECTION

MECHANISMS

Shared bandwidth,

Transport layer

Recovery mechanisms for networks

Sub 50ms recovery

on failure

Multi-failure

scenarios

Minimal

Costs

Packet IP/MPLS: MPLS

Fast Re-Route (FRR)

Sub 50ms for

limited scenarios

Multi-failure

scenarios

Shared bandwidth,

Packet layer $$$

Digital OTN: HW

Accelerated Shared

Mesh Protection

Sub 50ms recovery

on failure

Multi-failure

scenarios

Shared bandwidth,

Transport layer

Fast

Recovery

Optical SONET/SDH:

1+1, 1+N, 1:N

Single failure

scenario

Dedicated backup

resource

Sub 50ms recovery

on failure

Digital OTN: SW Based

Shared Mesh

Restoration

Up to few seconds

recovery on failure

Multi-failure

scenarios

Shared bandwidth,

Transport layer

Multi-failure

backups

SMP (Shared Mesh Protection) is currently being standardized in ITU-T

SMP solution components

A B C

D E

F G

SPs like Pacnet moving to mesh architectures to take

advantage of new transport protection schemes

Plan for multi-failures

Network Planning System GMPLS Control Plane

Real-time backup

path re-computation

Pre-provisioned in hardware

for <50ms activation

OTN Switch with Hardware

based SMP Processor

SMP in Action

A B C

D E

F G

High Priority

Low

Service 1 = Working Path AE

Failure 1 Backup ADE

Failure 2 Backup ABFE

Failure 3 Backup ABCGFE

SMP Processor Table

Service 2 = Working Path AD

Failure 1 Backup AD

Plan for multi-failures

Online optimization w/GMPLS at Transport Hardware activation <50ms across network

Shared backup = 50% fewer line cards than 1+1 on AD

= 1:1

= N:1

Service 1

Service 2

Protection

Industry impetus on Shared Mesh Protection

ITU – Q9 / SG15

G.SMP G.808.3

G.ODUSMP

Documents

under

“Last Call”

Two current drafts

Requirements for SMP

Supporting SMP in MPLS-TP

Documents

on Standards

Track

EFFICIENCY VS. DEDICATED

PROTECTION

SMP saves 30% over 1+1 Protection

Source: ACG Research, 2013

Large network, 80+ nodes

SMP

Savings 30% 33% 30% 28% 27%

100G WDM

Protection

Interface

Count

While being more reliable than 1+1 protection

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

Year 1 Year 2 Year 3 Year 4 Year 5

2660 3480

4630

6270

8750

1870 2320

3240

4540

6400

1+1 SMP

SUMMARY

Summary

OTN provides the optimal digital layer for

DWDM networks

OTN is replacing SDH/SONET in

transport networks

OTN provides standardized bit and timing transparent

transport of all important client services

OTN is the most cost efficient multiplexing and switching technology for

1Gbps and above services

HW Accelerated ODUk Shared Mesh Protection can provide guaranteed 50ms protection and the bandwidth efficiency of

shared restoration

DANTE, GÉANT &

Application of OTN & Mesh

Restoration/Protection

• Presenter: Michael Enrico

• Company: DANTE

Presenter Profile

Michael Enrico received his BSc and PhD

degrees in Physics from Lancaster University in 1991 and 1995. In 1997 he moved into telecommunications joining what was then BT

Labs, where he worked on: the study and development of innovative broadband access

network architectures based on hybrid fibre-copper infrastructures and highly scalable IP network transport solutions for broadband

services. In 2001, he joined DANTE’s Network Engineering and Planning team in which he

worked on various high and low level design assignments. In 2003, he was promoted to Network Engineering and Planning Manager and

in 2012 to CTO and is now responsible for developing technology strategies in DANTE and

the GÉANT project as well as representing these same entities on the international R&E networking stage.

• Name: Michael Enrico

• Title: Chief Technical Officer

• Email: michael.enrico@dante.net

DANTE – who we are, what we do…

• DANTE (Delivery of Advanced Network Technology to Europe)

established in 1993 - plans, builds and operates advanced networks for

research and education

• Owned by Europe’s National Research and Education Networks

(NRENs) and works in partnership with them and the European

Commission

• DANTE's work is primarily organised in the form of projects, which

receive co-funding from the EC e.g.

o GÉANT via GN3plus – pan-European R&E comms infrastructure

o EUMEDCONNECT3 – southern & eastern Mediterranean

o CAREN – central Asia

o ORIENTPlus – China

o AfricaCONNECT – Africa

The GÉANT core offers

Flexibility, Reliability & Speed

40 European Countries

Dark Fibre + DWDM

Hybrid network:

• Routed IP

IPv6, multicast, VPN

• Point-to-point

Circuits typically 1Gbps

• Dedicated Lambdas Full 10Gbps

Bandwidth on Demand

Network monitoring

Security

Mobility/AAI (edu*)

Transmission

platform

Switching

platform Converged

(P-OTS)

platform?

Fibre Leased circuits

TDM (SDH)

pt-to-pt DWDM

IP & MPLS

GR BE TR IL EE LV LT SK

HR SI

UK

NL

DE

FR

ES

PT

DK

CZ

AT

IT

HU

CH

RO BG

PL

IE

LU

MT CY

“Routerless” “Fully featured” Off fibre net IP/MPLS only NREN POPs

(Routerless)

RU

Circuits

over GÉANT Leased

circuits

MK RS

ME

An architectural view of GÉANT (“before”)

Converged

(P-OTS)

platform

IP

Transmission

platform

Switching

platform

Fibre Leased circuits

Packet

transport

DWDM & OTN

IP

GR BE TR IL EE LV LT SK

HR SI

UK

NL

DE

FR

ES

PT

DK

CZ

AT

IT

HU

CH

RO BG

PL

IE

LU

MT CY

“Routerless” “Fully featured” Off fibre net IP/MPLS only NREN POPs

RU

Circuits

over GÉANT Leased

circuits

MK RS

ME

“Converged”

(packet transport)

platform

“Fully featured” “Better featured”

ALL now “Better featured”

…and “after” (upgrade)

B/W Virtualization transforms waves into resources • A large pool of intelligent capacity

GMPLS allocates resources to service demands • Same concept as data center virtualization

Enables shared mesh restoration

B/W Virtualization

• DWDM

• OTN Switching

• GMPLS Control Plane

2x10GbE service

demand

100GbE service demand •500Gb/s total

•95Gb/s in use •115Gb/s in use •215Gb/s in use

Benefit of “superchannels” with OTN (rapid provisioning & resilience options)

53

New GÉANT “day-1” DF footprint

Current status of transmission rollout

A potential use of 1:1 or SM protection

100G Trunk Protection

• GÉANT “Western Ring” consists of 5 links each running 100GE

• Upgrade Path?

• Upgrade all five trunks to 2x100GE OR…

FR

UK

NL

DE 100G 100G

100G

100G 100G

CH

UK

NL

DE 100G 100G

100G

100G 100G

FR CH

100G Trunk Protection

• GÉANT “Western Ring” consists of 5 links each running 100GE

• Upgrade Path?

• Upgrade all five trunks to 2x100GE OR…

UK

NL

DE 2x100G 2x100G

2x100G

2x100G 2x100G

FR CH

100G Trunk Protection

• GÉANT “Western Ring” consists of 5 links each running 100GE

• Upgrade Path?

• Upgrade all five trunks to 2x100GE OR…

• Add a “direct” fully protected link between two sites

UK

NL

DE 100G 100G

100G

100G 100G

FR CH

100G

FR

UK

NL

DE

CH

working

path Prot/rest

path

100G Trunk Protection

• GÉANT “Western Ring” consists of 5 links each running 100GE

• Upgrade Path?

• Add a “direct” fully protected link between two sites

• If there is a fibre cut between CH & DE the “direct” link between CH & NL will get restored dynamically in ~50ms

• The IP traffic will use the same physical path it would have used if the ring was 2x100GE

• There will be no increase in traffic on IP link FR-UK or UK-NL or FR-CH

• Traffic between CH & DE will go via NL making CH only 2 IP hops away rather than 4

FR

UK

NL

DE

CH

working

path Prot/rest

path

Two interesting applications…

• (in “BIG Science”…)

LHC : 27 km long

100m underground

ATLAS

General Purpose,

pp, heavy ions

CMS +TOTEM

Heavy ions, pp

ALICE

pp, B-Physics,

CP Violation

The LHC Experiments

Exploring our Universe with eVLBI

Through dedicated high-speed

links, GÉANT connects remote

radio telescopes around the

world, providing researchers with

real-time distributed images of

the solar system.

“The EXPReS project has been transformed by our connection

to the GÉANT network. Whilst the advancement of telescope technology means we can now carry out years’ worth of

observations in days, the ability to then transfer that vast

quantity of data between astronomers at such high speed means the pace of our research has accelerated beyond

recognition, with real-time collaboration now a reality.” – Professor Ralph Spencer, Jodrell Bank Observatory)

The path to eVLBI in near real-time

65

Custom-made hardware (“correlator”)

~500000 lines of C++ code

Tape Network BOD!!! Disks

Coming… SKA – Square Kilometre Array

Southern Africa

Western Australia

• Andy Lumsden

• CTO, SVP Operations

• Pacnet

THE NEW PACNET NETWORK

Introduction

6

8

• Pacnet Overview

• Transformation Strategy

• The New Network

• OTN & MESH Adoption Our View & Challenges…..

Pacnet Overview…….. Our Submarine Cable Network

EAC-C2C

way.

•Pacnet owns and operates the leading pan-Asian

submarine cable network that lands in 21 cable landing

stations and extends from India to the USA

• EAC-C2C, fiber optic submarine cable network

spanning 36,800 kilometers between Hong Kong, China, Korea, Japan, Taiwan, the Philippines and Singapore. EAC-C2C has a design capacity of 17.92

terabits per second (Tbps) to 30.72 Tbps to and from each of the landing countries, with continuous upgrades

under progress planning and review •EAC-PACIFIC is part of UNITY with 2 dedicated FPs

from Chikura to LA, USA

Pacnet services incl…..

• IRU, IPL, E-IPL

• IP-MPLS, IP-T

• CDN • Managed Datacenter Services, Hosting/Storage, Colocation

• Self owned & operated Data Center space in the Asia Pacific Region

Transforming the PACNET Network

Transform the Core Network

Move away from SDH Rings

Converge to reduced number of highly efficient connectivity (integrate subsea and backhaul)

Deploy powerful multi-service and multi-protocol platform in the core

Extend and Expand Carrier Ethernet & VPLS Capability

A Comprehensive IP/Optical convergence strategy

Integrated Data Plane

Integrated Control Plane

Connect the Data Centers

10/40/100GE Ethernet connectivity over new Core Network

7

0

Converge to improve efficient links

Make use of Asia’s longest

and most resilient Fiber

Optic Cable Network

• Integrated Subsea and

Backhaul

• Pick the right

segments for most

direct routes

• More than 2 degrees

for more auto-restore

Fast & Furious Mesh

Build a new parallel Optical

Mesh Network

• No more SDH Rings

2-Fiber Pair model

• Choose, Upgrade and

Use only 1 Fiber Pair

• Interconnect

Philippines and Korea

• No distinction between

Subsea and Backhaul

New Topology

Simplify the Core!

New Optical Network

• Ethernet VPN (EVPN), IP, SDH, EIPL

• OTN transport services on top of the Optical Transport

Flexible Services At the Edge

• GMPLS signaling and OTN Switching for virtualization and Full Meshed Topology

Wholesale, Restoration and

Routing Availability

• Built upon 100G Optical Core Large Effective

Bandwidth Availability

Transforming the Core Network

Multi-Service

Layer

Next-gen core equipment

allowing multi-layer & multi-

service creation across all

key dimensions:

• Integrated Subsea and

Backhaul

• Wave restoration

• 40G/100G/OTN

• Packet Optical Network

• ODU Grooming

Converged backbone: Maximize efficiency of core

transport for scalable & profitable service expansion

Convergence on reduced

number of shortest & highly

efficient core network

connectivity that

accommodate profitable

growth across all services

Integration of IP & optical

domains with Cross-Layer

visibility and automation,

optimizing operational costs

Core simplification

Convergence

End-to-end

Cro

ss

- La

ye

r

Core Layer

Increase Efficiency

Expansion of our Ethernet

Services coverage and

capability (VPLS & T-MPLS

Carrier Ethernet

Next-Gen

Integrated

DWDM/OTN/

ODU Switching

INFINERA DTN-XTM

PRODUCT BROCHURE

INFINERA DTN-X: MULTI-TERABIT PACKET OPTICAL

TRANSPORT NETWORK (P-OTN) PLATFORM

Offering service providers operat ional simplicit y , cost -effect ive network

scale to mult i-terabit and superior PIC-enabled network ef f iciency

Why You Need the DTN-X

The relentless growth of video, mobile and cloud-based applications

demands a network that can deliver highbandwidth, market-leading

network economics. The In nera DTN-X integrates Photonic Inte-

grated Circuit (PIC) based multi-Terabit WDM transport and inte-

grated OTN switching to offer a combination of scale and ef ciency

while simplifying network operations. By combining plug-and-play

automated turn-up, GMPLS network intelligence and service automa-

tion, DTN-X provides a truly simple network and system architecture

leveraging high density, low power enabling PICs, delivering a ‘no

compromise’ Digital Optical Network.

What Is the DTN-X

The In nera DTN-X is a next generation mult i-Terabit converged

P-OTN solution. The DTN-X enables 5 Tb/s) of non-blocking switch-

ing in a single bay, upgradeable in the future to 10 Tb/s, scalable

to 100 Tb/s in a mult i-bay con gurat ion, and offering 8 Tb/s of

WDM capacity scalable to 24 Tb/s. DTN-X combines the bene ts

of PIC technology, integrated switching and the exibility of OTN

and packet. The DTN-X extends In nera’s leadership with the unique

Digital ROADM architecture and Generalized Multi-Protocol Label

Switching (GMPLS) service intelligence and is posit ioned to meet

the needs of service providers seeking to offer new and innovative

services in a SIMPLE, SCALABLE, and EFFICIENT manner.

Simple

The In nera DTN-X is simple to install, operate, troubleshoot and

scale. Services can be quickly and easily provisioned and transported

over a common WDM layer. The key enablers of network simplicity are:

PIC-enabled economical optical-electronic-

opt ical (O-E-O) conversion allows sub-lambda grooming while

SCALABLE

SIMPLE

EFFICIENT

500 Gb/s super-channel

to 100 Tb/s

Intelligent GMPLS automation

MPLS future

50% less power

Service-specific

transport

containers

Service Edges (IP/IPVPN/VPLS..)

OTN

networking

to datacenter

to peering gateway

GMPLS

intelligence

Lambda level

Port level

Sub-port (VLAN) level

ODU

ODUflex ODU

IP/Optical Integration– IP Traffic Grooming

• IP traffic from router ports or sub-ports is mapped to the optimal transport

container

• Traffic is individually forwarded to its specific destination across the low-cost

optical layer with the highest reliability and quality.

• Maximum filling of optical transport resources avoids capacity waste

Flexible IP traffic grooming options at the OTN layer,

including port-level and sub-port-level grooming

Next Generation SLTEs

Typical Terrestrial/Subsea Network

Back to Back transponders

Integrated Terrestrial/Subsea Network

End to End Provisioning/Protection/Management

• End to End

Provisioning/Management

• End to End

Protection/Restoration

Unifies Subsea &

Terrestrial

• No ‘grey optics’ required for

pass through traffic

• Less equipment yields capex

savings

• Reduced ODF requirements

Eliminates Back to Back

Transponders

• Eliminates potential points of

failure

• Reduces time to

activate/troubleshoot

Improves Operations

Provisioning

Across terrestrial

Provisioning

Across subsea

OTN & MESH Adoption

OTN & MESH

• Anticipate that OTU client Interface requirement coming from

Telecom Carriers and large capacity consumers, for instance

Internet Service Providers and Cloud Service Providers

• Unprotected 10G services still in demand, OTN provides

grooming capabilities and flexibility for multi service traffic type – 40G on sub sea services now commonly requested

• Pacnet's multiple cable architecture, opens up offer of fast re

route, multi path back up/restore. Product offer key to

successful take up

• Holistic overlay approach, to deploy capabilities POP-POP or

Importantly DC-DC

7

7

OTN for UNI

• OTN for Intra-Domain IaDI is obviously mature BUT Inter-

Domain IrDI / UNI is not mature yet….

• Pacnet will look at inter vendor testing, PoC to realize potential

of OTN

(source : OTNtutorial.pdf)

Multiple Specification for OTU client interfaces will make more confusion

In Summary…

• Next Gen Transport Evolution will allow Pacnet

• Transition to a cost efficient Terrestrial and Sub Sea architecture

• Traffic grooming, multi services integration (TDM & Packet)

• MPLS+ETHERNET+OTN

• Network Scalability, Flexibility

• Leverage existing network footprint with multiple cable spans in region

• OTN Adoption is coming to the Sub Sea Environment

• Extend Pacnet's Optical domain to Enterprise, Carrier customer base

• Separate Data and Control Plane opens up future development

Thank You