LHCONE VRF Reachability & Transit

Michael O’Connor moc@es.net

ESnet

Network Engineering

LHCOPN-LHCONE Meeting – Amsterdam

Science Park – Amsterdam NL

October 28, 2015

LHCONE Global Expansion

• The success of the LHCONE network is driving expansion and growth in Asia, Australia and Central/South America.

• While desirable, expansion and growth will strain the full mesh BGP routing model currently in place.

• On the general Internet, no single provider – no matter how big – connects to all subscribers or to all of the global content.

• To connect it all together (to give all subscribers access to all content), providers must spend money and connect their networks together.

• What options and approaches are available in the research and education networking space to maintain full connectivity among all LHCONE participating institutions?

ESnet LHCONE Full Routing Table Exported only to Sites, ESnet “Transits” the full LHCONE table to it’s customers

Diagram from ESnet perspective of the logical ROUTED connections available to reach all LHCONE collaborating sites.https://twiki.cern.ch/twiki/pub/LHCONE/LhcOneVRF/LHCONE-ESnet-paths.pdf

A discussion on the topic of transit services.

ESnet LHCONE Site RoutesExported to Peers

Internet2

GEANT

NORDUnet

In general transit policies provide protection for NSPs from exploitation by their peers. For instance, ESnet does not share it’s commercial routes with it peer networks, the service is intended to be used only by ESnet customers.

GEANT is a regional transit provider for their customer networks in Europe.

*Networks remaining in full color are ESnet sites

ESnet LHCONE Site Routes Exported to Peers

•ESnet transit policy specifies that this is the only portion of the LHCONE table that we export to peers.

•This is why the principle LHCONE NSPs have established a full mesh of BGP peerings.

Full Mesh LHCONE BGP Routing

GEANT

NORDUNET

I2

ESnet

CANET

Today the principle LHCONE NSPs form a full BGP Mesh, establishing a fully connected network.

Internet2 hosted multipoint BGP exchanges could be considered a form of transit concentrated within in a POP.

GEANT provides LHCONE transit for the RNP network in Brasil

In general, LHCONE NSPs will consider providing transit on a case by case basis

Established point to point or multipoint BGP peering

LHCONE Global Expansion

Geography will strain the LHOCNE fully meshed connectivity model

Example: If KREONET joins LHCONE by connecting to CANET, ESnet and I2 on the US west coast in Seattle WA

Connecting to AsiaKREONET Hypothetical Example

GEANT

NORDUNET

I2

ESnet

KREONET

CANET

What options exist for GEANT, NORDUnet and KREONET to exchange routes?

Connecting to AsiaKREONET Hypothetical Example

NORD

I2

Example: If KREONET joins LHCONE by connecting to CANET, ESnet and I2 on the US west coast in Seattle WA

Maintain Full Mesh by:KREONET establishing a point of presence at an exchange where GEANT and NORDUnet are located, or vice versa.

CANET

ESnet

KREONET

GEANT

Connecting to AsiaKREONET Hypothetical Example

NORD

ESnet

CANET

KREONET

I2

GEANT

Use a Transit NSP:Hypothetically, I2Transit service fills in the gaps left in the partial mesh by exporting the full routing table to KREONET.

•Dedicated transcontinental circuits are no longer required.

•Transit service also provides alternate paths to CANET and ESnet.

Connecting to AsiaHow will this scale?

NORD

ESnet

CANET

KREONET

I2

GEANT

SINET

ARnet

SING-AREN

TWA-REN

Clearly an Asian regional transit service similar to that provided by GEANT in Europe would simplify LHCONE expansion into Asia.

Maintaining LHCONE Reachability Through Measurement

• A new report containing LHCONE BGP Ipv4 and Ipv6 route prefixes.

• JSON format facilitates automated route table comparisons.

twiki.cern.ch/twiki/bin/view/LHCONE/WebHome

Proposal:1. Define an LHCONE route table reporting format.2. Principle NSPs will share LHCONE route tables.3. Table comparison will yield an LHCONE reachability metric,

identifying isolated prefixes.

Summary

• LHCONE success is driving expansion and that is a good thing.

• To manage growth, the community needs to develop:

• Strategies for maintaining LHCONE reachability.

• Policies for mitigating the exploitation risk of transit services.

• What are the transit policies of the principle LHCONE NSPs?

• Are existing transit policies sufficient to support global expansion?

• What technical approaches and tools are required to maintain a fully

connected LHCONE network?

Questions

Michael O’Connor moc@es.net

ESnet

Network Engineering

LHCOPN-LHCONE Meeting – Amsterdam

Science Park – Amsterdam NL

October 28, 2015