1Presentation_ID 1999, Cisco Systems, Inc.

The Keystone of Internet EconomyVersion 3.1

Saturday, February 17, 2001

The Keystone of Internet EconomyVersion 3.1

Saturday, February 17, 2001

2Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

IXPs - The keystone to Internet Economy Why should I connect to an IXP? Transit and Peering Interconnections - A Short History Types of IXPs & Examples of IXPs Ciscos Role Case Studies Technical Addendum

3Presentation_ID 1999, Cisco Systems, Inc. 3Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

4Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

In many places, ISP would love to interconnect, but cannot afford large core routers just to connect to an IXP.

Route reflectors enable ISPs to use smaller affordable routers.

These routers all interconnect with one BGP peer connection to a BGP Router Reflector.

The Route Reflector provides the routing information

5Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

AS 100

AA

BB CC

Normal BGP needsto be meshed!Normal BGP needsto be meshed!

AS 200

AS 300

6Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

AA

BB CC

Reflector

Router Reflector allowsfor a BGP hub (star)configuration

Router Reflector allowsfor a BGP hub (star)configuration

7Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

Solves BGP mesh problem on the IXP where you need larger routers

Packet forwarding between IXP routers is not affected.

Normal BGP speakers can co-exist on the IXP.

Multiple reflectors for redundancy Easy migration

8Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

Single ANS for the route reflector. Private AS Number can be used as long as transit services are forbidden on the IXP.

Cannot change attribute of reflected routes.

Multi-lateral Peering Agreement best fits the route reflector topology.

9Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

A1

Cisco2501 Cisco CAT 5000

Cisco 4500

B1 N1

T1 T1 T3

10M

10M

100M

100M10M

Cisco2501 Cisco7206

Router ReflectorCisco 3620

B2A2 N2

R1

AS6500

192.168.1.1192.168.1.2

192.168.1.3

192.168.1.4192.168.1.5

Z1

Services

172.16.0.0/19 172.16.96.0/19 172.16.224.0/19

10Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

A1

Cisco2501 Cisco CAT 5000

Cisco 7206VXR

B1 N1

T1 T1 T3

10M

10M

100M

100M10M

Cisco2501 Cisco7206

Router ReflectorCisco 3620

B2A2 N2

R1

AS6500

Z1

Services

172.16.0.0/19 172.16.96.0/19 172.16.224.0/19

iBGP Peers

192.168.1.1192.168.1.2

192.168.1.3

192.168.1.4192.168.1.5

11Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

A1

Cisco2501 Cisco CAT 5000

Cisco 7206VXR

B1 N1

T1 T1 T3

10M

10M

100M

100M10M

Cisco2501 Cisco7206

Router ReflectorCisco 3620

B2A2 N2

R1

AS6500

Z1

Services

172.16.0.0/19 172.16.96.0/19 172.16.224.0/19

IP Traffic

192.168.1.1192.168.1.2

192.168.1.3

192.168.1.4192.168.1.5

12Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

Router A2router bgp 65000neighbor 192.168.1.5 remote-as 100

Router B2router bgp 65000neighbor 192.168.1.5 remote-as 100

Router N2router bgp 65000neighbor 192.168.1.5 remote-as 100

Router R1 ! Route Reflectorrouter bgp 65000neighbor 192.168.1.1 remote-as 100neighbor 192.168.1.1 route-reflector-

clientneighbor 192.168.1.2 remote-as 100neighbor 192.168.1.2 route-reflector-

clientneighbor 192.168.1.3 remote-as 100neighbor 192.168.1.5 route-reflector-

client

iBGP Config

13Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

ISP-N

A1

Cisco2501 Cisco CAT 5000

B1 N1

T1 T1 T3

10M

10M

100M

100M10M

Cisco2501 Cisco7206

Router ReflectorCisco 3620

B2A2 N2

R1

AS65000iBGP

ISP-A ISP-B

Cisco 7206VXR IXPServices

172.16.0.0/19 172.16.96.0/19 172.16.224.0/19

192.168.1.1192.168.1.2

192.168.1.3

192.168.1.4192.168.1.5

14Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

A1

Cisco2501 Cisco CAT 5000

B1 N1

T1 T1 T3

10M

10M

100M

100M10M

Cisco2501 Cisco7206

Router ReflectorCisco 3620

B2A2 N2

R1

AS65000iBGP

Cisco 7206VXR IXPServices

172.16.0.0/19 172.16.96.0/19 172.16.224.0/19

ISP-BsAS200iBGP

ISP-NsAS300iBGP

eBGP Peer

eBGP Peer

ISP-NISP-A ISP-B

192.168.1.1192.168.1.2

192.168.1.3

192.168.1.4192.168.1.5

15Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

Router Reflector Based IXPs have proven to scale to +60 ISPs.

What are the scaling options? Direct Peering with Peers and the

Router Reflector Replacing the Router Reflector with a

Router Server

16Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

A1

Cisco2501 Cisco CAT 5000

B1

T1 T1

10M

10M

100M

100M10M

Cisco2501

Router ReflectorCisco 3620

B2A2

R1

AS65000iBGP

Cisco 7206VXR IXPServices

172.16.0.0/19 172.16.96.0/19

ISP-BsAS200iBGP

ISP-A ISP-B

192.168.1.1192.168.1.2

Z1

T3

Cisco7206

Z2

172.16.128.0/19ISP-ZsAS300iBGP

ISP-Z

192.168.1.6

192.168.1.4192.168.1.5

N1

T3

Cisco7206

N2

172.16.224.0/19ISP-NsAS300iBGP

ISP-N

192.168.1.3

eBGP Peer

eBGP Peer

eBGP Peer

17Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

A1

Cisco2501 Cisco CAT 5000

B1

T1 T1

10M

10M

100M

100M

Cisco2501

Router Server

Unix w/ Route Server Daemon

B2A2

Cisco 7206VXR IXPServices

172.16.0.0/19 172.16.96.0/19ISP-BsAS200

ISP-A ISP-B

192.168.1.1192.168.1.2

Z1

T3

Cisco7206

Z2

172.16.128.0/19ISP-ZsAS400

ISP-Z

192.168.1.6

192.168.1.4192.168.1.5

N1

T3

Cisco7206

N2

172.16.224.0/19ISP-NsAS300

ISP-N

192.168.1.3

ISP-AsAS100

eBGP Peer

eBGP Peer

eBGP Peer

18Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

A1

Cisco2501

Cisco CAT 2924XL

B1 N1

T1 T1 T3

10M

10M

100M

100M10M

Cisco2501 Cisco7206

Router ReflectorCisco 3620

B2A2 N2

R1

AS4558iBGP

Cisco 7206VXR IXPServices

172.16.0.0/19 172.16.96.0/19 172.16.224.0/19

ISP-BsAS65000

iBGP

ISP-NsAS300iBGP

ISP with Private

AS number

Use the BGP

remove-private-as command ISP-NISP-A ISP-B

192.168.1.1192.168.1.2

192.168.1.3

192.168.1.4192.168.1.5

UpstreamISP

Use the BGP

remove-private-as command

N-GW

19Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

Internet

64 Kb

ps

256

kbps

128 Kbps

National Gateway

ISP A ISP B ISP C

Internet

64 Kb

ps

256

kbps

128 Kbps

National Gateway

ISP A ISP B ISP C

Domestic + International Together

512 Kbps

IXP

Domestic + International Separate

4 M

b ps2 Mbps 51

2 Kbp

s

20Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

no-export

no-export

ISP A IXP ISP B

Upstream #1 Upstream #2

RR marks prefixes as BGP Community no-

export

170.10.0.0/20 No-Export170.10.0.0/20

ISP A advertises 170.10.0.0/20 to the

IXP

ISP Bs GW router sees no-export and does not advertise

upstream.

21Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

Cisco CAT 2924XL

N1

T3

100M

10M

Cisco2650

Router ReflectorCisco 3620

N2

R1

IXPAS4558

iBGP

ISP-NsAS300iBGP

Ingress/Egress Packet and

Route Filtering

ISP-N

192.168.1.3

192.168.1.5

UpstreamISP

N-GW US-GW172.16.224.0/19

The Internet

22Presentation_ID 1999, Cisco Systems, Inc. www.cisco.com

Peer B

Peer AIXP-W

IXP-E

Customer C

Customer A

Customer D

Customer B

A

B C

D

E

ISP #1

ISP #2

109:100 109:200

F