1

Provider Bridging design for UNM Campus - CPBN

2

Outline of Topics Introduction Obstacles Fiber? Now What? Wavelength Division Multiplexing Ethernet-based Connections QinQ 802.1Q multi-tagging now 802.1ad How UNM and ABQG used to do it. How UNM and ABQG are doing it Now Design considerations CPBN Design Open for Discussion

3

Introduction Edward May

Network Engineer with the University of New Mexico and ABQG (Albuquerque Gigapop)

http://www.unm.edu http://abqg.unm.edu

4

Obstacles Acquiring Fiber

In no way does this presentation presume to inform anyone on how to get more fiber, or any at all for that matter.

One of the biggest obstacles can be getting access to, or acquiring any fiber at all.

Often you just can’t get new fiber installed

Equipment cost versus Fiber cost Virtual resource versus physical resource.

5

Fiber? Now What? Growing Bandwidth Needs. And

everyone will say it is a NEED. Ethernet – almost all of our

connections are Ethernet these days. 1g or 10g

Link Aggregation – use multiple fiber pairs using Ethernet and bond them together for additional bandwidth

WDM – Wave Division Multiplexing 802.1Q – Provider Bridging

6

Wave Division Multiplexing Multiple carrier signals on the same pair

of fiber DWDM – Dense – narrower wavelengths CWDM – Coarse – wider wavelengths

Allows for expanding capacity without additional fiber installation. Color (light frequency) is used for the

individual signals.

Stealth.net

7

Wave Division Multiplexing CWDM

Transponders can be lower cost ~4-16 waves some might have

limitations DWDM

Some systems up to 160 different signals each capable of 10gb/s

100gb/s on the way for some equipment

BTI Systems example

8

9

Ethernet-based Connections Ethernet is the Standard

No Token Ring, FDDI, Firewire Twisted Pair or Fiber, No 10base5 or

10base2 anymore CenturyLink/Zayo/TWTC are

offering Metro Optical Ethernet or Ethernet services, in much of their service area

Low-cost interfaces, cables and connectors for copper

10

QinQ 802.1Q multi-tagging The 802.1 Ethernet standard was amended to allow

for vlans within vlans. Now called 802.1ad

http://www.ieee802.org/1/pages/802.1ad.html This adds a 12-bit Vlan ID field to packets.

11

How we used to do it

12

How we used to do it

DWDM Point to point system, with transponders only.

Redundancy Path Router Port Transponder

Capable – OC, Ethernet, FC, Outside wavelengths(or alien)

13

How we do it now

14

How we do it now DWDM Point to point system, with

transponders and QinQ for gigE services.

Redundancy Path Router Port(if we wish) Transponder Ethernet

Capable – OC, Ethernet, FC, Outside wavelengths(or alien), Also Ethernet “circuits” can be protected.

15

Good and Bad

Easy configuration Rate limiting (tested it works) Ethernet standards plus Provider

bridging.

Monitoring capabilities still lagging the capabilities.

Campus Connectivity Now

16

Design Considerations

Monitoring service – costly to monitor a fiber pair

Private circuits Redundancy – sfp’s, fiber pairs,

fiber path, hardware Training costs/Hardware costs Reliability Maintenance and Operability –

Distance limitations/optical power loss 17

UNM Network Re-Design

Move away from older and slower large distributed routers

Faster distributed switching for on-campus communications

Capability of additional service redundancy to buildings – sfp, fiber pair, port

Upgrade from 20Gbps backbone to 40Gbps with 100Gbps for campus and Research networks18

Designs Considered

MPLS to the building More expensive hardware/routing

platform, distributed routing Distributed Routing/current model

More expensive hardware, still distributed

Provider Bridging Proven between ABQG and UNM,

More centralized routing and services capable, manage circuits

19

20

Migration in Process Hardware deployed to Fiber Zones 40Gbps up between FZ’s 80Gbps up to new Core routers 100Gbps up to new Core from

ABQG for campus and Research Local connections made to FZ

routers Securing new Hardware, and

configuration in process, Migration of buildings begins soon21

Migration from Current

22

100G for UNM

23

CBPN and Research Network

24

25

Open for Discussion Edward May

emay@unm.edu 277-8050

26

References:

1. 802.1ad QinQ: http://www.ieee802.org/1/pages/802.1ad.h

tml and http://en.wikipedia.org/wiki/802.1QinQ

2. BTI Systems: http://www.btisystems.com

3. Albuquerque Gigapop website: http://abqg.unm.edu

4. Wikipedia is your friend. QinQ, WDM, etc: http://en.wikipedia.org/wiki/IEEE_802.1ad-2005