Peering in Brazil PTT - IX.brix.br/doc/nic.br.ptt.br.ietf88.isoc.peering-brazil.2013110503.pdf ·...

PTTMetro/PTT.br - Peering in Brazil – ISOC Panel Regional Interconnection Overview – IETF 88th – PTT.br <[email protected]> - NIC.br - http://ptt.br/ 1

Peering in BrazilPTT.br

IETF 88th – ISOC Panel

Regional Interconnection Overview

Vancouver, BC, Canada

November 6, 2013

Eduardo Ascenço Reis <[email protected]>

PTT.br Engineering Team <[email protected]>

http://ptt.br/


Summary

The purpose of this presentation is to highlight peering in Brazil

considering the regional interconnection scenario.

http://ptt.br/


CGI.br - The Brazilian Internet Steering Committee

http://ptt.br/


CGI.br - The Brazilian Internet Steering Committee

The Brazilian Internet Steering Committee (CGI.br) was created by

Interministerial Ordinance 147, of May 31st, 1995, which was amended by

Presidential Decree 4,829 of September 3rd, 2003,

with the purpose of coordinating and integrating all Internet service initiatives in Brazil,

as well as promoting technical quality, innovation and the dissemination of

the services available.

http://ptt.br/


NIC.br - The Brazilian Network Information Center

http://ptt.br/


.brDomains / IP / ASN

Registration

Authoritative Name SystemsDNS.br

NIC.br divisions / activitiesRegistro.brCERT.brCetic.brCeptro.br

PTT.br / IPv6.br/ SIMET.nic.br / etc

R$

Brazilians(persons or companies)

Return BenefitsHelp Improve Internet

CGI.br – NIC.br – PTT.br - Financial Model

http://ptt.br/


IXP - Internet eXchange Point

PTT – Ponto de Troca de Tráfego

Reference Name

http://ptt.br/


Year Location (City/State) Event

1989 São Paulo / SP .br TLD Activation

1991 São Paulo / SP

1996 São Paulo / SP PTT ANSP/FAPESP Operation Start

1997 São Paulo / SP Registro.br Operation Start (Brazil NIR)

2000 Porto Alegre / RS PTT RSIX Operation Start (RNP UFRGS)

2000 São Paulo / SP PTT OPTiX-LA Operation Start (Optiglobe Inc, now Tivit)

2002 Curitiba / PR PTT PriX Operation Start (RNP UFPR)

2002 Brasilia / DF PTT FIX Operation Start (RNP)

2004 São Paulo / SP PTTMetro (CGI.br)

2004 Rio de Janeiro / RJ PTTMetro (CGI.br)

2004 Brasilia / DF PTT FIX move to PTTMetro (CGI.br)

2004 Barueri / SP PTT ANSP/FAPESP moved to NAP do Brasil (Terremark Latin America)

2005 Curitiba / PR PTT PRIX moved to PTTMetro (CGI.br)

Brazil First Connection to Internet via FAPESP (Dawn of Brazil Internet)

Brazilian PTT History and Internet Key Points

From Peering in Brazil presentation @ LACNIC XI / Salvador, BA – Brazil - Interconnection Schemes and Strategies for ISPs Tutorial

http://ptt.br/


PTT Close Proliferation Problem (e.g. São Paulo city in the past) - 1/3

City Area

PTTOptix-LA

PTTDiveo

PTTANSP/FAPEP

PTTTelcomp

CustomerAS

Too many ConnectionsHigh Cost


http://ptt.br/



City Area

PTTOptix-LA

PTTDiveo

PTTANSP/FAPEP

PTTTelcomp

CustomerAS

?


http://ptt.br/



City Area

PTTOptix-LA

PTTDiveo

PTTANSP/FAPEP

PTTTelcomp

CustomerAS

ISPNSP

IP Transit


http://ptt.br/


PTTMetro – Brazilian Metropolitan IXP Project

PTTMetro (PTT- Internet Exchange Point) is the project of the

Brazilian Internet Steering Committee (CGI.br) that provides the

necessary infrastructure for the direct interconnection between the

diverse networks that operate in a metropolitan region.

http://cgi.br/

http://www.cgi.br/internacional/

http://ptt.br/


http://ptt.br/


PTTMetro – PTT.br – Project # Operation

PTTMetro

CGI.br project started in 2004 and is still active.

PTT.br

Operation division responsible to deploy and maintain PTTMetro locations.

PTT.br has a partnership to support its operation with entities that host PIX

on all locations. Not complete list of PIX's hosts types:● National Education and Research Network (RNP)● Academic (e.g. Universities)● Information Technology Government Companies (e.g. Procempa, Prodest, Prodepa)● Internet Data Centers (IDC)● Internet Service Providers (ISP)● Internet Network Providers (NSP)

http://ptt.br/


PTTMetro/PTT.br - Financial Model HighLights

PTTMetro / PTT.br costs are sustained by CGI.br / NIC.br, despite

Autonomous Systems (AS) participants needs for ports (number and capacity).

Each participant AS has only costs to reach one or more Interconnection Points (PIX)

of a specific PTT.br location in order to access its peering fabric.

http://ptt.br/


IXP

PIX B

Router

Router

RouterRouter

AS A

AS C

AS BAS D

PIX A

PIX C

PIXCentral

PIX D

PIX: Interconnection Point

PTTMetro/PTT.br - Regional Metro Ethernet Non-Blocking Switch/Peering Fabric

http://ptt.br/


PIX CentralC1

PIX CentralC2

PIXRemote

PTTMetro/PTT.br – High Availability Network Topology Model

PIX: Interconnection Point

Dark Fiber Pair

http://ptt.br/


PTTMetro/PTT.br – Operational Responsibilities

NIC.br

PTT.br is responsible for:

Installation, Management, Administration, Monitoring and Supporting all IX locations.

Always keeping Neutrality and High Quality as main targets.

Highlight: PTT.br is responsible to provide enough capacity to sustain bandwidth demand

on connection between PIX: (e.g. 1GE, 10GE, nx 10GE with DWDM).

PIX

Each entity that hosts a PTT.br PIX is responsible to provide continuous and high quality:● IDC Infrastructure

Rack Space, Electrical Energy, Refrigeration, Physical Security,

Operational Hand, etc● Dark Fiber Pair (preferably redundant) to Central PIX

http://ptt.br/


PTTMetro/PTT.br – São Paulo – PIX Topology

http://ptt.br/


PTT.br – Actual Domain of Operation

BRAZIL

http://ptt.br/


PTT.br Locations after PTTMetro Project was Started in 2004

● Brasília● Rio de Janeiro● São Paulo

http://ptt.br/


PTT.br Locations Currently in Operation

Each location is an independent IX

http://ptt.br/


PTT.br Locations Currently in Operation – Two Recently Activated

http://ptt.br/


All PTTMetro Locations are Isolated

The main purpose for PTTMetro locations is to allow the local traffic to

stay on the location.

The Brazilian Internet Steering Committee do not intend to interconnect PTTMetro

Locations and compete with telecommunications companies.

PTTMetro project stimulates and support inter locations transport services done

by participants companies.

PTTMetro have defined some transport modes in order to optimize common

resources and reduce costs that are already in production

(e.g. Campinas <=> São Paulo by Fasternet company)

PTTMetro/PTT.br – IXP Locations

http://ptt.br/


NIC.br - Brazilian AS Distribution

http://ptt.br/


NIC.br - Brazilian AS Distribution

http://ptt.br/


NIC.br/PTT.br – IXP Locations and Brazilian AS Distribution

Brazilian Autonomous Systems (AS) ~2200

PTT.br IXP Locations

http://ptt.br/


AmericanaBelemBelo HorizonteBrasiliaCampina Grande

Campinas

CaxiasCuritiba

FlorianopolisFortalezaGoianiaLajeado Londrina

Manaus

MaringaNatal

Porto AlegreRecifeRio de JaneiroSalvadorSao Jose do Rio PretoSao Jose dos CamposSao PauloVitoria

PTT.br – Participants Distribution per Location

http://ptt.br/


PTT.br – All Locations Aggregated Traffic

http://ptt.br/


PTT.br – Day Sample Traffic per Location

http://ptt.br/


PTT.br – All Locations Aggregated Exchanged Traffic Growth

Aug/2007

Feb/2008

Aug/2008

Feb/2009

Aug/2009

Feb/2010

Aug/2010

Feb/2011

Aug/2011

Feb/2012

Ago/2012

Fev/2013

Ago/2013

0

5

10

15

20

25

30

35

40

45

50

Peta

byte

s

http://ptt.br/


0506

0708

0910

1112

1314

1516

1718

1920

2122

2300

0102

0304

0

20

40

60

80

100

120

140

160

180

200

Week Day Comparison

PTT.br Sao Paulo

2011 2012 2013

Time

Gb

ps

PTT.br – Three Years Traffic Curve Comparison

http://ptt.br/


0506

0708

0910

1112

1314

1516

1718

1920

2122

2300

0102

0304

0

20

40

60

80

100

120

140

160

180

200

Week Day Comparison

PTT.br Sao Paulo

2011 2012 2013

Time

Gb

ps

Comercial Hours Reference (8am to 6pm)


http://ptt.br/


0506

0708

0910

1112

1314

1516

1718

1920

2122

2300

0102

0304

0

20

40

60

80

100

120

140

160

180

200

Week Day Comparison

PTT.br Sao Paulo

2011 2012 2013

Time

Gb

ps

Comercial Hours Reference (8am to 6pm)


http://ptt.br/


0506

0708

0910

1112

1314

1516

1718

1920

2122

2300

0102

0304

0

50

100

150

200

250

Sunday Comparison

PTT.br Sao Paulo

2011 2012 2013

Time

Gb

ps


http://ptt.br/


0506

0708

0910

1112

1314

1516

1718

1920

2122

2300

0102

0304

0

50

100

150

200

250

Sunday Comparison

PTT.br Sao Paulo

2011 2012 2013

Time

Gb

ps


http://ptt.br/


0506

0708

0910

1112

1314

1516

1718

1920

2122

2300

0102

0304

0,00%

1,00%

2,00%

3,00%

4,00%

5,00%

6,00%

7,00%

Week Day Relative Comparison

PTT.br Sao Paulo

2011 2013

Time

Byt

esPTT.br – Three Years Traffic Curve Comparison

Relative Analyses: per hour proportional to full day traffic exchanged

http://ptt.br/


0506

0708

0910

1112

1314

1516

1718

1920

2122

2300

0102

0304

0,00%

1,00%

2,00%

3,00%

4,00%

5,00%

6,00%

7,00%

Week Day Relative Comparison

PTT.br Sao Paulo

2011 2013

Time

Byt



http://ptt.br/


0506

0708

0910

1112

1314

1516

1718

1920

2122

2300

0102

0304

0,00%

1,00%

2,00%

3,00%

4,00%

5,00%

6,00%

7,00%

8,00%

Sunday Relative Comparison

PTT.br Sao Paulo

2011 2013

Time

Byt



http://ptt.br/


0506

0708

0910

1112

1314

1516

1718

1920

2122

2300

0102

0304

0,00%

1,00%

2,00%

3,00%

4,00%

5,00%

6,00%

7,00%

8,00%

Sunday Relative Comparison

PTT.br Sao Paulo

2011 2013

Time

Byt



http://ptt.br/


PTTMetro/PTT.br – Peering Agreements

Multi-Lateral Peering Agreements (MLPA)

IP (v4/v6) traffic exchange between all participants.BGP sessions established between participants and IXP route servers.Different MLPA VLANs for IPv4 and IPv6.

Bilateral Peering Agreements (BPA)

Shared VLAN ModeIP traffic exchange only between participants.Use the same MLPA VLANs.

Dedicated VLAN ModeIP traffic exchange only between participants (e.g. Internet Transit).Use a dedicate VLAN for each peering agreement.

http://ptt.br/


MLPA IPv4(e.g. VLAN tag 10)AS A AS B

MLPA IPv6(e.g. VLAN tag 20) AS C

AS DDedicated

VLAN(e.g. tag 2010)

AS E

AS FDedicated

VLAN(e.g. tag 2020)

AS G

PTTMetro/PTT.br – Logical Connection Structure per Location

http://ptt.br/


PTTMetro/PTT.br – Reference Model

AS A AS BIP (v4|v6)

Fundamental Definition

http://ptt.br/


PTTMetro/PTT.br – Basic Operational Model – Allowed Traffic

AS A AS BMAC A MAC B

PTT.brLocation

Peering Fabric

Allowed Frames with Ethertypes:● 0x0800 - IPv4● 0x0806 - ARP● 0x86dd - IPv6

IP (v4|v6)

http://ptt.br/


PTTMetro/PTT.br – Extended Operational Model – Multiple AS per Single Port

AS A MAC A

PTT.brLocation

Peering FabricMLPA

VLAN C

AS D MAC D

NSPTransportProvider

VLANA

VLANB

VLANB

VLANA

Use Different VLAN Tags for Logical Isolation (IEEE 802.1Q)

http://ptt.br/


PTTMetro - Economically Interests for Telecommunication Companies

● Reduction of Transit and Interconnection Costs

● Last/First Mile Provisioning

● IP Services InterconnectionUsing dedicated VLANs to provide L2 logical isolation for:Internet Transit (IPv4 and IPv6), Backup, Storage, VoIP, etc

● Inter Locations Transport

● Interconnection Points (PIX) Hosting

● Neutral Facilities for the Brazilian Telecommunications Agency Regulated Interconnections

PTTMetro/PTT.br – Economical Summary

http://ptt.br/


PTTMetro/PTT.br – SIMET

SIMET.NIC.BR

Internet Traffic Measurement System

NIC.br AS14026 operating in most

of PTT.br locations

http://ptt.br/


PTTMetro/PTT.br – SIMET

http://ptt.br/


Anycast Copies at 14 PTT.br IX Locations

Root: L.root-servers.net.BR cctld: [b-f].dns.br

PTTMetro/PTT.br – Redundant Authoritative DNS Servers Service

http://ptt.br/


PTTMetro/PTT.br – Redundant Authoritative DNS Servers Service

http://ptt.br/


PTT.br – Participação no Euro-IX

European Internet Exchange Association (Euro-IX)

https://www.euro-ix.net/

PTT.br is an Euro-IX member since 2010

with personal attendance on meetings since 2011.

http://ptt.br/


PTT.br – Participação no LAC-IX

Latino American and Caribean Internet Exchange Asociation (LAC-IX)

http://lac-ix.org/

PTT.br is a cofounder and member of LAC-IX.

LAC-IX

http://ptt.br/


PTTMetro/PTT.br – PTT Forum 7 – São Paulo, Brazil

The PTT Fórum 7 event will take place in São Paulo, Brazil on the 2nd and 3rd of December 2013.

PTT Fórum normal audience is composed by Brazilian Autonomous Systems (AS) and PTTMetro/PTT.br IX participants (some of them are international companies).

The event will be translated between Portuguese and English.

The event will be part of the Brazilian Internet Infrastructure week together with an IPv6 Forum and GTER/GTS (Network Engineering, Operation and Security Working Groups).

http://ptt.br/pttforum/

http://ptt.br/


http://ptt.br/

[email protected]

PTTMetro/PTT.br – Thanks & Contact

Thanks | Obrigado

http://ptt.br/

Date post:	16-May-2018
Category:	Documents
Upload:	duongquynh
View:	217 times
Download:	1 times

Peering in Brazil PTT - IX.brix.br/doc/nic.br.ptt.br.ietf88.isoc.peering-brazil.2013110503.pdf ·...

Documents