1SouthAmericanAstronomicalCoordinationCommittee(SAACC)Meeting-April17,2019
LSSTNetworksConstructionandCommissioning
JeffreyKantor
SouthAmericanAstronomyCoordinationCommittee(SAACC)Meeting
April17,2019
2SouthAmericanAstronomicalCoordinationCommittee(SAACC)Meeting-April17,2019
SummitSiteSummitFacilityTelescopeandCamera
DataAcquisitionCrosstalkCorrection
NetworksandPathDiversitybetweenSitesandCenters
BaseSiteBaseCenter
Long-termstorage(copy1)DataAccessCenter
DataAccessandUserServices
HQSiteHQFacility
ObservatoryManagementScienceOperationsEducationandPublic
Outreach
ArchiveSiteArchiveCenterAlertProduction
DataReleaseProductionCalibrationProductsProduction
EPOInfrastructureLong-termStorage(copy2)DataAccessCenter
DataAccessandUserServices
FrenchSiteSatelliteProcessing
CenterDataReleaseProduction
3SouthAmericanAstronomicalCoordinationCommittee(SAACC)Meeting-April17,2019
LSSTLongHaulNetworkLinks(BaselineFY21)
Tucson
LaSerena
CerroPachon
Santiago
SaoPaolo
Chicago40x10GbAURA(ScienceData)
20x10GbAURA(OCS/TCSControl)
Panama
1x100Gb1x40–100GbREUNA
2x100GbAmlight/ANSP/RedCLARA
CC-IN2P3Lyon
Miami
100Gb(spectrum)Amlight/AngolaCable
Champaign
2*100GbNCSA/ICCN
Santiago
BocaRaton
10GbAmlight/internet2
10GbIN2P3
10x10GbNon-LSSTAURA(Fail-over) 100Gb
(spectrum)AmLight/RNP/RedCLARA(viaBuenosAires)
SecondaryPath
PrimaryPath
SLAC,OtherDOE
10GbESnet(institutional)
2x100GbEsnet/FLR/i2
4SouthAmericanAstronomicalCoordinationCommittee(SAACC)Meeting-April17,2019
ESNetforLSST
WASH
PHILNEWY32AOANEWY1118TH
BOSTALBA
BUFF
CLEV
JACK
CHAR
RALE
CHAT
ASHB
PITT
ATLA
DETR
INDI
CINC
LOUI
NASH
MEMP
JCSN
BATO
DALL
KANS
STLO
TULS
SANA
ALBQ
ELPA
DENV
PUEB
PHOE
TUCS
SALT
LASV
SAND
LOSA
SANL
RENO
BOIS
SEATOLYM
PORT
EUGE
SACR
SUNN
STAR
CHIC EQCH
HOUS
HOUH
BALT
Ciena_Map v12pld 9/30/2016
ESnet6 Optical Footprint: Add/DropsWave options Atla-Chic
atla-cr5rtr
LSSTDWDM
ESnetIP/MPLS core
star-cr5rtr
chic-cr5rtr
to Florida
MREN 8700
StarLight
NCSArtr1
ATLA HUB180 PeachTree(Site A)
Pre-FY21
100G100G
100G
100G
100G
100G
Before FY21 but after 2018 there will be a switch between the DWDM and alta-cr5 rtr. The handoff will be 1x100G.
atla-cr5rtr
LSSTDWDM
star-cr5rtr
chic-cr5rtr
to Florida
MREN 8700
Starlight
NCSArtr1
Post-FY21
100G 100G
100G
100G
100G
ESnetDWDM
ESnetDWDM
ESnetDWDM
LSST SW
LSST SW
LSST SW
100G
100G
100G
100G
100G
100G
PS
PS
PS
Last update 1/18/2018
600 W. Chicago(Site B)
710 N. Lake Shore Drive(Site C)
LSST SW
PS
NCSArtr2
NCSArtr2
710 N. Lake S
hore Drive
(Site C
)
600 W. C
hicago
(Site B)
100G
ATLA HUB180 PeachTree(Site A)
100G
FY20(2x20Gbps) FY21+(2x100Gbps)
5SouthAmericanAstronomicalCoordinationCommittee(SAACC)Meeting-April17,2019
Base–LDF100GbpsNetworkDemonstration
− FollowinguponthefirstsuccessfultransferofdigitaldataoverLSST/AURAfiberopticnetworksfromtheSummitSiteonCerroPachon,ChiletotheBaseSiteinLaSerena,ChileandontotheArchiveSiteatNCSAinChampaigninDecember2017,thatachieved44Gbpssustaineddatarate.
− 100GbpsdemonstrationfromLaSerena–NCSANovember14,duringSupercomputing2018.Datasetis10TBofDECampublicdata.UsingSCInetconnectionsfromMiami–Dallas–Chicago.DM-provided“watch”JupyterHubapplicationwillbeusedtomonitortransferfromDataTransferNode(DTN)toGPFSfile-system/disk.
Via Atlantic
DWDM
LSSTDWDM10x10G
1
2
3
4
5
6
La Serena REUNA
LSSTDWDM10x10G
1
2
3
4
5
AmLightAndes1
1/1
1/2
1/3
1/4
1/5
3/2
3/110G SR
1G UTP
DWDM
AmLight
Via Pacific
100G Leased AmLightAMPATH01
7/2
AmLightAMPATH02
7/2
8/1
Cent
ury
Link
100G LR4
CLARA/SCL AMPATH ICCN NCSA/NPCF
5x100G
7/1
7/1
NCSAEX9214
NCSAMX960
NIC
9/1/0
100G DTNeth0
6/1
Dell Z9100
7
8
9
10
en
p6
s0
100G DAC
6
7
8
9
10
1/6
1/7
1/8
2/6
2/7
AmLightAndes2
3/2
3/1
6/1
SC18SCINet
StarLight & MREN
100GDTN
Version: SC18.0929.01
Date: 09.29.2018
Author: LSST-NET
Ready
Pending
OOB
NVMeNVMeNVMe
NVMe
100G
DTN
NVMeNVMe
NVMeNVMeNVMe
NVMeNVMe
NVMe
Co
rsa
De
ll Z
91
00
-ON
AMIS
Sens
or
8700HD
SC18
AMIS
Sens
or
8/2
AMISSensor
Mirror
Mirror
Mirror
1
14
3321
OOB
SC15
SC14
SL-10
100G DTNs
6SouthAmericanAstronomicalCoordinationCommittee(SAACC)Meeting-April17,2019
End-to-EndNetworkBandwidthEvolution
7SouthAmericanAstronomicalCoordinationCommittee(SAACC)Meeting-April17,2019
Summit–BaseFiberPostImprovements
8SouthAmericanAstronomicalCoordinationCommittee(SAACC)Meeting-April17,2019
BaseDataCenterFY19
From: Luis Corral [email protected]: RE: BDC racks in La Serena
Date: January 30, 2019 at 1:26 PMTo: Ron Lambert [email protected], Jeff Kantor [email protected]
Therackswereunloadedsafelyandwemarkedtheperimeterwithhelpfromthesafetyteam,I
askedGiovannitoinstallacoverifpossibletoprotecttheracksfromthemorningdew.My
preliminaryreportisthatalltheracksarrivedingoodcondi>onbuttheofficialinspec>onhasto
bedonebyRon,
--LuisCorralNetworkArchitect–LargeSynop>cSurveyTelescope(LSST)
Email:[email protected]
Phone:+56-51-2205320
From:RonLambert
Sent:Wednesday,January30,20192:37PM
To:JeffKantor<[email protected]>;LuisCorral<[email protected]>
Subject:Re:BDCracksinLaSerena Wildo. I am also requesting if there is room in the bdc to store them.Ron
Get Outlook for Android
9SouthAmericanAstronomicalCoordinationCommittee(SAACC)Meeting-April17,2019
RecentAccomplishments
− Base–LDF100GbpsDemonstrationatSupercomputing2018− StartedBaseFacility
– Installationofracks,PDUs,etc.– MoveofexistingLSST,CISS,Geminiequipment– InstallationofnewLSSTequipment– Cabling,wired/wirelessnetworks,VOIPinoffices,etc.
− InstalledfiberforAuxiliaryTelescope(startofobservingendofFY19)− CompletedrepairsonSummit–BaseFiberposts(interruptedbyearthquake)− FinalizedagreementforESnetservice
– Atlanta–Chicago– FY202x20Gbps,FY212x100Gbps
10SouthAmericanAstronomicalCoordinationCommittee(SAACC)Meeting-April17,2019
FY19RemainingMajorActivities/Milestones
− CompleteSummitNetworkcabling,accessswitches,Wi-Fi,VOIP(allFY)− Summitserverinstallations(AuxTel,EFD,MW,ESAS/ECS,TMA,Camera
rooms,...)(allFY)− InstallLSSTDWDMSummit–Base(May)− InstallBaseDataCenterracks,moveexistingequipment,installnew
networkswitchesandservers(May)− DWDMpurchaseandactivationofSpectrumLink(May)− Cableoffices,rooms,installaccessswitches,Wi-Fi,VOIP(June)− ImplementationofFY202x20GbpsESNet(September)