The Data Logistics Toolkit
Martin Swany
Professor, School of Informatics and ComputingExecutive Associate Director, Center for Research in Extreme
Scale Computing (CREST)Indiana University
The Data Logistics Toolkit
• Logistics - the management of the flow of resources from the point of origin to the point of consumption
• The DLT integrates local and distributed storage infrastructure, file transfer software, performance monitoring and tuning
• The DLT software distribution supports the creation of network- optimized data nodes
DLT Overview
• Set of packages with configuration scripts, etc.
• Allows the configuration of – DTN with GridFTP– IBP storage depot for content distribution– Phoebus WAN accelerator– On-ramp for Internet2 AL2S using XSP
• Includes Periscope/perfSONAR monitoring• Automatic network tuning
DTN with AL2S On-Ramp
• Working with the Globus team at U. Chicago and Argonne
• Leveraging our eXtensible Session Protocol (XSP) to create end-to-end, “sessions”– user-network interface (UNI)
• XSP daemon acts as network controller– signals AL2S/OESS, OSCARS, OpenFlow
• GridFTP XIO driver, updating to use the Globus Transfer Network Controller API
• Generic, transparent on-ramp to circuit networks like AL2S
WAN Acceleration
• A key reason the Science DMZ model “works” is the separation of lossy access networks from high-bandwidth, long-latency links
• Termination of TCP connections in “middleboxes” can increase throughput by reducing the RTT
• Protocol translation
• Storage in the network to buffer and burst
Distributed Storage for Content Distribution
• IBP provides a primitive, scalable, in-network storage service
• File-like abstractions can be built on top of this• Uses a data structure known as an exNode (like
a Unix inode) to track allocations• These basic building blocks can be used to build
various instances– Parallel filesystem– Distributed RAID-like storage– Content distribution network– Bittorrent-like peer to peer transfers
Architecture• Unified Network Information Service (UNIS)
– Descendant of perfSONAR Lookup and Topology Services– Network and service “graph”
• Intelligent Data Movement Service (IDMS)– Data dispatcher– Operates on UNIS data– Spawn storage services dynamically in GENI
• Periscope/perfSONAR– Monitoring for operational integrity and optimization, BLiPP
• Storage Services– IBP, prototype based on Ceph
• Other services– Data transfer (GridFTP), WAN acceleration
Earth Observation Depot Network (EODN) –An open, community specific content distribution
network for remote sensing data
Landsat data• Landsat 8 launched February 13th, 2013
• Covers the entire land surface of the Earth every 16 days – 8 day offset from Landsat 7
– ~700 scenes each day
• Each scene contains a GeoTIFF product: high-resolution sensor images
– ~1GB compressed, 2GB uncompressed
• Traditionally used for environmental monitoring and land use and land cover change studies
EODN
Client
EODN (DLT) WISC
IUNYSER
MIZZ
RealEarthUW-Madison
UNISDMS
discover / measure
(3) stage sensing data
(2) harvest
(6) Processing…
(7) WMS upload
(5) fast download
EODNHarvester
(1) subscribe
(4) publish
webGUI
Landsat Ground Network
Cisco Appliance Platform
• In collaboration with Internet2, Cisco and Fusion-io
• Cisco C220 server– 2x Intel® Xeon® E5-2680, 16 cores@4GHz, 64GB DDR3 RAM– Fusion-io ioDrive2 1.2 TB
• CentOS 6.4 Linux with DLT RPMs and tuning for data transfer throughput
12
Acknowledgements
• Staff Scientist Dr. Ezra Kissel leads the DLT development efforts, PI of the GENI IDMS effort
• CC-NIE integration project with U. Tennessee and Vanderbilt U.
• CC-NIE integration project with the Globus team at U. Chicago and Argonne Nat’l Lab
• EODN development with AmericaView, U. Wisconsin
Phoebus-SLaBS performanceGridFTP transfers over dedicated 10G path, increasing WAN latency, 4ms LAN RTT and .001%
edge loss
