Data-over-Time-Space Distance: Challenges,

Current R&D Trajectories and Future

Raj Kettimuthu

• Eliminate queue wait-time for online analysis - incentivize batch jobs

• Eliminate network contention - automated provisioning of network

• Eliminate disk I/O - stream data directly from detector to compute memory

Challenges and Impediments to Data over Time-Space

Challenges and Impediments to Data over Time-Space

Peak vs average network utilization

Next Big Advances on Current R&D Trajectories

Explain performance, identify bottlenecks etc. Automated provisioning of end-to-end network resources

Streaming analysis of large-scale data

Autonomous Science Infrastructure

Science Instrument

SupercomputerArchival storage

Analytics Visualize

1 PB in a day data transfer from Argonne to NCSA.

Why are we tuning?

Why are we driving? Self-managing science infrastructure