5
Data-over-Time-Space Distance: Challenges, Current R&D Trajectories and Future Raj Kettimuthu
Data-over-Time-Space Distance: Challenges,
Current R&D Trajectories and Future
Raj Kettimuthu
• Eliminate queue wait-time for online analysis - incentivize batch jobs
• Eliminate network contention - automated provisioning of network
• Eliminate disk I/O - stream data directly from detector to compute memory
Challenges and Impediments to Data over Time-Space
Challenges and Impediments to Data over Time-Space
Peak vs average network utilization
Next Big Advances on Current R&D Trajectories
Explain performance, identify bottlenecks etc. Automated provisioning of end-to-end network resources
Streaming analysis of large-scale data
Autonomous Science Infrastructure
Science Instrument
SupercomputerArchival storage
Analytics Visualize
1 PB in a day data transfer from Argonne to NCSA.
Why are we tuning?
Why are we driving? Self-managing science infrastructure
