End-to-End Performance Initiative
Russ HobbyMay 30, 2001Internet2 Campus WorkshopAtlanta, Georgia
Internet2 Campus Workshop (May 30, 2001) 2
The Problem
Even with high bandwidth network links, the Internet2 community often does not see expected performance.
Internet2 Campus Workshop (May 30, 2001) 3
E2E Perf Initiative Vision
To enable the end-user to obtain optimal performance from the available current and future infrastructure on a routine basis.
Internet2 Campus Workshop (May 30, 2001) 4
Work to Date
Initial planning in the late fall and winter
Campus Workshop in San Diego
Planning Meeting in Ann Arbor
Recasting of work plan
Formation of Design Team
Design Team White Paper
Spring Member Meeting
New Initiative Director, Cheryl Munn-Freemon Starts June 5
Internet2 Campus Workshop (May 30, 2001) 5
Design Team
The End-to-End Performance Initiative Design Team includes:
George Brett, NCSA/NLANR DAST/Web 100
Claudia de Luna, NASA Jet Propulsion Laboratory
Doug Gale, OARnet
Andy Germain, NASA Goddard Space Flight Center
Terry Gray, University of Washington and Pacific/Northwest GigaPoP
Wendy Huntoon, PSC/NLANR NCNE
Basil Irwin, Web100
Cheryl Munn-Fremon, University of Michigan
Ronn Ritke, SDSC/NLANR MOAT
Matthew Schmitz, Cisco Systems
Internet2 Staff Participants:
Guy Almes, Laurie Burns, Steve Corbató, Ted Hanss, Russ Hobby (chair), Kathleen Young, and Matt Zekauskas.
Internet2 Campus Workshop (May 30, 2001) 6
The Initiative is
A Coordinating Structure• Will not replace current activities in the area• Will encourage work where there are missing activities• Coordinate activities to support E2E Performance• Help to move developments into operation
A Communications Facilitator • Promote communications for common areas• Tools for cross-area communications
A Knowledge Repository• Collect and disseminate knowledge gained• Distribute tools developed
Internet2 Campus Workshop (May 30, 2001) 7
Participants
The Initiative is Structured Around Partnerships among
•Applications Communities•Network Operators•Gigapops•Network Researchers•Campuses•Corporate partners• Internet2 Staff
Internet2 Campus Workshop (May 30, 2001) 8
Applications Communities
They are the reason to have the network!
The Initiative will:• Work closely with selected test communities• Focus on helping them do what they want to do• Use their key applications to evaluate and improve network performance
Internet2 Campus Workshop (May 30, 2001) 9
Campuses include the “Ends” in End-to-End
Campus concerns include:
Campus Users - overall performance and end result of the application.
System Administrators - computer hardware and operating system.
Network Operators - performance of the network.
Internet2 Campus Workshop (May 30, 2001) 10
Focus Areas
Applications End-to-End
Host Computer and Operating Systems
The Network
Operational Support
Internet2 Campus Workshop (May 30, 2001) 11
End-to-End Applications
Develop Test Case Disciplines • Study and Resolve Their Problems• Examples:
–High Energy Physics–Astronomy–Medicine
Identify Key Applications to Test Performance–FTP–Video Conferencing–Remote Instrument Control
Internet2 Campus Workshop (May 30, 2001) 12
End-to-End Applications
Develop Techniques and Tools to Make Networks Friendly to Applications
• Applications Design –Best Practices–Resource Determination
• Implementation–Best Practices–Software Libraries–Applications Development Systems
• Operation –Obtaining Resources–Self Tuning Applications–Capabilities to Isolate Problems
Internet2 Campus Workshop (May 30, 2001) 13
Host Computer and Operating System
Web100 is a Key Player for this Area
Techniques and Tools to Analyze• The Various Computer Sub-systems and Software• Different Hardware/Operating System Combinations and present options for to obtain optimal performance
• Optimal Computer Configurations
Publicize Methodologies, Tools, and Results • Case Studies, Best Common Practices• Analysis Tools for Different Computers
Internet2 Campus Workshop (May 30, 2001) 14
Host/OS Sub-Layers
API/library interface for accessing network resources
Kernel interface
Kernel memory-management subsystem
TCP-handling stack
IP-handling stack
Device driver and driver interface to kernel
NIC
Host bus or buses
Memory subsystem
CPU
Disk subsystem
Internet2 Campus Workshop (May 30, 2001) 15
The Network
Establish a Common Measurement Infrastructure• Standard Instrumentation Locations along the Path• Common Data Sets Collected• Applications Reference Servers• Download of Special Testing Software
Develop Analysis Tools• Study Network Behavior• Pinpoint Source of Problems• Determine the Health of the Network
Internet2 Campus Workshop (May 30, 2001) 16
Operational Support
Develop a Coordination and Communication Structure for Support Personnel Groups
• Computer System Administrators, LAN Managers, Campus NOCs
• Access to Experts• Cross-Campus Support
Establish the Performance Evaluation and Review Framework (PERF)
• A Coordination Structure to Study and Resolve Hard Problems
• Help populate the Knowledgebase of Solutions
Internet2 Campus Workshop (May 30, 2001) 17
Operational Support
Other Operational Developments
•Knowledgebase creation and use
•Cross-Domain Trouble Ticket System for use by NOCs (initially) and End-Users (later)
•Standard Sets of Operational Data that everyone can use to determine network capabilities and limitations.
Internet2 Campus Workshop (May 30, 2001) 18
Initiative Management and Support
Initiative Structure• Series of Calls for Participation (CFPs)• Participation by Internet2 Community Partners• Initiative Management Structure• An Initiative Advisory Committee
Internet2 Provides• Initiative Management• Communications Tools• Information Resources and Tools• Evaluation and Assessment
Internet2 Campus Workshop (May 30, 2001) 19
Show Me the Money
UCAID has committed ~$1.5 million in project funding to provide central coordination and support
Initiative coordination activities include proactively identifying potential funding sources and developing funding opportunities
Potential funding agencies have participated in the planning stages and discussions will continue
Internet2 Campus Workshop (May 30, 2001) 20
Next Steps
White paper still open for comments
Design Team work continuesProduce an action plan and post
Develop the Calls for Participation
Specify review process
Issue first set of CFPs, and begin work in specific areas
Form an advisory and management structures
Internet2 Campus Workshop (May 30, 2001) 21
Further Information
End-to-End Performance Initiative
http://www.internet2.edu/e2eperf/
Initiative Design Paper
http://www.internet2.edu/e2eperf/papers/End-to-End-Perf-Design-Paper.pdf