ResearchChannel Michael Wellings, Director, Engineering Immersive Medical Telepresence Workshop...

ResearchChannelResearchChannel

Michael Wellings, Director, EngineeringImmersive Medical Telepresence Workshop Phoenix 2006

Innovations in Interactive HD Video Over High-Bandwidth Networks September 6-7, 2006

Think Forward. Think ResearchChannel.

What Is ResearchChannel?

As a consortium of universities and research institutions, we are an intellectual community that makes knowledge available to all by sharing our developments, insights and discoveries with a global audience.

We bring together ideas from the world’s premier institutions and disseminate those ideas to the public directly.

We engage our audience in the research process by communicating developments as they unfold.

We experiment with technology to enable alternative, leading-edge exchanges of our resources.

We are committed to looking forward, both in terms of our technological innovation and our continual diversification and expansion of resources for our audience.


Pioneering Technology Innovations

To advance global networking technologies

To explore new methods of media distribution and sharing for teaching learning and research

To further multidisciplinary multinational scientific collaboration

Because the consortium is uniquely qualified to do so


Arizona State University

California State College, Monterey Bay

Duke University

George Mason University

Indiana University, School of Informatics

Johns Hopkins University

Massachusetts Institute of Technology

National University of Singapore

New York University

Pennsylvania State University

Rice University

Rutgers, The State University of New Jersey

Stanford University Medical Center

Texas A&M University

Tulane University, Freeman School of Business

Our Consortium ofUniversity Participants

Universidad de Puerto Rico

Universidade de São Paulo

University of Alaska - Fairbanks

University of Chicago

University of Hawaii

University of Kentucky

University of Maryland

University of Michigan

University of Pennsylvania

University of Southern California

University of Virginia

University of Washington

University of Wisconsin-Madison

Virginia Tech

Yale University


AARNet

Advanced Network Forum

AJA Video Systems Inc.

Fujinon

Howard Hughes Medical Institute

IBM Corporation

Intel Corporation

Internet2

Johnson & Johnson

Library of Congress

Microsoft Research

National Academies

National Academy of Engineering

andResearch Centers/Affiliates

National Academy of Sciences

National Institute of Nursing

National Institute of Standards and Technology

National Institutes of Health

National Library of Medicine

National Science Foundation

National Sea Grant College Program

NTT Labs

Pacific Northwest Gigapop

Poznañ Supercomputing and Networking Center

R1edu.org

SURFnet

Vulcan Northwest Inc.

Wisconsin Public Television


OurNewest Participants


Cable and Satellite TelevisionDishNetwork satellite system

•11.4 million homes

Cable systems•10.3 million homes

OurMulti-platform Distribution

Streaming Worldwide

• Video on demand

• Broadband and multiple bit rate

ResearchChannel ResearchChannel DistributionDistributionResearchChannel ResearchChannel DistributionDistribution


21.7 million households

DishNetwork satellite system

• 11.5 million homes

Cable systems• 10.2 million homes• 35 states

U.S. Television Distribution


Ideally suited to VOD platform

Charter Communications agreement adds

2 million VOD subscribers

Launch first quarter 2006 with 15 titles per month

Google Video, Open Media Network

New Distribution Initiatives:Cable VOD


DigitalWell: Grid Enabled Digital Asset Management

Project Focus

• Easy way to acquire, collect, classify, store ,deliver large collections of digital media over IP networks.

• Proxy for any type of large data sets but initially focused on video and audio assets – content agnostic

• Includes broadcast/Internet Integration

• Exploits next generation networking to ensure high quality – Deliver Realism

• Easy-to-use Web services-based interface compatible with current Web browsers and computing platforms.

• Uses pluggable authentication to ensure security and control access to collections.

• Scalable architecture ensures that collections can be built, accessed, searched and shared between disparate networked communities.

• D-Lib/Data Grid Interoperation via SRB and OAI for content and metadata sharing..

• Middleware – modular integration modelMetadata, DRM/IP, AAI, WSAPI, Grid

• Automation – End to EndCapture, Describe, Preserve, Deliver


Grid Enabled Digital Broadcast

DigitalWellSRBTSM

Metadata

Acquisition

Tape IngestDub

Final Cut Edit

Suites

TelevisionScheduling BroadcastServices

StorageTape/DiskServices

EncodingCaptioningServices

StreamingVoD

Services

ContentDistributio

nServices

Manage Digital Essence Edit, Transcode, …Automate Metadata Device Acquisition MXF, AAF, SMPTE, MPEG7,…Archive/Preservation Re-purpose, Footage, …

Service Flows


SR

BS

RB

1st TierDisk Cache

Stage DiskCache

Stage DiskCache

1st TierDisk Cache

Near-lineArchive

Near-lineArchive

Sto

rage A

bstractio

nS

torag

e Ab

straction

Data Grid

Data Grid



Data Grid - Digital Library Integration

SRB and Digital Libraries• Conduit for sharing metadata

and/or content in a federation• Platform for building a preservation

environmentD-Libs using or considering SRB • MIT D-Space - +120 sites• Cornell Fedora – +30 sites• ResearchChannel DigitalWell• UCSD TV• CDL

Data Grids• WUNGrid• PRAGMA Grid



SC’05 DigitalWell SRB Data Grid Diagram – HD Collaborative Video Demonstration


DigitalWell Collections Existing, Ongoing, New …

+2100 hrs ResearchChannel, UWTV+180 Ocean Science uncompressed HDMicrosoft Research Lecture SeriesMulti-University Research LibraryForestry Old Growth Satellite ImageryDeep Space Astronomy – WUNGrid ProjectKEXP Radio Live Broadcasts, In Studio Sessions+15,000 hrs EthnomusicologyResearch Instructional Medical DatasetsUW Library Collections

Innovations in Innovations in TechnologyTechnologyInnovations in Innovations in TechnologyTechnology


Why?

To advance global networking technologies

To explore new methods of media distribution and sharing for teaching learning and research

To further multidisciplinary multinational scientific collaboration

Because the consortium is uniquely qualified to do so


ResearchChannel is a collaboration among experts in Internet networking, storage/search infrastructure development, emerging streaming media and interactive technologies, digital television engineering, and video production.

On the Leading Edge


Projects

First Internet HDTV transmission - iHDTV

Digital Asset Management System

Development - DigitalWell

Automation of multiple format encoding

Webcasting (SD and HD over IP in multiple

formats)

Streaming to handheld devices

ResearchChannel Internet2 Working Group


Advanced Media Delivery Methods

“Big Video”• HD Multiple Unicast• HD Multicast• SD Multicast• SD Multiple Unicast• WMV VOD• HD VOD

“small video” • Enhanced Phone unicast delivery• “Podcasting”

AUP of R&E networks (NLR, for example) can make 10gige Lambdas availableThe Commodity Internet will catch up


Advanced on-line Services

2500 hours of content on the web in multiple formats:• MPEG2 @ 5.6mbps• WMV 1300mbps• WMV multi-resolution feed• Pocket-video files being created

Programming is encoded automatically and pushed to the webWhen the show first airs on the channel, the encoded VOD version is available on the webGoogle downloads of ResearchChannel programming available soon


iHDTV Software Suite

iHDTV Explained• iHD1500• iHD270• HD to the Desktop

WindowsXP-based application suiteReleased as Open Source as of April 24th, 2006• Announcement at Internet2 Spring Member Meeting


iHDTV Explained

iHD1500• Uncompressed SMPTE 292M 4:2:2• Data rate total approx 1.5 gbps• Requires:

high-end HD capture cardsPCI Express platformsWindows XP2 x gige network connectionJumbo frame transport and routing


iHDTV Explained

iHD270 (first introduced aug 99)• Sony HDCamtm compression• SDTI data format 270mbps• AJA Xena I/O• Requires:

AJA Xena-HD capture cardsDual Processor P4Windows XPSony HDCam Hardware encoder/decoderGige network connection


Sept 2005 - iGrid San Diego• Enhanced HD interactive - USA118: Global N-Way

Uncompressed Interactive Conferencing• Underwater research using HD from SS Thompson – USA119:

20,000 Terabits Under the SeaNov 2005 - SC05 Seattle• Enhanced HD Interactive Conferencing/HD Storage, capture

and editing using SRB (Storage Resource Broker)

Recent Demonstrations


iGRID 2005 San Diego

USA118: Global N-Way Interactive HDUSA119: 20,000 Terabits under the sea


iGrid DemonstrationUSA118: Global N-Way Interactive HD


Technology Support


iGRID 05 – USA118

Sept 2005 - iGrid San Diego• Enhanced HD interactive - USA118: Global N-Way

Uncompressed Interactive Conferencing• Remote sites:

1. Pacific Northwest Gigapop - University of Washington - Seattle

2. The WIDE (Widely Integrated Distributed Environment) Project - Tokyo

3. University of Wisconsin - Madison4. University of Michigan – Ann Arbor5. SURFnet - Amsterdam


iGRID 05 – USA118

Sept 2005 - iGrid San Diego• Remote site equipment:

2 RX iHD1500 Hosts (multicast from iGRID)1 TX iHD1500 Client (unicast to iGRID)

• Central site equipment:6 RX iHD1500 Clients2 TX iHD1500 Hosts (Multicast)Evertz VIP-12 HD Video Tile GeneratorMultichannel mix-minus audio system


iGRID 05 – USA118

iHD500 – first demonstrated at SuperComputing 2004• Real-time HD communication: Australia and Seattle >

Pittsburgh @ 1.5gbps each direction• At that time relatively high latency (1500ms RT)

500ms hardware/software one-way250ms network delay one-way



iGRID USA 118 Network Diagram


iGRID USA 118


iGRID USA 118



iGRID 05 – USA119

Sept 2005 - iGrid San Diego• First ever live HD/ip from a ship at sea to viewers on

shore• Ku-Band equipment upgrade to SeaTel antenna• Careful RF engineering to design satellite Link-Budget• Real-time MPEG-2 MP@HL encoding • Ip gateway• Satellite modem 20mbps


Internet HDTV: VISIONS’05


iGRID USA 119


iGRID USA 119 Network


iHD1500 application

SMPTE 292M/ip• ~1.5gbps

1080-60i HD video with multiplexed audioResearchChannel partner Intel PCE-Express 3.4GHz Dual Xeon platformsResearchChannel partner AJA Video Systems supplied initial round of Xena-HD capture boards


iHD1500 application

Latency about 4 frames end to end plus network delay• 4 frames=133ms or ~ 1/7 sec• Network delay Australia>Philadelphia ~ 250ms• Satellite latency about 250ms per hop• H.323 devices about 220ms plus network delay• No significant delay in video equipment


Software Enhancements

iHD1500 Enhancements:• tile display generated in software• Audio mixing in software• Audio mix-minus in software• Video switching in software


iHDTV Open Source Group•Launched Spring quarter 2006• iHDTV Trusted Partners Group formed•Advisory groups:

Executive TeamTechnical Team

•Enhancement planed as first step•Wide deployment desired•Multicast tunnel nodes• Interoperability with other HD systems is an

important goal

iHD-X: Open Source Initiative


High Definition Video to the Desktop

FORMATS• MPEG2 MP@HL

• VC-1 (WMV-HD)

• H.264/AVC/MPEG4 Part 10

• HDV (MPEG2 MP@H14)

PLAYERS• VLC

• WM9/10

• QuickTime/MPEG4

• VLC


Advanced Delivery Methods

The content is important, not the delivery method• We will use what works best for the application• Quality will scale to match the receiving device

Multiple delivery methods will be used• Wired delivery for stationary receivers• Non-wired delivery for mobile devices

As high speed connectivity proliferates, over-the-air transmission becomes less important for stationary receivers• The multiple use, highly connected devices in the home receive all

content over high speed network connections using several forms of transport media

Ip over cable, fiber, copper, RF

• CATV operators will migrate to an all-IP delivery scheme and broadcasters will be hard-pressed to compete

• Traditional Broadcasting’s last stand will be rural areas in advance of expanding IP networks


Advanced Delivery Methods

It took about a year for cable modems downstream speeds to increase from 2mbps to 8mbps in the Seattle area

High bandwidth connectivity means non-linear viewing of multi-res content which will change the face of media deliveryGlobal reach

Old Model:• Broadcast in your own geographic area• Compete with local broadcasters and print media

New Model:• “X-cast” (Podcast, multicast, unicast etc) to the world and

become part of an immense soup of content• Compete with everyone for a small slice of a universal market


ResearchChannel Advanced on-line Services

ResearchChannel satellite feed on the network• 233.0.73.29 MPEG2@ 3.2mbps

Live 1080i HD video of Mt Rainier• 233.0.73.26 MPEG2 MP@HL @ 20mbps

Live 720p HD video of Mt Rainierhttp://www.researchchannel.org/tech/desktopclients.asp

HD VOD 720p WMV-HD http://www.researchchannel.org/visions05/hdpresentation.asp

HD VOD 1080i MPEG2 ML@HLhttp://www.researchchannel.org/tech/desktophdsamples.asp

KEXP-FM Audio-on-demand; uncompressed audio webcastinghttp://www.kexp.org



Successful demonstration home delivery of WMV-HD@720p over CATV ModemsDeveloping VOD archive for oceanographic HD videoKEXP-FM on-line services have a world-wide audience that equals Seattle broadcast listener numbers



Making Television HistoryVisions ’05 - Emmy Award Nominee

First-ever live HD 1080i video/IP streamed around the world• SMPTE 292M multicast and unicast @ 1.5gbps• MPEG 2 MP@HL multicast• WMV-HD multicast with Unicast automatic failover



Seattle Science Foundation Project – testbed for newMedical technology with HD video archiving

WWAMI: collaborative medical education viaAdvanced video technology


Internet HDTV: VISIONS’05

http://www.researchchannel.org/visions05/multimedia.asp


UW Medical Center: Inside Access -Brain Tumor Surgery

Brain Tumor SurgeryThis program profiles an innovative surgical technique for maintaining the speech and language skills of a brain tumor patient. The program introduces viewers to Deborah Kelley, a remarkable patient who bravely allows a camera to follow her for several weeks, from her initial consultation at the UW Medical Center's Neurosurgery clinic and then into surgery.

http://www.researchchannel.org/prog/displayevent.asp?rid=2763


For More Information

www.researchchannel.org

inquires: [email protected]

Michael Wellings Director, [email protected]

Date post:	27-Dec-2015
Category:	Documents
Upload:	doreen-sims
View:	216 times
Download:	0 times

ResearchChannel Michael Wellings, Director, Engineering Immersive Medical Telepresence Workshop...

Documents