Increasing Situational Awareness via UAV Increasing Situational Awareness via UAV Video Feeds in GIS ApplicationsVideo Feeds in GIS Applications
Lt Col Ricky E. SwardLt Col Ricky E. SwardMr Tim Mr Tim BeermanBeerman
Capt Clint SparkmanCapt Clint Sparkman
US Air Force AcademyUS Air Force Academy
OverviewOverview
AbstractAbstractPurposePurposeBackgroundBackgroundUAVSAT prototypeUAVSAT prototypeUAVs at the AcademyUAVs at the AcademyResultsResultsFuture WorkFuture Work
AbstractAbstractWith the emergence of UAVs and the video payloads available With the emergence of UAVs and the video payloads available
onboard, the integration of sensor data into a common framework onboard, the integration of sensor data into a common framework referenced in a geodatabase is becoming more desirable. The USAreferenced in a geodatabase is becoming more desirable. The USAF F AcademyAcademy’’s Unmanned Aerial Vehicle (UAV) Research Group, a 25s Unmanned Aerial Vehicle (UAV) Research Group, a 25--member multimember multi--disciplinary team, and the Academydisciplinary team, and the Academy’’s Geo Integration s Geo Integration Office are developing a prototype UAV Situational Awareness toolOffice are developing a prototype UAV Situational Awareness tool that will that will connect the commander in a command center to the video feed fromconnect the commander in a command center to the video feed from an an operational UAV. The prototype is being built as an ESRI ArcObjoperational UAV. The prototype is being built as an ESRI ArcObjects ects extension for ArcGIS 9.0 that displays a moving UAV on the spatiextension for ArcGIS 9.0 that displays a moving UAV on the spatial data al data from the geodatabase and streams the video data to an embedded vfrom the geodatabase and streams the video data to an embedded video ideo viewer in the map. The result is a fusion of the UAVviewer in the map. The result is a fusion of the UAV’’s location and video s location and video feed into a common frame of reference. Using this tool in a comfeed into a common frame of reference. Using this tool in a command mand center during dynamic situations will increase the situational acenter during dynamic situations will increase the situational awareness of wareness of Air Force Commanders.Air Force Commanders.
PurposePurpose
Connect Air Force commanders to UAV video Connect Air Force commanders to UAV video feedsfeeds–– RealReal--time feeds from operational UAVstime feeds from operational UAVs–– Increases situational awareness during dynamic Increases situational awareness during dynamic
situationssituationsCombine existing technologiesCombine existing technologies–– GIS systems, ArcGIS, ArcMap, etc.GIS systems, ArcGIS, ArcMap, etc.–– UAV video feeds, EO/IRUAV video feeds, EO/IR–– Networking technologiesNetworking technologies
Developing a prototype systemDeveloping a prototype system
BackgroundBackground
US Air Force AcademyUS Air Force Academy–– Undergraduate institution with around 4000 cadetsUndergraduate institution with around 4000 cadets–– 32 different majors including aeronautical and computer 32 different majors including aeronautical and computer
engineeringengineering
UAV Research GroupUAV Research Group–– 25 members from 11 different disciplines25 members from 11 different disciplines–– $100K budget this year$100K budget this year
USAF Academy Geo Integration OfficeUSAF Academy Geo Integration Office–– Integrating GIS across the baseIntegrating GIS across the base
BackgroundBackground
Red Hen SystemsRed Hen Systems–– Video capture and playback via Video capture and playback via GeoVideoGeoVideo™™–– Not realNot real--timetime–– GeoGeo--referenced DVD video captured in flightreferenced DVD video captured in flight–– Replay video in ArcMap applicationReplay video in ArcMap application
University of Nebraska University of Nebraska gNetgNet–– Interactive map of Lewis and Clarke explorationsInteractive map of Lewis and Clarke explorations
IwaneIwane Video GIS systemVideo GIS system–– View videos of selected locations, but not realView videos of selected locations, but not real--timetime
UAV Situational Awareness ToolUAV Situational Awareness Tool
UAVSAT Client Server ArchitectureUAVSAT Client Server Architecture
Airborne UAV captures video and telemetryAirborne UAV captures video and telemetryCurrently on separate wireless feedsCurrently on separate wireless feedsServer computerServer computer–– Connects to Ground Control Station (GCS)Connects to Ground Control Station (GCS)–– Connects to video feedConnects to video feed
Client computersClient computers–– Log into secure web siteLog into secure web site
Client/Server ArchitectureClient/Server Architecture
UAVs at the AcademyUAVs at the Academy
Silver FoxSilver FoxDesert HawkDesert HawkBATCAMBATCAMPredator Engine testingPredator Engine testingAlpha 60Alpha 60
ResultsResults
Current prototype based on ArcMapCurrent prototype based on ArcMap–– Includes detachable video streaming windowIncludes detachable video streaming window–– Based on MicrosoftBased on Microsoft’’s Windows Media Players Windows Media Player–– Able to connect to UAVSAT via IP and stream videoAble to connect to UAVSAT via IP and stream video–– Can display UAV on geoCan display UAV on geo--referenced mapreferenced map
Next releaseNext release–– Update UAVUpdate UAV’’s position in reals position in real--time and move icontime and move icon–– May use Tracking AnalystMay use Tracking Analyst–– Tracking Server sounds promisingTracking Server sounds promising
ChallengesChallenges
Synchronizing video and telemetrySynchronizing video and telemetry–– 10 second delay10 second delay–– Need to match location with videoNeed to match location with videoInvestigating onboard solutionInvestigating onboard solutionMay synchronize on the groundMay synchronize on the ground
AcknowledgementsAcknowledgements
This research has been funded by a grant from the Institute This research has been funded by a grant from the Institute for Information Technology Applications (IITA) at the for Information Technology Applications (IITA) at the AcademyAcademyThanks go to Cadet Nick Thanks go to Cadet Nick BrownheimBrownheim and the cadets in the and the cadets in the Software Engineering course for their work on the UAVSAT Software Engineering course for their work on the UAVSAT tooltool
ReferencesReferences[1] Red Hen Systems, Inc. [1] Red Hen Systems, Inc. GeoVideoGeoVideo Brings DVD Video to the ESRI Brings DVD Video to the ESRI ArcGIS Mapping Environment.ArcGIS Mapping Environment. Retrieved from Retrieved from http://http://www.redhensystems.comwww.redhensystems.com// on 2 December 2004.on 2 December 2004.[2] University of Nebraska. [2] University of Nebraska. gNetgNet interactive mapping system. interactive mapping system. Retrieved from Retrieved from http://http://www.lewisandclarkgnet.comwww.lewisandclarkgnet.com/index//index/ on 2 on 2 December 2004.December 2004.[3] The [3] The IwaneIwane Video GIS system. Retrieved from Video GIS system. Retrieved from http://http://www.iwane.comwww.iwane.com/old/ eiwane510.html/old/ eiwane510.html on 2 December 2004.on 2 December 2004.[4] Cloud Cap Technology, Inc. Piccolo autopilot system. Retr[4] Cloud Cap Technology, Inc. Piccolo autopilot system. Retrieved ieved from from http://http://www.cloudcaptech.com/default.htmwww.cloudcaptech.com/default.htm on 12 January 2005.on 12 January 2005.[5] Advanced Ceramics Research, Inc. Silver Fox UAV. Retrieve[5] Advanced Ceramics Research, Inc. Silver Fox UAV. Retrieved d from from http://http://www.acrtucson.com/UAV/silverfox/index.htmwww.acrtucson.com/UAV/silverfox/index.htm on 12 January on 12 January 2005.2005.[6] [6] AerosondeAerosonde Corporation. Corporation. AerosondeAerosonde UAV. Retrieved from UAV. Retrieved from http://http://www.aerosonde.comwww.aerosonde.com// on 12 January 2005.on 12 January 2005.
Author InformationAuthor InformationMr Tim R. BeermannMr Tim R. BeermannGeo Integration OfficeGeo Integration OfficeHQ USAFA/CEPDHQ USAFA/CEPD8120 Edgerton Dr, Suite 408120 Edgerton Dr, Suite 40USAF Academy, CO 80840USAF Academy, CO 80840Phone: 719Phone: 719--333333--16061606timothy.beermann@[email protected]
Capt Clint H. SparkmanCapt Clint H. SparkmanDepartment of Computer ScienceDepartment of Computer ScienceHQ USAFA/DFCSHQ USAFA/DFCS2354 Fairchild Dr, Suite 6G1012354 Fairchild Dr, Suite 6G101USAF Academy, CO 80840USAF Academy, CO 80840Phone: 719Phone: 719--333333--76647664Fax: 719Fax: [email protected]@usafa.af.mil
Lt Col Ricky E. SwardLt Col Ricky E. SwardDepartment of Computer ScienceDepartment of Computer ScienceHQ USAFA/DFCSHQ USAFA/DFCS2354 Fairchild Dr, Suite 6G1012354 Fairchild Dr, Suite 6G101USAF Academy, CO 80840USAF Academy, CO 80840Phone: 719Phone: 719--333333--76647664Fax: 719Fax: [email protected]@usafa.af.mil
