Web Mapping Application for Operative Fire and Water Services · DefinitionsIntroduction MODIS Data...

Post on 08-Aug-2020

1 views 0 download

transcript

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

Web Mapping Application for Operative Fireand Water Services

Mostafa ElFouly

Technische Universitat Dresden

German Aerospace Center (DLR)

Supervisors: Prof. Buchroithner ManfredDipl.- Geogr. Stefan Plattner, DLR

Dr. Christian Strobl, DLR

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

Definitions

MODIS

• MODIS is a sensorcarried on both the Terraand Aqua satellites.

• It allows to obtainimages in the morning(Terra) and in theafternoon (Aqua) for anydistinct location.

• Its data spatialresolution are between250 meters to 1kilometer.

Source: http://aqua.nasa.gov

MODIS-Aqua

Source: http://terra.nasa.gov

MODIS-Terra

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

Introduction

Motivation

• Fire is an important ecosystemprocess affecting land coverchange

• MODIS Sensor increases theability to monitor fires fromspace

• Archive/Catalog connector hasto be built.

NASA ModelsSource: http://www.nasa.gov/topics/earth/features/fiery-past prt.htm

Monthly Global Fire Activity

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

MODIS Data Products

• There are 44 MODIS datasets divided into 4 levels.

• MODIS data products are likea biological food web.

• Calibration and Geolocation.

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

Source: http://modis-atmos.gsfc.nasa.gov/products flow.html

MODIS Data Work Flow

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

Design

Data Layer

Service Layer Front End Layer

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

System Workflow

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

System Workflow

WEB-GIS

Clie

nt

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

System Workflow

Archive

WEB-GIS

JSON Response

parsed metadata

about them

atched �ilesHTT

P Re

ques

tJS

ON R

eque

stSe

lect

ed a

rea

of in

tere

st

Serv

ices

Clie

nt

Connector

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

System Workflow

Archive

WEB-GIS

HTT

P/FT

PRe

ques

t

HTTP/FTP

Responsem

etadata aboutthe m

atched �iles

JSON Response

parsed metadata

about them

atched �ilesHTT

P Re

ques

tJS

ON R

eque

stSe

lect

ed a

rea

of in

tere

st

Data

Serv

ices

Clie

nt

Connector

NASA

Catalog(unprocessed data)

Archive

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

System Workflow

FetcherArchive

WEB-GIS

HTT

P/FT

PRe

ques

t

HTTP/FTP

Responsem

etadata aboutthe m

atched �iles

JSON Response

parsed metadata

about them

atched �ilesHTT

P Re

ques

tJS

ON R

eque

stSe

lect

ed a

rea

of in

tere

st

HTT

P/JS

ONRe

ques

t �ile

s to

be d

ownl

oade

dan

d pr

oces

sed

Data

Serv

ices

Clie

nt

Connector

NASA

Catalog(unprocessed data)

Archive

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

System Workflow

Fetcher

NASA

Catalog(unprocessed data)

Archive

HTT

P/FT

PDo

wnl

oad

Requ

est

WEB-GIS

HTT

P/FT

PRe

ques

t

HTTP/FTP

Responsem

etadata aboutthe m

atched �iles

JSON Response

parsed metadata

about them

atched �ilesHTT

P Re

ques

tJS

ON R

eque

stSe

lect

ed a

rea

of in

tere

st

HTT

P/JS

ONRe

ques

t �ile

s to

be d

ownl

oade

dan

d pr

oces

sed

Data

Serv

ices

Clie

nt

Connector

ArchiveNASA

Catalog(unprocessed data)

Archive

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

System Workflow

Fetcher

NASA

Catalog(unprocessed data)

Downloads theelected �iles to theselected destination Pickup

Archive

HTT

P/FT

PDo

wnl

oad

Requ

est

WEB-GIS

HTT

P/FT

PRe

ques

t

HTTP/FTP

Responsem

etadata aboutthe m

atched �iles

JSON Response

parsed metadata

about them

atched �ilesHTT

P Re

ques

tJS

ON R

eque

stSe

lect

ed a

rea

of in

tere

st

HTT

P/JS

ONRe

ques

t �ile

s to

be d

ownl

oade

dan

d pr

oces

sed

Data

Serv

ices

Clie

nt

Connector

ArchiveNASA

Catalog(unprocessed data)

ArchiveFolder

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

System Workflow

Fetcher

NASA

Catalog(unprocessed data)

Downloads theelected �iles to theselected destination Pickup

Archive

Process Chain

Checks the pickupfolder periodaically

Sends the �ile to beprocessed and exposed

HTT

P/FT

PDo

wnl

oad

Requ

est

WEB-GIS

HTT

P/FT

PRe

ques

t

HTTP/FTP

Responsem

etadata aboutthe m

atched �iles

JSON Response

parsed metadata

about them

atched �ilesHTT

P Re

ques

tJS

ON R

eque

stSe

lect

ed a

rea

of in

tere

st

HTT

P/JS

ONRe

ques

t �ile

s to

be d

ownl

oade

dan

d pr

oces

sed

Data

Serv

ices

Clie

nt

Connector

ArchiveNASA

Catalog(unprocessed data)

ArchiveFolder

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

System Workflow

Fetcher

NASA

Catalog(unprocessed data)

Downloads theelected �iles to theselected destination Pickup

GeoDB forprocessed

MODIS

Archive

Process ChainSaves the

processed �ile

Checks the pickupfolder periodaically

Sends the �ile to beprocessed and exposed

HTT

P/FT

PDo

wnl

oad

Requ

est

WEB-GIS

HTT

P/FT

PRe

ques

t

HTTP/FTP

Responsem

etadata aboutthe m

atched �iles

JSON Response

parsed metadata

about them

atched �ilesHTT

P Re

ques

tJS

ON R

eque

stSe

lect

ed a

rea

of in

tere

st

HTT

P/JS

ONRe

ques

t �ile

s to

be d

ownl

oade

dan

d pr

oces

sed

Data

Serv

ices

Clie

ntSends the processed �ile back to the user

Connector

ArchiveNASA

Catalog(unprocessed data)

ArchiveFolder

products

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

Fetching Process

django

DatabaseCelery Workers

events

task for celeryto execute

tasks

Message Brokers

redis

Source: http://www.celeryproject.org/

Celery Architecture

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

Conclusion

Results

• Web-based modules for the retrieval,processing and exposing ofsatellite-based crisis information to theprocess chain is built.

• Archive Connector maps the user inputparameters to NASA-MODIS DataArchive.

• Fetcher module uses the DistributedTask Queue allowing the downloadprocess for multiple files to be executedasynchronously.

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

Limitations and Future Work

Limitations

• MODIS is an opticalsensor and not apassive-microwave one.

• Cloud coverage leads toan average annual globalunmapped area of 43%.

• The MODIS active fireproduct will only detectfires that are burning atthe time of satelliteoverpass.

Future Work

• HDF files is to bedistributed across manymachines in a cluster orcloud, which will resultin a faster processing ofthe files.

• The tool should be ableto fetch/retrieve HDFfiles from multiplearchives depending onthe availablity of thearchive servers.

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

Limitations and Future Work

Limitations

• MODIS is an opticalsensor and not apassive-microwave one.

• Cloud coverage leads toan average annual globalunmapped area of 43%.

• The MODIS active fireproduct will only detectfires that are burning atthe time of satelliteoverpass.

Future Work

• HDF files is to bedistributed across manymachines in a cluster orcloud, which will resultin a faster processing ofthe files.

• The tool should be ableto fetch/retrieve HDFfiles from multiplearchives depending onthe availablity of thearchive servers.

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

References

• Online Journal of Space Communication. (2013). ’ASTER’,http://spacejournal.ohio.edu/issue3/remote sats2.html (accessed 16December 2013).

• Giglio, L., I. Csiszar, and C. O. Justice. (2006). Global distribution andseasonality of active fires as observed with the Terra and Aqua ModerateResolution Imaging Spectroradiometer (MODIS) sensors, J. Geophys. Res.,111, G02016, doi:10.1029/2005JG000142.

• Janetos, A. C., and Justice, C. O. (2000). ’Land cover and globalproductivity: A measure- ment strategy for the NASA program’,International Journal of Remote Sensing, 21, pp. 1491-1512.

• Brandon Maccherone. ’MODIS Data Product Non-Technical Description -MOD 02, 03’ [on- line],http://modis.gsfc.nasa.gov/data/dataprod/nontech/MOD0203.php (accessed7 August 2013).

• VectorNav Technologies. ’Importance of Industrial Grade Sensor Calibration’[online], http://www.vectornav.com/support/library?id=86 (accessed 18October 2013).

Definitions Introduction MODIS Data Products Technical Implementation Conclusion References

References

• Eberle, J. and Strobl C. (2012). ’Web-Based Geoprocessing and WorkflowCreation for Generating and Providing Remote Sensing Products’ -Geomatica Vol. 66, No. 1, pp. 13 to 26.

• Roy, D. P., Lewis, P., and Justice, C. (2002a). ’Burned area mapping usingmulti-temporal moderate spatial resolution data - a bi-directional reflectancemodel-based expectation approach’, Remote Sensing of Environment, 83, pp.263-286.

• D.P. Roy et al. (2008). Remote Sensing of Environment. 112 3690-3707

• Celery. (2013). ’Distributed Task Queue’ [online],http://www.celeryproject.org/ (accessed 11 November 2013).

• Lalit Chandnani. (2013). ’Django Celery: Redis Vs RabbitMQ messagebroker’ [online],http://blog.langoor.mobi/django-celery-redis-vs-rabbitmq-message-broker/(accessed 5 December 2013).