Web-GIS portal for multi-Web-GIS portal for multi-source geographic data of source geographic data of

Nordic SeaNordic Sea

Name Name ::Phalguni PalPhalguni Pal Supervisor: Supervisor:

Dhayalan. VelauthapillaiDhayalan. Velauthapillai

Nansen Environmental and Nansen Environmental and Remote Remote Sensing CenterSensing Center

Outline of the talk Outline of the talk

Introduction Introduction Problem definition Problem definition Objectives Objectives Software and toolsSoftware and tools Database (ODB)Database (ODB) Initial workInitial work Challanges Challanges Discussion Discussion ConclusionConclusion

IntroductionIntroduction

Nansen Ceneter(NERSC) : Nansen Ceneter(NERSC) : an an independent non-profit research independent non-profit research institute affiliated with the University institute affiliated with the University of Bergen. of Bergen.

Basically work on applied Basically work on applied environmental research.environmental research.

Introduction 2Introduction 2 This master thesis is combination of two projects This master thesis is combination of two projects

running at Nansen Center called DISPRO and running at Nansen Center called DISPRO and INTAS.INTAS.

DISPRO: DISPRO: European research project.European research project. Currently running on Nansen Center.Currently running on Nansen Center. Web-base GIS system.Web-base GIS system. Monitoring oil spills and harmful algal bloomsMonitoring oil spills and harmful algal blooms

using satellite images.using satellite images.

Indroduction3Indroduction3

• INTAS: INTAS:

EU project running at NERSC.EU project running at NERSC. Oceanographic data (OD) collectedOceanographic data (OD) collected

from Nordic sea.from Nordic sea. Huge number of unorganized data.Huge number of unorganized data. Make a well managed ODB. Make a well managed ODB.

Problem definitionProblem definition

Prepare oceanographic data for a Prepare oceanographic data for a suitable & well organized waysuitable & well organized way

Display the informations in the Display the informations in the browser with user friendly manner browser with user friendly manner

To avoid use of expansive GIS toolsTo avoid use of expansive GIS tools

e.g. ArcExlporer, e.g. ArcExlporer,

Problem definitionProblem definition

Prepare oceanographic data for a Prepare oceanographic data for a suitable & well organized waysuitable & well organized way

Display the informations in the Display the informations in the browser with user friendly manner browser with user friendly manner

To avoid use of expansive GIS toolsTo avoid use of expansive GIS tools

e.g. ArcExlporer, Idealware, ArcMap e.g. ArcExlporer, Idealware, ArcMap etc.etc.

ODB of INTAS :ODB of INTAS : Huge numbers of data collected during the Huge numbers of data collected during the

period 1882-2007 from North Atlantic with period 1882-2007 from North Atlantic with the NS sub area.the NS sub area.

Three different databases and data Three different databases and data processing:processing: Initial data with chance of duplicity.Initial data with chance of duplicity. Observed and interpolated data.Observed and interpolated data. Objective analyzed monthly fields data withObjective analyzed monthly fields data with errors estimates. errors estimates.

Data Processing:Data Processing:Initial data with chance of duplicity: Initial data with chance of duplicity: Error estimation process: Error estimation process: 1.1.Download data (more than 20 converters) from initial sources to separate Download data (more than 20 converters) from initial sources to separate databases. databases.

2.Quality control for all initial databases (9 procedures).2.Quality control for all initial databases (9 procedures).

3.Standard deviation flags.3.Standard deviation flags.

4.4.Interpolation at the standard levels.Interpolation at the standard levels.

5.Objective analysis of the monthly fields (with kriging errors estimates).5.Objective analysis of the monthly fields (with kriging errors estimates).

Quality-duplicate controlled, merged initial database

Observed and interpolated data.Observed and interpolated data.

Objectively analyzed databases for requested grid net

Mean and anomalies fields at standard levels, in layers and on density surfaces

Objective analyzed monthly fields data with errors estimates.

NS database content: reference period for anomalies NS database content: reference period for anomalies computing computing

YearYear 00 11 22 33 44 55 66 77 88 99

19001900 267267 481481 555511 337878 445599 282800 228585 8989 181822 130130

19101910 222211 7766 172172 303066 6622 00 77 00 6969 1515

19201920 4545 8484 9696 387387 898944 687687 14145858 824824 445757 949422

19301930 779900 888686 989866 12129898 12122626 929222 15156868 13133030 17717766 15158484

19401940 10108888 445050 12128080 858577 10310322 555599 909011 886969 20242024 15157878

19501950 22238238 26262929 39543954 29872987 44158158 44382382 44665522 55528528 77796796 99335335

19601960 75753030 66699699 66037037 70870844 57576611 55489489 55481481 55852852 53532626 66815815

19701970 66703703 55635635 66147147 79467946 49504950 55751751 88317317 88115115 77064064 66261261

19801980 88675675 88062062 8585030310010011

00 151522222213413433

3311079079

6611275275

66 878087801551552424

88

1990199011499499

44 66312312 60607070 66660660 65655656 52528080 44342342 55730730 55454454 52095209

20002000 42684268 55117878 41354135 11772222 867867 688688   3636         

NS database content: countriesNS database content: countries

CountryCountry Stations #Stations #

11 USSR/RUSSIAUSSR/RUSSIA 132,081132,081

22 NORWAYNORWAY 123,740123,740

33 UNKNOWNUNKNOWN 68,67868,678

44 UNITED KINDOMUNITED KINDOM 20,40820,408

55 ICELANDICELAND 19,80819,808

66 UNITED STATESUNITED STATES 15,94615,946

77 GERMANYGERMANY 11,15711,157

88 DENMARKDENMARK 5,1255,125

99 POLANDPOLAND 2,2682,268

1010 JAPANJAPAN 1,5601,560

1111 NETHERLANDNETHERLAND 1,4161,416

1212 CANADACANADA 1,2031,203

NS database content: station sourcesNS database content: station sources

1900 1910 1920 1930 1940 1950 1960 1970 1980 1990 2000 2010YEARS

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

11000

12000

13000

14000

15000

16000

Nu

mb

er o

f s

tati

on

s b

y s

ou

rce

source->stationsODB_CA [154488]

W OD2001 [83830]

IMR9002 [34730]

AARIod [27634]

OBNINSK [27614]

ODB_ICES [16727]

VEINS_H [14919]

MIKE2006 [11123]

AARI_TGM [7375]

W OD2005 [7233]

AARIcr [5215]

NPICD [3100]

Cearex [2825]

NNDCD [2416]

ARGO [2414]

PNSEC [756]

AW I_CD [731]

MMBI [386]

TRACTOR [313]

OVERFLOW [304]

ESOP [215]

GSP [181]

MAIA [150]

VEINS [113]

NANSEN [10]

CriuseReport [6]

Initial data for this projectInitial data for this project

Working on the selected data of Working on the selected data of 2006.2006.

Two different source of data, PF Two different source of data, PF (Profiling floats) and RV (Research (Profiling floats) and RV (Research Vessels).Vessels).

PF is approx 2980 data and RV is approx PF is approx 2980 data and RV is approx 2404 data. 2404 data.

Station position 1.01-31.12.2006 ODB-> Profiling floats (st: 2908)Station position 1.01-31.12.2006 ODB-> Profiling floats (st: 2908)

1.01-31.12.2006 ODB-> Research Vessels (st: 2404) Station position1.01-31.12.2006 ODB-> Research Vessels (st: 2404) Station position

ObjectivesObjectives

An An oceanographic oceanographic Database (ODB).Database (ODB). Develop a web-based application (Web-GIS) Develop a web-based application (Web-GIS)

to display all different parameters in the ODB to display all different parameters in the ODB system in a browser as a station graph, section system in a browser as a station graph, section graph or section map without using any graph or section map without using any software/tools.software/tools.

The system will also display satellite images The system will also display satellite images and forecasts from numerical models on the and forecasts from numerical models on the same map as ODB data.same map as ODB data.

What is GIS?What is GIS?

Geographical Information System.Geographical Information System. GIS is a computer system for GIS is a computer system for

capturing, storing, checking, capturing, storing, checking, integrating, manipulating, analyzing integrating, manipulating, analyzing and displaying data related to and displaying data related to positions on the Earth's surface. positions on the Earth's surface.

GIS is used for handling maps. GIS is used for handling maps.

Projection of Nordic sea:Projection of Nordic sea:

Selection of development methodSelection of development methodand why?and why?

Agile development methodsAgile development methods

XP- eXtreme Programming XP- eXtreme Programming

Selection of technoligies and why?Selection of technoligies and why?

Database: MySQLDatabase: MySQL Other possibilities: Oracle, DB2, SQL Server, Other possibilities: Oracle, DB2, SQL Server,

PostgreSQLPostgreSQL

UMN Mapserver 5.x (GDAL, OGR ).UMN Mapserver 5.x (GDAL, OGR ). Apache Tomcat, Java.Apache Tomcat, Java. HTML, XML. HTML, XML. Python. Python. Full package : MS4W for Windows.Full package : MS4W for Windows.

Pictorial view of the project: Pictorial view of the project:

Client/Browser

Request

Response

MapServerMap file

Request for data(.ovf)

MySQLDB

Response data

ApplicationServer

DISPRO databaseDISPRO database

Tables:Tables: STATIONSTATION

P_SALINITYP_SALINITY

P_TEMPERETUREP_TEMPERETURE

STATION_INFO STATION_INFO

Details of table’s columns:Details of table’s columns:

STATIONSTATION ABSNUMABSNUM STLATSTLAT STLON STLON STDATESTDATE STTIMESTTIME STSOURCESTSOURCE STVERSIONSTVERSION STCOUNTRYNAMESTCOUNTRYNAME STVESSELNAMESTVESSELNAME STDEPTHSOURCE STDEPTHSOURCE STLEVELSTLEVEL STDEPTHGRIDSTDEPTHGRID STDEPTHGRIDMINSTDEPTHGRIDMIN STDEPTHGRIDMAX STDEPTHGRIDMAX

P_SALINITYP_SALINITY

Columns:Columns: ABSNUMABSNUM

LEVELLEVEL

VALUE VALUE

FLAGFLAG

P_TEMPERATUREP_TEMPERATURE

Columns:Columns: ABSNUMABSNUM

LEVELLEVEL

VALUE VALUE

FLAGFLAG

STATION_INFOSTATION_INFO

Columns:Columns: ABSNUMABSNUM COUNTRYCODECOUNTRYCODE VESSELCODEVESSELCODE STNUMINCRUISESTNUMINCRUISE PROJECTCODEPROJECTCODE INSTITUTECODE INSTITUTECODE INSTRUMENT INSTRUMENT SOURCEUNIQUEIDSOURCEUNIQUEID SOURCEDATAORIGINSOURCEDATAORIGIN VESSELCRUISEIDVESSELCRUISEID

Relationship:Relationship:

STATION

P_SALINITYP_SALINITY

P_TEMPERATURESTATION_INFO

ABSNUMABSNUMSTLATSTLATSTLON STLON STDATESTDATESTTIMESTTIMESTSOURCESTSOURCESTVERSIONSTVERSIONSTCOUNTRYNAMESTCOUNTRYNAMESTVESSELNAMESTVESSELNAMESTDEPTHSOURCE STDEPTHSOURCE STLEVELSTLEVELSTDEPTHGRIDSTDEPTHGRIDSTDEPTHGRIDMINSTDEPTHGRIDMINSTDEPTHGRIDMAXSTDEPTHGRIDMAX

LEVELLEVELABSNUMABSNUMVALUE VALUE FLAGFLAG

LEVELLEVELABSNUMABSNUMVALUE VALUE FLAGFLAG

ABSNUMABSNUMCOUNTRYCODECOUNTRYCODEVESSELCODEVESSELCODESTNUMINCRUISESTNUMINCRUISEPROJECTCODEPROJECTCODEINSTITUTECODE INSTITUTECODE INSTRUMENT INSTRUMENT SOURCEUNIQUEIDSOURCEUNIQUEIDSOURCEDATAORIGINSOURCEDATAORIGINVESSELCRUISEIDVESSELCRUISEID

1

∞

∞

1

∞

1

1

HTML request form HTML request form

MAPFILE MAPFILE REQUEST REQUEST SERVICE SERVICE VERSION VERSION LAYERS LAYERS STYLES STYLES SRS SRS BBOX BBOX WIDTH WIDTH HEIGHT HEIGHT FORMAT FORMAT

Submit

Result: position located on the mapResult: position located on the map

Expected display on browser (Section Map):Expected display on browser (Section Map):

Time series length (years) for latitude-longitude grid Time series length (years) for latitude-longitude grid net for net for salinity. salinity.

- 4 0 - 3 0 - 2 0 - 1 0 0 1 0 2 0 3 0 4 0 5 0 6 06 0

6 2

6 4

6 6

6 8

7 0

7 2

7 4

7 6

7 8

8 0

0

5

1 0

1 5

2 0

2 5

3 0

3 5

4 0

4 5

5 0

5 5

6 0

6 5

7 0

7 5

Y e a r A m o u n t

D a t a b a s e : C L I M A T E _ v 2 . I B C o m p u t e r : A L E X

F i l e : _ 1 _ V I n d _ 6

7 4

6 0

6 7

6 8

ChallengesChallenges : : New types of work.New types of work. Work with maps.Work with maps. Initial problems with software versions and Initial problems with software versions and

tool driverstool drivers Time consuming during upgrading Time consuming during upgrading

softwares in serversoftwares in server Changing of database many times. Changing of database many times. Changing of Platform(Linux -> Windows)Changing of Platform(Linux -> Windows) Shortage of Shortage of literature literature and web help in this and web help in this

field field

Discussion Discussion

XP method realy fits XP method realy fits with the projectwith the project All new types of toolsAll new types of tools Selection of database was crucialSelection of database was crucial Spatially enabled MySQL Spatially enabled MySQL Problems in GUI & took lots of time to fix it Problems in GUI & took lots of time to fix it Version problems & working with existing Version problems & working with existing

software software Started late and working just 6 months Started late and working just 6 months

ConclusionConclusion

Still have some future work.Still have some future work.

Will have opportunity to future Will have opportunity to future enhancement of the system.enhancement of the system.

WelcomeWelcome

Questions? Questions?