Alfred Wegener Institute · Intro BSRN Toolbox Quality Checks Quality Codes Usage Demo Introduction...

QC offered byBSRN Toolbox

H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Quality Checks offered by the BSRN Toolbox

Holger Schmithusen

Alfred Wegener Institute

2012-08-01


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Outline

1 Introduction to the BSRN Toolbox

2 Applied Quality Checks

3 Produced Quality Codes

4 Usage Demonstration of Quality Check Feature


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo






H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Introduction to the BSRN Toolbox

Provided by WRMC to station scientists, data users and datacurators

Open source (licensed under GPL)

Main features:

Download manager forStationToArchive filesFormat converter(StationToArchive,Pangaea)Basic file operationsQuality Checks for BSRNdata


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo




Main features:



H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo




Main features:



H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo




Main features:

Download manager forStationToArchive files

Format converter(StationToArchive,Pangaea)Basic file operationsQuality Checks for BSRNdata


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo




Main features:

Download manager forStationToArchive filesFormat converter(StationToArchive,Pangaea)

Basic file operationsQuality Checks for BSRNdata


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo




Main features:

Download manager forStationToArchive filesFormat converter(StationToArchive,Pangaea)Basic file operations

Quality Checks for BSRNdata


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo




Main features:



H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

PhysicallyPossible Limits

Extremely RareLimits

Comparisons

Quality Codes

Usage Demo


2 Applied Quality ChecksPhysically Possible LimitsExtremely Rare LimitsComparisons




H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo

Applied Quality Checks

Current version of BSRN Toolbox provides one set of quality checks:

C. N. Long and E. G. Dutton:

BSRN Global Network recommended QC tests, V2.0

Physically possible limit tests

Extremely rare limit tests

Intercomparisons between different parameter


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo

Physically Possible Limits

Theses parameter are checked forphysically possible values:

SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo



SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards

UTC[W

m−

2]

SWD

00 03 06 09 12 15 18 21 00

0

500

1000

1500

Max: 1.5 Sa · cos(SZA)1.2 + 100 Wm2

Min: −4 Wm2


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo



SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards

UTC[W

m−

2]

DIF

00 03 06 09 12 15 18 21 00

0

500

1000

1500

Max: 0.95 Sa · cos(SZA)1.2 + 50 Wm2

Min: −4 Wm2


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo



SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards

UTC[W

m−

2]

DIR

00 03 06 09 12 15 18 21 00

0

500

1000

1500

Max: SaMin: −4 W

m2


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo



SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards

UTC[W

m−

2]

SWU

00 03 06 09 12 15 18 21 00

0

500

1000

1500

Max: 1.2 Sa · cos(SZA)1.2 + 50 Wm2

Min: −4 Wm2


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo



SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards

UTC[W

m−

2]

LWU

00 03 06 09 12 15 18 21 00

0

500

1000

1500

Max: 700 Wm2

Min: 40 Wm2


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo



SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards

UTC[W

m−

2]

LWD

00 03 06 09 12 15 18 21 00

0

500

1000

1500

Max: 900 Wm2

Min: 40 Wm2


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo

Extremely Rare Limits

Theses parameter are checked forextremely rare values:

SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo



SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards

UTC[W

m−

2]

SWD

00 03 06 09 12 15 18 21 00

0

500

1000

1500

Max: 1.2 Sa · cos(SZA)1.2 + 50 Wm2

Min: −2 Wm2


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo



SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards

UTC[W

m−

2]

DIF

00 03 06 09 12 15 18 21 00

0

500

1000

1500

Max: 0.75 Sa · cos(SZA)1.2 + 30 Wm2

Min: −2 Wm2


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo



SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards

UTC[W

m−

2]

DIR

00 03 06 09 12 15 18 21 00

0

500

1000

1500

Max: 0.95 Sa · cos(SZA)0.2 + 10 Wm2

Min: −2 Wm2


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo



SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards

UTC[W

m−

2]

SWU

00 03 06 09 12 15 18 21 00

0

500

1000

1500

Max: Sa · cos(SZA)1.2 + 50 Wm2

Min: −2 Wm2


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo



SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards

UTC[W

m−

2]

LWU

00 03 06 09 12 15 18 21 00

0

500

1000

1500

Max: 500 Wm2

Min: 60 Wm2


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo



SW downwards

SW diffuse

SW direct normal

SW upwards

LW downwards

LW upwards

UTC[W

m−

2]

LWD

00 03 06 09 12 15 18 21 00

0

500

1000

1500

Max: 700 Wm2

Min: 60 Wm2


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo

Comparisons

Comparisons are done for thefollowing parameter:

SWD vs. DIF + DIR

SWD vs. DIF

SWU vs. DIF + DIR

LWD vs. T2

LWU vs. T2

LWD vs. LWU


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo

Comparisons


SWD vs. DIF + DIR

SWD vs. DIF

SWU vs. DIF + DIR

LWD vs. T2

LWU vs. T2

LWD vs. LWU

UTC

[W m

−2]

SWD vs. DIF+DIR

00 03 06 09 12 15 18 21 00

0

200

400

600

800

1000

1200


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo

Comparisons


SWD vs. DIF + DIR

SWD vs. DIF

SWU vs. DIF + DIR

LWD vs. T2

LWU vs. T2

LWD vs. LWU

UTC

[W m

−2]

SWD vs. DIF

00 03 06 09 12 15 18 21 00

0

200

400

600

800

1000

1200


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo

Comparisons


SWD vs. DIF + DIR

SWD vs. DIF

SWU vs. DIF + DIR

LWD vs. T2

LWU vs. T2

LWD vs. LWU

UTC

[W m

−2]

SWU vs. DIF+DIR

00 03 06 09 12 15 18 21 00

0

200

400

600

800

1000

1200


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo

Comparisons


SWD vs. DIF + DIR

SWD vs. DIF

SWU vs. DIF + DIR

LWD vs. T2

LWU vs. T2

LWD vs. LWU

UTC

[W m

−2]

LWD vs. T2

00 03 06 09 12 15 18 21 00

0

200

400

600

800

1000

1200


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo

Comparisons


SWD vs. DIF + DIR

SWD vs. DIF

SWU vs. DIF + DIR

LWD vs. T2

LWU vs. T2

LWD vs. LWU

UTC

[W m

−2]

LWU vs. T2

00 03 06 09 12 15 18 21 00

0

200

400

600

800

1000

1200


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks



Comparisons

Quality Codes

Usage Demo

Comparisons


SWD vs. DIF + DIR

SWD vs. DIF

SWU vs. DIF + DIR

LWD vs. T2

LWU vs. T2

LWD vs. LWU

UTC

[W m

−2]

LWD vs. LWU

00 03 06 09 12 15 18 21 00

0

200

400

600

800

1000

1200

LWD


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo






H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Produced Quality Codes

One QC per measured value

Designed as 6-bit array (decimal numbers 0 − 63)

2 bits per

physical possible limitsextremely rare limitscomparisons

extendable for additional future checks


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo


abov

eco

mpa

red

mea

sure

men

t

belo

wco

mpa

red

mea

sure

men

t

abov

eex

trem

ely

rare

limit

belo

wex

trem

ely

rare

limit

abov

eph

ysic

ally

poss

ible

limit

belo

wph

ysic

ally

poss

ible

limit

bit position 5 4 3 2 1 0decimal value 32 16 8 4 2 1

Examples

SWD = 9990 Wm2 0 0 1 0 1 0 = 10

LWD = 350 Wm2 1 0 0 0 0 0 = 32

LWU = 300 Wm2 0 1 0 0 0 0 = 16


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo


abov

eco

mpa

red

mea

sure

men

t

belo

wco

mpa

red

mea

sure

men

t

abov

eex

trem

ely

rare

limit

belo

wex

trem

ely

rare

limit

abov

eph

ysic

ally

poss

ible

limit

belo

wph

ysic

ally

poss

ible

limit


ExamplesSWD = 9990 W

m2

0 0 1 0 1 0 = 10LWD = 350 W

m2 1 0 0 0 0 0 = 32LWU = 300 W

m2 0 1 0 0 0 0 = 16


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo


abov

eco

mpa

red

mea

sure

men

t

belo

wco

mpa

red

mea

sure

men

t

abov

eex

trem

ely

rare

limit

belo

wex

trem

ely

rare

limit

abov

eph

ysic

ally

poss

ible

limit

belo

wph

ysic

ally

poss

ible

limit



m2 0 0 1 0 1 0 = 10

LWD = 350 Wm2 1 0 0 0 0 0 = 32

LWU = 300 Wm2 0 1 0 0 0 0 = 16


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo


abov

eco

mpa

red

mea

sure

men

t

belo

wco

mpa

red

mea

sure

men

t

abov

eex

trem

ely

rare

limit

belo

wex

trem

ely

rare

limit

abov

eph

ysic

ally

poss

ible

limit

belo

wph

ysic

ally

poss

ible

limit



m2 0 0 1 0 1 0 = 10LWD = 350 W

m2

1 0 0 0 0 0 = 32

LWU = 300 Wm2

0 1 0 0 0 0 = 16


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo


abov

eco

mpa

red

mea

sure

men

t

belo

wco

mpa

red

mea

sure

men

t

abov

eex

trem

ely

rare

limit

belo

wex

trem

ely

rare

limit

abov

eph

ysic

ally

poss

ible

limit

belo

wph

ysic

ally

poss

ible

limit



m2 0 0 1 0 1 0 = 10LWD = 350 W

m2 1 0 0 0 0 0 = 32LWU = 300 W

m2 0 1 0 0 0 0 = 16


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data

ConfigurationDialogue

Visualisation




4 Usage Demonstration of Quality Check FeatureInput DataOutput DataConfiguration DialogueVisualisation


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data


Visualisation

Input Data

Various input formats are supported:

Pangaea files as downloaded from www.pangaea.de

Output from Pangaea’s Data Warehouse

TAB-delimited tables as produced by the format converter

StationToArchive files need to be converted first

http://www.pangaea.de/PHP/BSRN_Status.php?q=LR0100

http://www.pangaea.de/search?count=10&minlat=&minlon=&maxlat=&maxlon=&mindate=2008-01-01T00%3A00%3A00&maxdate=2008-12-31T23%3A59%3A59&env=All&q=project%3ABSRN+%2Bevent%3AGVN+%2BBasic+%2Band+%2Bother


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data


Visualisation

Input Data









H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data


Visualisation

Input Data









H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data


Visualisation

Input Data









H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data


Visualisation

Output Data

Format of output files is Pangaea format

Available output:

Quality codesAuxiliary data (astronomical parameter, DIF+DIR)Original data set with flagged values removed


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data


Visualisation

Output Data


Available output:



H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data


Visualisation

Output Data


Available output:

Quality codes

Auxiliary data (astronomical parameter, DIF+DIR)Original data set with flagged values removed


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data


Visualisation

Output Data


Available output:

Quality codesAuxiliary data (astronomical parameter, DIF+DIR)

Original data set with flagged values removed


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data


Visualisation

Output Data


Available output:



H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data


Visualisation

Output Data


Available output:



H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data


Visualisation

Configuration Dialogue


H. Schmithusen

Outline

Intro BSRNToolbox

Quality Checks

Quality Codes

Usage Demo

Input Data

Output Data


Visualisation

Visualisation

Date post:	03-Jul-2020
Category:	Documents
Upload:	others
View:	1 times
Download:	0 times

Alfred Wegener Institute · Intro BSRN Toolbox Quality Checks Quality Codes Usage Demo Introduction...

Documents