+ All Categories
Home > Documents > Saving Canadian surface observations of weather, climate, and hydrological variables, 1984-1998

Saving Canadian surface observations of weather, climate, and hydrological variables, 1984-1998

Date post: 20-Oct-2015
Category:
Upload: kmschmitt14
View: 39 times
Download: 2 times
Share this document with a friend
Description:
A data rescue project
Popular Tags:
1
Original state of the dataset The original dataset was created as a central repository for Dr. Rouse’s research. The majority of the data are in daily ClimoBase archive files that consist of measure- 1999 ments made in regular increments over 24 hour periods. 7068 files / 62 MB Fortran extraction program Scope Encoded file naming convention Numeric ‘NULL’ value (-6999) Surface-climate measurements No metadata including solar time, wind speed, Minimal explanation wind direction, dry-bulb, wet-bulb, Space delimited and vapor pressure in 24 unique sites. Preliminary Quality Analysis • Flagged any erroneous or missing measurements “-6999” Provenance A CD-ROM containing the data as well as ancillary information was given to former NSIDC Director Dr. Roger Barry. Resources 1998 CAG Award for Scholarly Distinction in Geography. (1998). Retrieved September 15, 2013, from http://www.cag-acg.ca/en/wayne_robert_rouse.html DCC Curation Lifecycle Model. (n.d.). Retrieved September 15, 2013, from http://www.dcc.ac.uk/resources/curation-lifecycle-model National Science Board. (2005). The elements of the digital data collections universe. Long-lived Digital Data Collections. Available: http://www.nsf.gov/pubs/2005/nsb0540/ NOAA at NSIDC. (n.d.). Retrieved September 15, 2013, from http://nsidc.org/noaa/ Data Rescue Workflow Adapted from the DCC Curation Lifecycle Model Data collection Dr. Rouse, Professor Emeritus at McMaster University, was considered to be one of the top scientists in his field by the Canadian Association of Geographers (CAG). CAG stated that Dr. Rouse “pioneered field research on the evaporation of high latitude sites, including woodlands, tundra, wetland and lake surfaces” (1998) and he received the 1998 CAG Award for Scholarly Distinction in Geography. The data were collected over a 14-year period, from 1984 to 1998, in multiple studies by Dr. Rouse and his teams. Sites were chosen in Churchill, Manitoba, Marantz Lake, Manitoba, and Inuvik, Northwest Territories, specifically to include a variety of terrains ranging from wetlands to boulders. Map Data ©2014 Google Saving Canadian surface observations of weather, climate, and hydrological variables, 1984-1998 A data rescue project Katie Schmitt Graduate School of Library and Information Science -- University of Illinois at Urbana-Champaign Outcome After the rescue process, ClimoBase has the potential to become a highly-valued reference dataset. Observational data, specifically regarding climate science, is of high value to a variety of individuals including scientists, politicians, students, and journalists. Migrate Tools: Python and Linux Migrated files to CSV format Replaced space delimiters with commas for easy processing Separated values that were merged together by positive or negative signs Replaced values merged together by multiple decimal points with “NULL” Replaced previous flagged values of “-6999” with “NULL” Describe A plain text description of ClimoBase was submitted to NSIDC’s technical writers in lieu of a specific metadata schema. Including provenance records, contact information, an accurate citation and detailed information about scope of the dataset. • The data files were divided and grouped by specific study and then described with README.txt files. Store and Access The migrated and preserved data will be stored on a server owned by the National Snow and Ice Data Center (NSIDC) The public will be allowed to access ClimoBase data through nsidc.org Before: After: 16.93 -15.54 0.187 0.0161 0.0767 16.93,-15.54,0.187,0.0161,0.0767 69.43 -17.91 0.295 0.0178 0.0094 69.43,-17.91,0.295,0.0178,0.0094 66.94 -20.92 0.324 0.0159 0.0081 66.94,-20.92,0.324,0.0159,0.0081 36.69 -16.07 0.379 0.0150 0.0037 36.69,-16.07,0.379,0.0150,0.0037 45.22 -5.80 0.414 0.0176 0.0010 45.22,-5.80,0.414,0.0176,0.0010 77.78 45.90 0.481 0.0194-0.0048 77.78,45.90,0.481,0.0194,0.0048 109.08 80.04 0.507 0.0160-0.0069 109.08,80.04,0.507,0.0160,0.0069 186.19 43.18 0.508 0.0202-0.0038 186.19,43.18,0.508,0.0202,-0.0038 165.91 161.35 0.505 0.0140-0.0132 165.91,161.35,0.505,0.0140,-0.0132 158.47 141.05 0.503 0.0172-0.0119 158.47,141.05,0.503,0.0172,-0.0119 104.02 81.32 0.394 0.0151-0.0139 104.02,81.32,0.394,0.0151,-0.0139 81.48 76.60 0.351 0.0144-0.0179 81.48,76.60,0.351,0.0144,-0.0179 118.83 99.21 0.358 0.0149-0.0212 118.83,99.21,0.358,0.0149,-0.0212 146.65 139.12 0.357 0.0186-0.0283 146.65,139.12,0.357,0.0186,-0.0283 150.01 156.52 0.295 0.0134-0.0484 150.01,156.52,0.295,0.0134,-0.0484 148.14 143.44 0.407 0.0172-0.0209 148.14,143.44,0.407,0.0172,-0.0209 Sample data from a ClimoBase daily archive file Acknowledgments The author would like to especially thank Florence Fetterer, Program Manager, and Ruth Duerr, Principal Investigator, at the National Snow and Ice Data Center (NSIDC) in Boulder, Colorado for their help and support. Thank you also to Dr. Wayne Rouse, Professor Emeritus at McMaster University, for the opportunity and experience. Further information ClimoBase data is expected to be available to the general public for research use in the summer of 2014. The dataset has the potential to show evidence of climate changes in Northern Canada throughout the time of Dr. Rouse’s studies and as compared to today. [email protected] @kmschmitt http://katieschmitt.me Appraise Plan Preserve Migrate Describe Store Reuse Access Introduction ClimoBase is a dataset that consists of incremental measurements resulting from multiple surface-climate studies led by Dr. Wayne Rouse from 1984 to 1998. The data will be preserved for future research in the NOAA collection at the National Snow and Ice Data Center (NSIDC) in Boulder, Colorado. ClimoBase 2014 7,008 CSV files / 67 MB Data files organized by study Detailed ‘README.txt’ files Standardized ‘NULL’ values Descriptive metadata Stored securely Accessed via NSIDC
Transcript

Original state of the datasetThe original dataset was created as a central repository for Dr. Rouse’s research. The majority of the data are in daily ClimoBase archive files that consist of measure- 1999 ments made in regular increments over 24 hour periods. 7068 files / 62 MB Fortran extraction programScope Encoded file naming convention Numeric ‘NULL’ value (-6999)• Surface-climate measurements No metadata including solar time, wind speed, Minimal explanation wind direction, dry-bulb, wet-bulb, Space delimited and vapor pressure in 24 unique sites. Preliminary Quality Analysis • Flagged any erroneous or missing measurements “-6999”

Provenance

• A CD-ROM containing the data as well as ancillary information was given to former NSIDC Director Dr. Roger Barry.

Resources1998 CAG Award for Scholarly Distinction in Geography. (1998). Retrieved September 15, 2013, from http://www.cag-acg.ca/en/wayne_robert_rouse.html

DCC Curation Lifecycle Model. (n.d.). Retrieved September 15, 2013, from http://www.dcc.ac.uk/resources/curation-lifecycle-model

National Science Board. (2005). The elements of the digital data collections universe. Long-lived Digital Data Collections. Available: http://www.nsf.gov/pubs/2005/nsb0540/

NOAA at NSIDC. (n.d.). Retrieved September 15, 2013, from http://nsidc.org/noaa/

Data Rescue WorkflowAdapted from the DCC Curation Lifecycle Model

Data collectionDr. Rouse, Professor Emeritus at McMaster University, was considered to be one of the top scientists in his field by the Canadian Association of Geographers (CAG). CAG stated that Dr. Rouse “pioneered field research on the evaporation of high latitude sites, including woodlands, tundra, wetland and lake surfaces” (1998) and he received the 1998 CAG Award for Scholarly Distinction in Geography.

The data were collected over a 14-year period, from 1984 to 1998, in multiple studies by Dr. Rouse and his teams. Sites were chosen in Churchill, Manitoba, Marantz Lake, Manitoba, and Inuvik, Northwest Territories, specifically to include a variety of terrains ranging from wetlands to boulders.

Map Data ©2014 Google

Saving Canadian surface observations of weather, climate, and hydrological variables, 1984-1998

A data rescue project

Katie SchmittGraduate School of Library and Information Science -- University of Illinois at Urbana-Champaign

OutcomeAfter the rescue process, ClimoBase has the potential to become ahighly-valued reference dataset. Observational data, specifically regarding climate science, is of high value to a variety of individuals including scientists, politicians, students, and journalists.

Migrate • Tools: Python and Linux • Migrated files to CSV format

• Replaced space delimiters with commas for easy processing

• Separated values that were merged together by positive or negative signs

• Replaced values merged together by multiple decimal points with “NULL”

• Replaced previous flagged values of “-6999” with “NULL” Describe • A plain text description of ClimoBase was submitted to NSIDC’s technical

writers in lieu of a specific metadata schema. — Including provenance records, contact information, an accurate citation and detailed information about scope of the dataset.

• The data files were divided and grouped by specific study and then described with README.txt files.

Store and Access

• The migrated and preserved data will be stored on a server owned by the National Snow and Ice Data Center (NSIDC)

• The public will be allowed to access ClimoBase data through nsidc.org

Before: After:

16.93 -15.54 0.187 0.0161 0.0767 16.93,-15.54,0.187,0.0161,0.0767

69.43 -17.91 0.295 0.0178 0.0094 69.43,-17.91,0.295,0.0178,0.0094

66.94 -20.92 0.324 0.0159 0.0081 66.94,-20.92,0.324,0.0159,0.0081

36.69 -16.07 0.379 0.0150 0.0037 36.69,-16.07,0.379,0.0150,0.0037

45.22 -5.80 0.414 0.0176 0.0010 45.22,-5.80,0.414,0.0176,0.0010

77.78 45.90 0.481 0.0194-0.0048 77.78,45.90,0.481,0.0194,0.0048

109.08 80.04 0.507 0.0160-0.0069 109.08,80.04,0.507,0.0160,0.0069

186.19 43.18 0.508 0.0202-0.0038 186.19,43.18,0.508,0.0202,-0.0038

165.91 161.35 0.505 0.0140-0.0132 165.91,161.35,0.505,0.0140,-0.0132

158.47 141.05 0.503 0.0172-0.0119 158.47,141.05,0.503,0.0172,-0.0119

104.02 81.32 0.394 0.0151-0.0139 104.02,81.32,0.394,0.0151,-0.0139

81.48 76.60 0.351 0.0144-0.0179 81.48,76.60,0.351,0.0144,-0.0179

118.83 99.21 0.358 0.0149-0.0212 118.83,99.21,0.358,0.0149,-0.0212

146.65 139.12 0.357 0.0186-0.0283 146.65,139.12,0.357,0.0186,-0.0283

150.01 156.52 0.295 0.0134-0.0484 150.01,156.52,0.295,0.0134,-0.0484

148.14 143.44 0.407 0.0172-0.0209 148.14,143.44,0.407,0.0172,-0.0209

Sample data from a ClimoBase daily archive file

Acknowledgments

The author would like to especially thank Florence Fetterer, Program Manager, and Ruth Duerr, Principal Investigator, at the National Snow and Ice Data Center (NSIDC) in Boulder, Colorado for their help and support.

Thank you also to Dr. Wayne Rouse, Professor Emeritus at McMaster University, for the opportunity and experience.

Further informationClimoBase data is expected to be available to the general public for research use in the summer of 2014. The dataset has the potential to show evidence of climate changes in Northern Canada throughout the time of Dr. Rouse’s studies and as compared to today.

[email protected] @kmschmitt http://katieschmitt.me

Appraise

Plan

Preserve

Migrate

Describe

Store

Reuse

Access

IntroductionClimoBase is a dataset that consists of incremental measurements resulting from multiple surface-climate studies led by Dr. Wayne Rouse from 1984 to 1998. The data will be preserved for future research in the NOAA collection at the National Snow and Ice Data Center (NSIDC) in Boulder, Colorado.

ClimoBase2014

7,008 CSV files / 67 MB Data files organized by study Detailed ‘README.txt’ files Standardized ‘NULL’ values Descriptive metadata

Stored securely Accessed via NSIDC

Recommended