Michael B. Toth mbt@rbtoth.com R.B Toth Associates

www.rbtoth.com

DHSS 2014 Challenges in Digitization Studies

Integration of Spectral Imaging as an Effective Preservation Support Tool

@michabt Follow

Eureka! Medieval Manuscripts on the Web

www.rbtoth.com

Applying Digitization

…to Preservation Support, Manuscript Studies, and Global Access

www.rbtoth.com

Providing Access

1. Access to data • By People • By Machines

2. Intellectual Property

• Global Storage & Access

www.rbtoth.com

…and “Digital Preservation”

www.rbtoth.com

…for Global Sharing

www.rbtoth.com

Applied Science & Technology…

www.rbtoth.com

…in Support of Users

www.rbtoth.com

Jan 2001 Proof of Concept

2003 2008 2004 2005 2006

Manuscript Study

Information and Imaging Technology

Archimedes Palimpsest Program 2003 2008 2004 2005 2006 2007

Oct 1998 Palimpsest Purchased

Sep 1998 Google Founded 10,000 queries/day

2007 Google indexes 4.28+ billion web pages 250+ million search results/day

2007 2000

2000

2001

2001

2002

2002

1999

1999

1998

1998

Imaging

Sep 2003 Firefox Released

Oct 2001 XML 2d Ed. Standard

1998 Kodak DC210+ 1.0 Megapixel Camera

2003 Kodak DX 6440 4 Mp Camera

2007 Kodak V1003 10 Mp Camera

2001 Kodak DCS 760 6.1 Megapixel Camera

2001 Archimedes Draft Metadata Standard

2007 Stokes 256 Mp Imaging System

Apr 2001 – Nov 2006 Phased Optical Imaging and Stitching Aug 2007 Optical Imaging

April 2004 ADITUP Conference

2000 Study Phase

2003 Archimedes Forum

2005-2006 XRF Imagining

2006 POC Data Release

2001 Method Sciamus Paper

2003 Stomachion NYTimes Article

2004 Hyperides

2005 Aristotle Commentary

2008 Data Release

2007-2008 Transcriptions

Technology Development

www.rbtoth.com

Camera Manuscript Optical Fibers LEDs

Prototype LED Illumination System November 2006 -Walters Art Museum

www.rbtoth.com

“National Treasure: Book of Secrets” December 2007

“Imaging” of page fragment from “John Wilkes Booth’s diary” using prop system based on 2006 LED system

Justin Bartha Nicolas Cage Diane Kruger

www.rbtoth.com

2007 LED Illumination

Bill Christens-Barry

Equipoise Imaging

www.rbtoth.com

Prototype LED Panel

UV LED • l0 = 365 nm 7 visible LEDs • 445 nm • 470 nm • 505 nm • 530 nm • 570 nm • 617 nm • 625 nm

4 Infrared LEDs • 700 nm • 735 nm • 780 nm • 870 nm

Two Panels, each w/ six banks of 12 visible and UV LEDs + two banks of 4 IR LEDs

www.rbtoth.com

LED Illumination

Imaging Systems

www.rbtoth.com

System Development

Integrate Integrate with Work with Work Processes Processes and Data and Data

StandardsStandards

AssessAssessCultural Cultural Heritage Heritage NeedsNeeds

Develop Develop System System

to Meet User/to Meet User/Stakeholder Stakeholder

NeedsNeeds

Image, Image, Process,Process,Distribute Distribute

Data, Data, ReviewReview

Develop Develop Phased Plan, Phased Plan,

Schedule, Schedule, Budget, Goals Budget, Goals

Integrate Integrate Feedback Feedback into Next into Next

Deliverable Deliverable

Review Plans Review Plans with Users with Users

Stakeholders Stakeholders & Team& Team

Inputs:

Funding, Goals, Standards, Deliverables

Deve

lopm

ent

Deve

lopm

ent

Proc

ess

Proc

ess

Desi

gn

Desi

gn

Elem

ents

Elem

ents Technology:

Proof of ConceptTestbedsPrototypesSoftware

Documentation: Review ReportsUser FeedbackUser and System MetricsOperational Manuals

Risk Reduction Evaluation:Test technical capability Identify development alternativesMilestone Reviews:Incorporate stakeholder/user feedback Goals met for each phase Inputs for next development phases

www.rbtoth.com

St. Catherine’s Monastery, Sinai 2009- Present

www.rbtoth.com

Syriac Galen Palimpsest 2009- Present

www.rbtoth.com

David Livingstone Diaries

www.rbtoth.com

XML Transcriptions

www.rbtoth.com

Metadata in Transcriptions

www.rbtoth.com

Integration of Data

This work is licensed under a Creative Commons Attribution-NonCommercial 3.0 Unported License.

www.rbtoth.com

System Integration

Technology

Processes People

www.rbtoth.com

• Requirements definition Program phasing to meet funding & schedule

• Systems integration New technologies & appropriate skills

• Process engineering Development of efficient work processes

• Standardization Application of broadly accepted standards

Program Management

www.rbtoth.com

1. Governance: Models for repository and data management with transparency and institution-wide acceptance

2. Staffing and Work Processes: Common current and future work processes supported by needed skills base

3. Cataloging and Metadata: Cataloguing information and metadata integrated with data set

4. Standards: International mature standards used in storing and maintaining digital data set, including metadata

5. Quality Control: Security, monitoring and auditing of any manipulation of data and/or supporting infrastructure

6. Content Management and Access: Continued Content Management and Access throughout full lifecycle

7. Outreach and External Collaboration: External collaboration and access to ensure broad storage and common standards

Full Lifecycle Program

www.rbtoth.com

Color Digital Imaging

X-Ray Synchrotron

Experimental Spectral Imaging, 3D

Imaging

Production Spectral Imaging &

Processing

$$$$ €€€€

$$$ €€€

$$ €€

$ €

Potential Applications

www.rbtoth.com

• Image Collection – Integrated illumination system and camera – Rapid set-up, ease of operator use – Integration of data and metadata

• Processing – Broadly accessible image processing algorithms – Sufficient power to digitally process large images – Ease and speed of use

• Data Storage – Sufficient storage for multiple large image sets – Standardized data and metadata – Long-term data viability

• Dissemination and Access – Integration of data from processing, studies – Access and dissemination by multiple users – Rapid access & transfer of large image files via Internet

Technical System & Infrastructure

www.rbtoth.com

Metadata

Metadata is structured information that describes, explains, locates, or otherwise makes it easier to retrieve, use, or manage an information resource. Metadata is often called data about data or information about information.

National Information Standards Organization, 2004

www.rbtoth.com

Cataloging & Metadata • Metadata Integrated with Digital Object

– Adherence to broadly accepted standards – Simple, flat metadata records

• Persistent Identifiers

• Accepted Standards – Standardized Vocabularies – Metadata Schema – XML to support conversion to other formats

• (e.g. MARC, MODS, EAD)

• Documentation & Preserve Standards

www.rbtoth.com

Six Types of Metadata Elements: 1. Identification Information 2. Spatial Data Reference Information 3. Imaging & Spectral Data Reference Information 4. Data Type Information 5. Data Content Information 6. Metadata Reference Information

(including XRF Extensions)

http://www.archimedespalimpsest.net/Documents/Internal/

Spectral Imaging Metadata

www.rbtoth.com

Dublin Core Metadata Initiative Element Set

www.rbtoth.com

Spectral Imaging Metadata

Six Types of Metadata Elements: 1. Identification Information 2. Spatial Data Reference Information 3. Imaging & Spectral Data Reference Information 4. Data Type Information 5. Data Content Information 6. Metadata Reference Information

(including XRF Extensions)

http://www.archimedespalimpsest.net/Documents/Internal/

www.rbtoth.com

Including: • Catalog Information • Metadata • File Format • Conservation Data • Intellectual Property • Storage • Others

Standardize Digital Products

www.rbtoth.com

Metadata & Standards Development: • Define consensus standards and metadata

elements to be used in pilot digitization o Include required cataloging & metadata

standards, standardized vocabulary, schemas and crosswalks

Metadata and Standards Review: • Define, document, review key metadata

elements and pilot project standards with major stakeholders and partners.

Data Planning

www.rbtoth.com

www.rbtoth.com

Content Management System

• Data Repository (CMS) – Master Server

• Master Files • Cataloging Data • Restricted Access Files

– Application Server • User Data

– PREMIS Archive • Dark Archive

• Access Infrastructure • Security

www.rbtoth.com

Simple Data Layout

ReadMe

Technical ReadMe

Data

Supplemental

Access Core Images

Access Other

Images

www.rbtoth.com

§Ensure utility of simple data §Broad distribution to service

providers §Standardized formats & encoding

Impermanence of Digital Data

Dynamic technology, media & formats • Rapid obsolescence requires regular reformatting

www.rbtoth.com

Digital “Preservation” • Sufficient storage for multiple large image sets • Globally replicate data online • Rapid access via Internet

www.rbtoth.com

Data & Metadata

• Long-term data set viability beyond the lifetime of current technologies – Adherence to existing, broadly accepted standards – Simple, flat digital records

• Critical for access, sharing and interpretation of digital data

• Integration of metadata with images, supporting data and scholarly products

www.rbtoth.com

Data Sharing

www.rbtoth.com

Changing Preservation

www.rbtoth.com

Photograph by Mark Schrope © 2012 Used with permission

www.rbtoth.com mbt@rbtoth.com

@michabt Follow

Eureka! Medieval Manuscriptson the Web

digitalgalen.net thedigitalwalters.org

Thank You