39
What is a Successful Digital Library? ECDL 2006, Alicante, September 18, 2006 Rao Shen, Naga Srinivas Vemuri, Weiguo Fan, and Edward A. Fox [email protected] http://fox.cs.vt.edu
What is a Successful Digital Library?
ECDL 2006, Alicante, September 18, 2006
Rao Shen, Naga Srinivas Vemuri, Weiguo Fan, and Edward A. Fox
[email protected] http://fox.cs.vt.edu
Acknowledgements (Selected)
• Sponsors: NSF grant ITR-0325579, ASOR, CWRU, ETANA, Vanderbilt U., Virginia Tech
• Faculty/Staff: Lillian Cassel, Debra Dudley, Manuel Perez, …
• VT (Former) Students: Aaron Krowne, Ming
Luo, Fernando Das Neves, Ricardo Torres, Hussein Suleman, …
Acknowledgements (Selected)
• Karen Borstad, MPP
• Giorgio Buccellati, UCLA
• Douglas Clark, Walla Walla College
• Joanne Eustis, CWRU
• Nick Fischio, CWRU
• Israel Finkelstein, Tel-Aviv University
• Paul Gherman, Vanderbilt U.
• Andrew Graham, U. Toronto
• Tim Harrison, U. Toronto
• Larry Herr, Canadian University College
• Christopher Holland, LRP
• Paul Jacobs, Mississippi State U.
• Douglas Knight, Vanderbilt U.
• Stan LaBianca, Andrews U.
• David McCreery, Willamette U.
• Eric Meyers, Duke U.
• Adam Porter, Illinois College
• Jack Sasson, Vanderbilt U.
• Tom Schaub, Indiana U. of Penn.
• Randall Younker, Andrews U.
ETANA-DL Website
ETANA-DL’s Member Collections
Outline
Ø Prior work Ø DL success model
§ From end user perspective Ø Case study Ø Conclusion
has an example IS success model
Prior Work on Measuring DL Success
DeLone et al.
Seddon
has an example Information seeking behavior model
Ellis
Kuhlthau
has an example DL quality model Gonçalves
has an example Usability of DLs inspection of NCSTRL
evaluation of ACM, IEEE-CS, NCSTRL, and NDLTD
evaluation of ADL
evaluation of ADEPT
has an indicator
system usage
has an example Technology
acceptance model Venkatesh predict Intention to re/use
Behavioral Attitude & Intension to Use — Venkatesh Model of IT Adoption
intention to use system
performance expectancy
system usage
Unified Theory of Acceptance and Use of Technology
effort expectancy
social influence
facilitating conditions
• Performance expectancy: – perceived usefulness, extrinsic motivation, job-fit, relative advantage,
and outcome expectations
• Effort expectancy – the degree of ease associated with the use of system
• Social influence – Subjective norms, social factors, and image
• Facilitating conditions – the degree to which an individual believes that an organizational and
technical infrastructure exist to support the system
Venkatesh Model of IT Adoption
DeLone and McLean Model of IS Success
System Quality
Information Quality
User Satisfaction
Individual Impact
Organization Impact
Use
Seddon Model of IS Success
System Quality
Information Quality
User Satisfactions
Net Benefits to:
Individuals Organizations
Society
Perceived Usefulness
Outline
Ø Prior work Ø DL success model
§ From end user perspective Ø Case study Ø Conclusion
DL Success Model
Ø 5S and minimal DL Ø Synthesize
§ IS success and adoption models (see above) § Information life cycle model (Borgman et al.) § 5S-based DL quality model (Gonçalves et al.) § Information-seeking behavior models (Ellis’ and
Kuhlthau’s) Ø From end user perspective
Informal 5S & DL Definitions DLs are complex systems that • help satisfy info needs of users (societies) • provide info services (scenarios) • organize info in usable ways (structures) • present info in usable ways (spaces) • communicate info with users (streams)
5S and DL formal definitions and compositions (April 2004 TOIS)
5S
structures (d.10)streams (d.9) spaces (d.18) scenarios (d.21) societies (d. 24)
structural metadataspecification(d.25)
descriptive metadataspecification(d.26)
repository(d. 33)
collection (d. 31)
(d.34)indexingservice
structured stream (d.29)
digitalobject (d.30)
metadata catalog (d.32)
browsingservice
(d.37)
searchingservice (d.35)
digital library(minimal) (d. 38)
services (d.22)
sequence (d. 3)
graph (d. 6)function (d. 2)
measurable(d.12), measure(d.13), probability (d.14), vector (d.15), topological (d.16) spaces
event (d.10)state (d. 18)
hypertext(d.36)
sequence (d. 3)
transmission(d.23)
relation (d. 1) language (d.5)
grammar (d. 7)
tuple (d. 4)*
Borgman et al.: Workshop Report on Social Aspects of Digital Libraries: http://www-lis.gseis. ucla.edu/DL/
Information Life Cycle
Information Life Cycle
Authoring Modifying
Organizing Indexing
Storing Retrieving
Distributing Networking
Retention / Mining
Accessing Filtering
Using Creating
sim
ilarit
y,
timel
ines
s,
completeness,
conformance
pertinence,
timeliness
Gonçalves et al.
system quality (SQ)performance expectancy (PE)
society, scenario, spaceservice
accessibility reliability
ease of use joy of use
composabilityefficiency
effectivenessextensibilityreusabilityreliability
accessibility accuracy
completeness consistence conformance pertinence
preservabilityrelevance
significance similaritytimeliness
DL quality dimension
information quality (IQ)
stream, structuredigital object
metadatacollectioncatalog
repository
adequacyrelevancereliability
scopetimeliness
understandability
social influence (SI)
DL success construct
society
5S and DL concept
DL visibility
DL success manifest variable
system quality (SQ)performance expectancy (PE)
society, scenario, spaceservice
accessibility reliability
ease of use joy of use
composabilityefficiency
effectivenessextensibilityreusabilityreliability
accessibility accuracy
completeness consistence conformance pertinence
preservabilityrelevance
significance similaritytimeliness
DL quality dimension
information quality (IQ)
stream, structuredigital object
metadatacollectioncatalog
repository
adequacyrelevancereliability
scopetimeliness
understandability
social influence (SI)
DL success construct
society
5S and DL concept
DL visibility
DL success manifest variable
E1:starting
K1:
in
itiat
ion
K3: exploration
K6:
presentation
sim
ilarit
y,
timel
ines
s,
completeness,
conformance
DL Success Constructs
E: Ellis’ model K: Kuhlthau’s model
satisfaction performance expectancy
(PE)
behavioral Intention to
(re)use
relevance adequacy timeliness
reliability understandability scope
accessibility ease of use
joy of use reliability
user interface
social influence (SI)
information quality (IQ)
system quality (SQ)
DL Success Model
information quality (IQ)
DL Concepts Regarding Information
collection metadata catalog
digital object metadata specification
repository
consist of
associated with
associated with
consist of consist of
accessibility preservability
pertinence relevance similarity
significance timeliness
digital object
accuracy completeness conformance
metadata specification
impact factor completeness collection
consistency completeness catalog
consistency completeness repository
understandability relevance timeliness reliability adequacy
digital object metadata specification
adequacy
catalog collection
scope
repository
Information Quality (IQ) Digital Library IQ
satisfaction performance expectancy
(PE)
behavioral Intention to
(re)use
relevance adequacy timeliness
reliability understandability scope
accessibility ease of use
joy of use reliability
user interface
social influence (SI)
information quality (IQ)
system quality (SQ)
DL Success Model
system quality (SQ)
screen design navigation
user interface
composability reusability
extensibility efficiency
effectiveness reliability
service accessibility
reliability ease of use joy of use
System Quality (SQ)
performance expectancy
Digital Library SQ
Outline
Ø Prior work Ø DL success model
§ From end user perspective Ø Case study Ø Conclusion
Case Study
Ø Part of requirements analysis for ETANA-DL § Email interviews with 5 prestigious
archaeologists § Face to face workplace interviews with 11
archaeologists Ø Associate the 4 constructs of DL success
model with the activities occurring in the seeking and utilization phases
DL success Construct
seeking phase utilization phase starting (E1/K1)
selection exploration
(E2-E6)/(K2-K3)
formulation (K4)
collection (K5)
presentation (K6)
social influence DL visibility
information quality adequacy, scope accuracy
system quality ease of use joy of use (interface)
accessibility accessibility accessibility
performance expectancy
usefulness (interface)
DL Success Constructs Associated with Seeking and Utilization Phases
DL Success Constructs Associated with Seeking Phase
Ø E1: Starting’ activity in Ellis’ model (K1: ‘initiation’ stage in Kuhlthau’s model) § Social Influence (SI) — DL visibility
v Publicize existence of a DL v Provide a DL alert service
DL Success Constructs Associated with Seeking Phase
Ø E2-E6: ‘chaining’, ‘browsing’, ‘differentiating’, ‘monitoring’, and ‘extracting’ in Ellis’ model (K2-K3: ‘selection’ and ‘exploration’ stages in Kuhlthau’s model) § Information Quality (IQ) § System Quality (SQ) § Performance Expectancy (PE)
DL Success Constructs Associated with Seeking Phase
Ø E2-E6: ‘chaining’, ‘browsing’, ‘differentiating’, ‘monitoring’, and ‘extracting’ in Ellis’ model (K2-K3: ‘selection’ and ‘exploration’ stages in Kuhlthau’s model) § Information Quality (IQ)
v Adequacy (degree of sufficiency and completeness) of DL collections and metadata catalogs
v Scope of DL repository
DL Success Constructs Associated with Seeking Phases
Ø E2-E6: ‘chaining’, ‘browsing’, ‘differentiating’, ‘monitoring’, and ‘extracting’ in Ellis’ model (K2-K3: ‘selection’ and ‘exploration’ stages in Kuhlthau’s model) § System Quality (SQ)
v Ease of use v Joy of use
DL Success Constructs Associated with Seeking Phases
Ø E2-E6: ‘chaining’, ‘browsing’, ‘differentiating’, ‘monitoring’, and ‘extracting’ in Ellis’ model (K2-K3: ‘selection’ and ‘exploration’ stages in Kuhlthau’s model) § Performance Expectancy (PE)
v Usefulness
DL Success Constructs Associated with Seeking Phases
Ø E2-E6: ‘chaining’, ‘browsing’, ‘differentiating’, ‘monitoring’, and ‘extracting’ in Ellis’ model (K2-K3: ‘selection’ and ‘exploration’ stages in Kuhlthau’s model) § System Quality & Performance Expectancy
v DL interface: screen design & navigation
DL Success Constructs Associated with Utilization Phase
Ø K4-K6: ‘formulation’, ‘collection’, and ‘presentation’ stage in Kuhlthau’s model § Information Quality
v information accuracy v information accessibility
Outline
Ø Prior work Ø DL success model
§ From end user perspective Ø Case study Ø Conclusion
Conclusion
Ø Lay the foundation for defining success of DLs from the view of DL end users
Ø Assume a multi-theoretical perspective Ø Synthesize many related research areas in
terms of theory and empirical work Ø Explicate and illustrate our approach by a
case study with ETANA and usability Ø Connect with other work on DL quality: led
by Emory funded by IMLS, DELOS …
Questions? Comments?
See http://fox.cs.vt.edu/talks/2006/
20060918ECDLsuccess.ppt
