Overview of the state of Overview of the state of library automation:library automation:Framing the OLE InitiativeFraming the OLE Initiative
Tuesday Sept 9, 2008
Duke University
Marshall BreedingMarshall BreedingDirector for Innovative Technologies and ResearchDirector for Innovative Technologies and ResearchVanderbilt UniversityVanderbilt University
http://staffweb.library.vanderbilt.edu/breedinghttp://www.librarytechnology.org/
AbstractAbstract
A brief overview and history of the A brief overview and history of the problem space we are addressing problem space we are addressing through the OLE Project. through the OLE Project.
Address to an audience savvy Address to an audience savvy regarding the library automation regarding the library automation arena. arena.
Summarize the state of the ILS world, Summarize the state of the ILS world, key problems with commercial ILS, key problems with commercial ILS, etc.etc.
Part I. Part I. Broad Industry and Broad Industry and Product TrendsProduct Trends
UpheavalsUpheavals
Industry ConsolidationIndustry Consolidation Abrupt transitions for major library Abrupt transitions for major library
automation productsautomation products Increased industry control by external Increased industry control by external
financial investorsfinancial investors Demise of the traditional OPACDemise of the traditional OPAC Frustration with ILS products and Frustration with ILS products and
vendorsvendors Open Source alternatives hit the Open Source alternatives hit the
mainstreammainstreamBreeding, Marshall: Perceptions 2007 an international survey of library automation. http://www.librarytechnology.org/perceptions2007.pl January 2008.
LJ Automation System LJ Automation System MarketplaceMarketplace Annual Industry report published in Annual Industry report published in
Library JournalLibrary Journal 2008: Opportunity out of turmoil 2008: Opportunity out of turmoil 2007: An industry redefined 2007: An industry redefined 2006: Reshuffling the deck 2006: Reshuffling the deck 2005: Gradual evolution 2005: Gradual evolution 2004: Migration down, innovation up 2004: Migration down, innovation up 2003: The competition heats up 2003: The competition heats up 2002: Capturing the migrating customer 2002: Capturing the migrating customer
Library Automation Library Automation M&A HistoryM&A History
Product and Product and Technology TrendsTechnology Trends Innovation below expectationsInnovation below expectations Conventional ILS less tenableConventional ILS less tenable Proliferation of products related Proliferation of products related
to e-content managementto e-content management New genre of discovery-layer New genre of discovery-layer
interfacesinterfaces
Web 2.0 / Web 2.0 / Collaborative Collaborative ComputingComputing
Currently implemented ad hocCurrently implemented ad hoc Many libraries putting up blogs, wikis, and Many libraries putting up blogs, wikis, and
fostering engagement in social networking fostering engagement in social networking sitessites
Proliferation of silos with no integration or Proliferation of silos with no integration or interoperability with larger library Web interoperability with larger library Web presencepresence
Next Gen: Build social and collaborative Next Gen: Build social and collaborative features into core automation componentsfeatures into core automation components
Part II. A Mandate Part II. A Mandate for Opennessfor Openness
Opportunities for Opportunities for OpennessOpenness
Open SourceOpen Source– Alternative to traditionally licensed Alternative to traditionally licensed
softwaresoftware Open SystemsOpen Systems
– Software that doesn’t hold data hostageSoftware that doesn’t hold data hostage
Open Source AlternativesOpen Source Alternatives
Explosive interest in Open Source driven Explosive interest in Open Source driven by disillusionment with current vendors by disillusionment with current vendors and near-evangelical promotion of this and near-evangelical promotion of this software licensing modelsoftware licensing model
Beginning to emerge as a practical optionBeginning to emerge as a practical option TOC (Total Cost of Ownership) still roughly TOC (Total Cost of Ownership) still roughly
equal to proprietary commercial modelequal to proprietary commercial model Still a risky strategy for libraries – Still a risky strategy for libraries –
traditional licensing also riskytraditional licensing also risky
A result of industry A result of industry turmoilturmoil Disruptions and business decisions Disruptions and business decisions
to narrow options have fueled the to narrow options have fueled the open source movementopen source movement
Benefit to libraries in having Benefit to libraries in having additional optionsadditional options
Traditionally licensed and open Traditionally licensed and open source ILS alternatives will coexist source ILS alternatives will coexist in the ILS arenain the ILS arena
Open Source ILS enters Open Source ILS enters the mainstreamthe mainstream
Earlier era of pioneering efforts to Earlier era of pioneering efforts to ILS shifting into one where open ILS shifting into one where open source alternatives fall in the source alternatives fall in the mainstreammainstream
Off-the-shelf, commercially Off-the-shelf, commercially supported product availablesupported product available
Still a minority player, but gaining Still a minority player, but gaining groundground
Open Source ILS Open Source ILS optionsoptions KohaKoha
– Commercial support from LibLimeCommercial support from LibLime EvergreenEvergreen
– Commercial support from Equinox Commercial support from Equinox SoftwareSoftware
OPALSOPALS– Commercial support from Media FlexCommercial support from Media Flex
NewGenLibNewGenLib– Open Source ILS for the developing worldOpen Source ILS for the developing world
Observations on Open Observations on Open Source ILSSource ILS
Current Open Source ILS products similar in modular Current Open Source ILS products similar in modular organization and functionality to existing systems. organization and functionality to existing systems. Evolving to achieve the same level of features and Evolving to achieve the same level of features and capacity present in established commercial systems.capacity present in established commercial systems.
Initial wave of Open Source ILS commitments Initial wave of Open Source ILS commitments happened in the public library arena. Recent activity happened in the public library arena. Recent activity among academic libraries:among academic libraries:– WALDO Consortium (Voyager > Koha)WALDO Consortium (Voyager > Koha)– University of Prince Edward Island (Unicorn > Evergreen) University of Prince Edward Island (Unicorn > Evergreen)
Do the current open source ILS products provide a Do the current open source ILS products provide a new model of automation, or an open source version new model of automation, or an open source version of what we already have?of what we already have?
JISC – SCONUL study did not show strong interest in JISC – SCONUL study did not show strong interest in open source ILS in the UK.open source ILS in the UK.
Impact of Open Source Impact of Open Source ILSILS Library automation industry cannot be Library automation industry cannot be
complacentcomplacent Some libraries moving from traditionally Some libraries moving from traditionally
licensed products to open source products licensed products to open source products with commercial support planswith commercial support plans
Disruption of ILS industryDisruption of ILS industry– new pressures on incumbent vendors to deliver new pressures on incumbent vendors to deliver
more innovation and to satisfy concerns for more innovation and to satisfy concerns for opennessopenness
New competition / More optionsNew competition / More options
More Open SystemsMore Open Systems
Pressure for traditionally licensed products to become Pressure for traditionally licensed products to become more openmore open
APIs (Application Programming Interfaces) let libraries APIs (Application Programming Interfaces) let libraries access and manipulate their data outside of delivered access and manipulate their data outside of delivered softwaresoftware
A comprehensive set of APIs potentially give libraries A comprehensive set of APIs potentially give libraries more flexibility and control in accessing data and more flexibility and control in accessing data and services and in extending functionality than having services and in extending functionality than having access to the source code.access to the source code.
Customer access to APIs does not involve as much risk Customer access to APIs does not involve as much risk to breaking core system functions, avoids issues of to breaking core system functions, avoids issues of version management and code forking associated with version management and code forking associated with open source models.open source models.
A Continuum of A Continuum of OpennessOpenness
Closed SystemsClosed Systems
Circulation AcquisitionsCataloging
Staff Interfaces:
End User Interfaces:
Data Stores:
Functionalmodules:
No programmable Access to the system.
Captive to the userInterfaces supplied by the developer
Programmer access:
Standard RDBM Standard RDBM SystemsSystems
Circulation AcquisitionsCataloging
Staff Interfaces:
End User Interfaces:
Data Stores:
Functionalmodules:
Database administrators can access data stores involved with the system:
Read-only?Read/write?
Developer shares database schema
Programmer access:
Open Source ModelOpen Source Model
Circulation AcquisitionsCataloging
Staff Interfaces:
End User Interfaces:
Data Stores:
Functionalmodules:
All aspects of the system available to inspection and modification.
Programmer access:
Open API ModelOpen API Model
Circulation AcquisitionsCataloging
Staff Interfaces:
End User Interfaces:
Data Stores:
Functionalmodules:
Core application closed.
Third party developers code against the published APIs or RDBMS tables.
Programmer access:
Published APIs
Open Source / Open Open Source / Open API ModelAPI Model
Circulation AcquisitionsCataloging
Staff Interfaces:
End User Interfaces:
Data Stores:
Functionalmodules:
Core application closed.
Third party developers code against the published APIs or RDBMS tables.
Programmer access:
Published APIs
Depth of OpennessDepth of Openness
Evaluate level of access to a products data Evaluate level of access to a products data stores and functional elements:stores and functional elements:– Open source vs Traditional licensesOpen source vs Traditional licenses
Some traditional vendors have well Some traditional vendors have well established API implementationsestablished API implementations– SirsiDynix Unicorn (API available to authorized SirsiDynix Unicorn (API available to authorized
customer sites that take training program)customer sites that take training program)– Ex Libris: consistent deployment of APIs in major Ex Libris: consistent deployment of APIs in major
products, recent strategic initiative: “Open products, recent strategic initiative: “Open Platform Program”Platform Program”
– Innovative Interfaces: Patron APIInnovative Interfaces: Patron API
Universal open APIs?Universal open APIs?
Some progress on API to support discovery layer Some progress on API to support discovery layer interfaces, but no comprehensive framework yet.interfaces, but no comprehensive framework yet.
Many industry protocols work like APIs: Many industry protocols work like APIs: – Z39.50, SRU/W, NCIP, OAI-PMH, OpenURL, etdZ39.50, SRU/W, NCIP, OAI-PMH, OpenURL, etd
It would be ideal if there were an open set of APIs that It would be ideal if there were an open set of APIs that were implemented by all automation system products.were implemented by all automation system products.– Third party components and add-ons would then work Third party components and add-ons would then work
across all products.across all products. DLF ILS-Discovery Interface protocol. Targets DLF ILS-Discovery Interface protocol. Targets
interoperability between ILS and new genre of interoperability between ILS and new genre of interfacesinterfaces
AKA: Berkeley AccordsAKA: Berkeley Accords
Opportunity out of the Opportunity out of the UpheavalsUpheavals
More optionsMore options– Commercial + Open SourceCommercial + Open Source
More vendorsMore vendors– New open source support companies provide new New open source support companies provide new
competitioncompetition Traditionally licensed and open source automation Traditionally licensed and open source automation
systems will co-exist. We have an interest in the systems will co-exist. We have an interest in the success of both alternatives.success of both alternatives.
More library involvementMore library involvement– Libraries re-energized to make significant Libraries re-energized to make significant
contributions to the body of library automation contributions to the body of library automation softwaresoftware
Part III. Moving Part III. Moving toward new toward new generation of library generation of library automationautomation
Rethinking the ILSRethinking the ILS
Fundamental assumption: Print + Digital = Hybrid Fundamental assumption: Print + Digital = Hybrid librarieslibraries
Traditional ILS model not adequate for hybrid Traditional ILS model not adequate for hybrid librarieslibraries
Libraries currently moving toward surrounding core Libraries currently moving toward surrounding core ILS with additional modules to handle electronic ILS with additional modules to handle electronic contentcontent
New discovery layer interfaces replacing or New discovery layer interfaces replacing or supplementing ILS OPACSsupplementing ILS OPACS
Working toward a new model of library automationWorking toward a new model of library automation– Monolithic legacy architectures replaced by fabric of SOA Monolithic legacy architectures replaced by fabric of SOA
applicationsapplications– Comprehensive Resource ManagementComprehensive Resource Management
“It's Time to Break the Mold of the Original ILS” Computers in Libraries Nov/Dec 2007
ILS: a legacy concept?ILS: a legacy concept?
ILS = Integrated Library System ILS = Integrated Library System (Cataloging + Circulation + OPAC + Serials + (Cataloging + Circulation + OPAC + Serials +
Acquisitions)Acquisitions) Focused on print and physical inventoryFocused on print and physical inventory Electronic content at the Journal Title or Electronic content at the Journal Title or
collection levelcollection level Emerged in the 1960’s – 1970’sEmerged in the 1960’s – 1970’s Functionality has evolved and expanded, but Functionality has evolved and expanded, but
basic concepts and modules remain intactbasic concepts and modules remain intact Note: Some companies work toward evolving the Note: Some companies work toward evolving the
ILS to competently handle both print and digital ILS to competently handle both print and digital content (e.g. Innovative Interfaces)content (e.g. Innovative Interfaces)
ILS: ever diminishing ILS: ever diminishing rolerole Many libraries putting much less emphasis Many libraries putting much less emphasis
on ILSon ILS Just an inventory system for physical Just an inventory system for physical
materialsmaterials Investments in electronic content increasingInvestments in electronic content increasing Management of e-content handled outside of Management of e-content handled outside of
the ILSthe ILS Yet: libraries need comprehensive business Yet: libraries need comprehensive business
automation more than ever. Mandate for automation more than ever. Mandate for more efficient operations. Do more with less.more efficient operations. Do more with less.
Dis-integration of Library Dis-integration of Library Automation FunctionalityAutomation Functionality
ILS -- Print and Physical inventoryILS -- Print and Physical inventory OpenURL Link resolverOpenURL Link resolver Federated SearchFederated Search Electronic Resource Management Electronic Resource Management
ModuleModule Discovery layer interfaceDiscovery layer interface
Is non-integrated Is non-integrated automation sustainable?automation sustainable?
Major burden on library personnelMajor burden on library personnel Serial procurement / installation / Serial procurement / installation /
configuration / maintenance cycles take configuration / maintenance cycles take many years to result in a many years to result in a comprehensive environmentcomprehensive environment
Inefficient data modelsInefficient data models Disjointed interfaces for library usersDisjointed interfaces for library users Very long cycle to gain comprehensive Very long cycle to gain comprehensive
automationautomation
New genre of discovery New genre of discovery layer interfaceslayer interfaces
Traditional ILS OPAC inadequate for Traditional ILS OPAC inadequate for today’s Web-savvy library userstoday’s Web-savvy library users
Scope too narrowScope too narrow Complex, non-intuitive interfaceComplex, non-intuitive interface Yet: Necessary for some types of Yet: Necessary for some types of
researchresearch Working toward a single point of Working toward a single point of
entry for all the content and services entry for all the content and services offered by the libraryoffered by the library
Common Next-Gen Common Next-Gen Interface featuresInterface features
Decoupled interfaceDecoupled interface Advanced search enginesAdvanced search engines Relevancy ranked resultsRelevancy ranked results Faceted NavigationFaceted Navigation Graphically enriched displaysGraphically enriched displays Real-time interaction with ILSReal-time interaction with ILS Advanced user services and Advanced user services and
information delivery featuresinformation delivery features
Current ProductsCurrent Products
Aquabrowser (Medialab, Bowker / Serials Solutions)Aquabrowser (Medialab, Bowker / Serials Solutions) Primo (Ex Libris)Primo (Ex Libris) Encore (Innovative Interfaces)Encore (Innovative Interfaces) WorldCat Local (OCLC)WorldCat Local (OCLC) BiblioCommonsBiblioCommons Visualizer (VTLS)Visualizer (VTLS) eXtensive Catalog (University of Rochester)eXtensive Catalog (University of Rochester) VUFind (open source / Villanova University)VUFind (open source / Villanova University) Scriblio (open source)Scriblio (open source)
http://www.librarytechnology.org/discovery.plhttp://www.librarytechnology.org/discovery.pl
Deep searchDeep search
Entering post-metadata search eraEntering post-metadata search era Increasing opportunities to search the full contentsIncreasing opportunities to search the full contents
– Google Library Print, Google Publisher, Open Content Alliance, Google Library Print, Google Publisher, Open Content Alliance, Microsoft Live Book Search, etc.Microsoft Live Book Search, etc.
– High-quality metadata will improve search precisionHigh-quality metadata will improve search precision Commercial search providers already offer “search inside the Commercial search providers already offer “search inside the
book”book” No comprehensive full text search for books quite yetNo comprehensive full text search for books quite yet Beginning to appear in library search environmentsBeginning to appear in library search environments
– U of Mich (U of Mich (http://mblog.lib.umich.edu/blt/archives/2008/05/search_full-tex.htmlhttp://mblog.lib.umich.edu/blt/archives/2008/05/search_full-tex.html ) ) Deep search highly improved by high-quality metadataDeep search highly improved by high-quality metadata
See: Systems Librarian, May 2008 “Beyond the current generation of next-generation interfaces: See: Systems Librarian, May 2008 “Beyond the current generation of next-generation interfaces: deeper search”deeper search”
Architecture and Architecture and StandardsStandards Need to have an standard approach for Need to have an standard approach for
connecting new generation interfaces with connecting new generation interfaces with ILS and other repositoriesILS and other repositories
Proprietary and Proprietary and ad hocad hoc methods currently methods currently prevailprevail
Digital Library FederationDigital Library Federation– ILS-Discovery Interface GroupILS-Discovery Interface Grouphttp://www.librarytechnology.org/blog.pl?ThreadID=43 http://www.librarytechnology.org/blog.pl?ThreadID=43
Initial foray into a broader set of protocols Initial foray into a broader set of protocols that open up other aspects of the ILSthat open up other aspects of the ILS
Moving toward a new Moving toward a new Generation of Library Generation of Library AutomationAutomation Are Legacy ILS concepts Are Legacy ILS concepts
sustainable?sustainable? New automation environment New automation environment
based on current library realities based on current library realities and modern technology platformsand modern technology platforms
Equal footing for digital and printEqual footing for digital and print Service oriented architectureService oriented architecture
Breaking down the Breaking down the modulesmodules Traditional ILSTraditional ILS
– CatalogingCataloging– CirculationCirculation– Online CatalogOnline Catalog– AcquisitionsAcquisitions– Serials controlSerials control– ReportingReporting
Modern approach: SOAModern approach: SOA
Service Oriented Service Oriented ArchitectureArchitecture
http://www.sun.com/products/soa/benefits.jsp
Legacy ILS + e-Legacy ILS + e-content modulescontent modules
FederatedSearch
FederatedSearch
Circulation Acquisitions
Cataloging Serials
OpenURLLinking
OpenURLLinking
Electronic Resource
MgmtSystem
Electronic Resource
MgmtSystem
Staff Interfaces:
End User Interfaces:
Data Stores:
Functionalmodules:
SOA model for business SOA model for business automationautomation
Underlying data repositoriesUnderlying data repositories– Local or GlobalLocal or Global
Reusable business servicesReusable business services Composite business applicationsComposite business applications
SOA for library workflow SOA for library workflow processesprocesses
Data Stores:
ReusableBusiness Services
CompositeApplications
Granulartasks:
Comprehensive Comprehensive Resource Management Resource Management
Broad conceptual approach that proposes a Broad conceptual approach that proposes a library automation environment that spans library automation environment that spans all types of content that comprise library all types of content that comprise library collections.collections.
Traditional ILS vendors: Under development Traditional ILS vendors: Under development but no public announcementsbut no public announcements
Open Source projects in early phasesOpen Source projects in early phases Projection: 2-3 years until we begin see Projection: 2-3 years until we begin see
library automation systems that follow this library automation systems that follow this approach. 5-7 years for wider adoption.approach. 5-7 years for wider adoption.
Open Library Open Library Environment (OLE) Environment (OLE) projectproject Andrew W. Mellon Foundation Andrew W. Mellon Foundation
– Research in Information Technology programResearch in Information Technology program– Solicited proposal / Lead institutionSolicited proposal / Lead institution
Duke University selected to lead projectDuke University selected to lead project Core Participants: Kansas University, Lehigh Core Participants: Kansas University, Lehigh
University, National Library of Australia, Library and University, National Library of Australia, Library and Archives Canada, University of Pennsylvania, Marshall Archives Canada, University of Pennsylvania, Marshall BreedingBreeding
Advisory Participants: University of Chicago, Wittier Advisory Participants: University of Chicago, Wittier College, University of Maryland, ORBIS Cascade College, University of Maryland, ORBIS Cascade Alliance, Rutgers UniversityAlliance, Rutgers University
Status: Proposal complete, pending formal approval Status: Proposal complete, pending formal approval from the Andrew W. Mellon Foundationfrom the Andrew W. Mellon Foundation
http://oleproject.org
Preparing for next Preparing for next generation library generation library automationautomation
Reassess workflowsReassess workflows Separate streams for print and digital?Separate streams for print and digital? Integrated processing of print and Integrated processing of print and
digital?digital? Opportunities to take advantage of Opportunities to take advantage of
SOA-based composite business SOA-based composite business applicationsapplications
Assemble a more ideal set of tools for Assemble a more ideal set of tools for managing serials and periodicalsmanaging serials and periodicals
Questions and Questions and DiscussionDiscussion
