© 2013 Deep Web Technologies, Inc.

Abe LedermanPresident and CTO

Deep Web TechnologiesANKOS 2013 Annual Meeting

April 26, 2013

Federated Search: A Discovery Solution

© 2013 Deep Web Technologies, Inc. 2

About Deep Web Technologies...

• Founded by Abe Lederman in 2002

– A co-founder of Verity, acquired by Autonomy

– BS & MS Degrees in Computer Science from MIT

– 25 years experience in Information Retrieval

• Over 100 solutions deployed worldwide

• Over $5M in U.S. Government Grants

• Pioneer/trailblazer in federated search

• Swets/DWT – partners since January 2010

© 2013 Deep Web Technologies, Inc. 3

A

© 2013 Deep Web Technologies, Inc. 4

© 2013 Deep Web Technologies, Inc. 5

The “Google Myth”

© 2013 Deep Web Technologies, Inc. 6

Library vs. Internet

© 2013 Deep Web Technologies, Inc. 7

How Can You Help Users…?

© 2013 Deep Web Technologies, Inc. 8

American Library Association Annual Conference, New Orleans

© 2013 Deep Web Technologies, Inc. 9

Blog Articles on Discovery

On Thursday afternoon, Nov 4, 2010 I attended the 45 minute face-off between Serials Solutions’ Summon and EBSCO’s EDS.

In the brief demonstration part of the face-off both Summon and EDS were each given 2 searches to conduct as a way to show off their respective products. As opposed to the Q&A portion of the face-off, these searches were not given to Summon and EDS in advance as evidenced by the fumbling of both sides. From my perspective, these demonstrations highlighted the fact that Discovery Services are not really any better when compared to Deep Web Technologies’ Explorit in terms of the quality of results that they return to the user.

© 2013 Deep Web Technologies, Inc. 10

“A single-search interface to quickly find relevant, real-time information from the sources you select that students, faculty, and academic staff need for their research needs.”

What is “Federated Search”?

© 2013 Deep Web Technologies, Inc. 11

What is a “Discovery Service?”

Discovery Services are capable of searching quickly and seamlessly across a wide range of periodically indexed content provided by participating publishers and may include a library’s catalog and other local content in the index.

© 2013 Deep Web Technologies, Inc. 12

How Federated Search Differs from a Discovery Service

Enter Search Term…

SourcesSources

Enter Search Term…

Index

Discovery ServiceFederated Search

FS Engine

Discovery Engine

© 2013 Deep Web Technologies, Inc.

Side-by-Side Comparison

Federated Search Discovery Service

Real-time search brings back most recent results.

Indexed search leads to some lag time for new information. Not always current!

Searches and links to full text where available.

Many publishers only provide metadata so unable to search full text.

Search any collection regardless of publisher and includes all of customer’s subscribed content – leads to efficient searching.

Search only content the Service is able to include in its index – lack of transparency.

Unbiased relevance ranking system is used.

Impartial weighting of results is questionable where service is owned by a major publisher.

© 2013 Deep Web Technologies, Inc.

End of First Segment

© 2013 Deep Web Technologies, Inc. 15

Questions to Ask of Summon, EDS and Other Discovery Services

For each database how far back does For each database how far back does your index go?your index go?

Is EBSCO content such as Cinahl Is EBSCO content such as Cinahl available in Summon?available in Summon?

Are you biasing your results toward Are you biasing your results toward Proquest or EBSCO content?Proquest or EBSCO content?

Do you have a comprehensive list of what’s in the index?Do you have a comprehensive list of what’s in the index?

Which of my subscription databases are you indexing?Which of my subscription databases are you indexing?

How current is your index for my important subscriptions?How current is your index for my important subscriptions?

Do a thorough comparison of coverage and results returned by various discovery solutions.

Do a thorough comparison of coverage and results returned by various discovery solutions.

When are you indexing just metadata vs. full text?When are you indexing just metadata vs. full text?

© 2013 Deep Web Technologies, Inc. 16

Landscape is Not So Clear

• EDS (EBSCO)– Discovery Service + Federated

Search

• Summon (ProQuest)– Discovery Service

• Primo (Ex Libris)– Discovery Service + Federated

Search

• WorldCat Local (OCLC)– Discovery Service + Federated

Search

© 2013 Deep Web Technologies, Inc. 17

Landscape is Clear with Searcher’s Discovery Solution

• Search all the sources and only the sources that you want.

• Sources queried in real-time.• Full-text searched and returned most of

the time.• Easily search user-specified subsets of

sources.• Searcher is vendor neutral.• Detailed statistics package.• Transparency in what is searched

© 2013 Deep Web Technologies, Inc. 18

© 2013 Deep Web Technologies, Inc. 19

Searcher Everywhere! ©

• Access Searcher from OPAC and library website

• Add Searcher widget on Department web pages

• Integrate Searcher with Course Management Systems

• Access/Integrate Searcher and Mendeley• Initiate Searcher searches from Library

Guides• Integrate Searcher and Social Media

(Facebook, Twitter)

© 2013 Deep Web Technologies, Inc. 20

Stanford University xSearch

1. Nanotechnology patents. Nanotechnology – the science of the very small … OECD Library2. Nanotechnology Investment Nanotechnology Investment…The U.S. Remains the world’s… ACS Publications3. Nanotechnology: Small Matters (PDF) The primary objective of this project was to engage… Energy Citations Database

3252

© 2013 Deep Web Technologies, Inc. 21

© 2013 Deep Web Technologies, Inc.

This GuideThis GroupAll GuidesSearchWorksxSearchWeb

© 2013 Deep Web Technologies, Inc. 23

References

• 2011 ALA Presentation: “The Age of Discovery: Understanding Discovery Services, Federated Search and Web Scale.”

• Charleston Advisor review: “Review of Deep Web Technologies Federated Search Service”

• NISO: “Promoting Transparency in Discovery”

• Swets: Taking library back from Google

© 2013 Deep Web Technologies, Inc. 24

Thank you!

Abe Lederman abe@deepwebtech.com

Tolga Bakkaloglu tbakkaloglu@tr.swets.com

Presentation located here: http://www.deepwebtech.com/wp-content/uploads/A

NKOS-SWETS.2013-Presentation2.ppt