Searching the InternetSearching the Internet

Our Quest for Knowledge in Our Quest for Knowledge in SpaceSpace

04/22/2304/22/23

Internet Search ToolsInternet Search Tools

Directories (Collections)Directories (Collections) Search EnginesSearch Engines Meta-Search EnginesMeta-Search Engines Invisible Web GatewaysInvisible Web Gateways PortalsPortals Asking “Experts”Asking “Experts”

04/22/2304/22/23

DirectoriesDirectories

04/22/2304/22/23

Directory CharacteristicsDirectory Characteristics

Organizes resources Organizes resources into logical subject into logical subject groups groups

Simple group Simple group headings so the user headings so the user can “drill down” to can “drill down” to locate sub-divisions of locate sub-divisions of information and sitesinformation and sites

Humans are involved Humans are involved in the creation of the in the creation of the DirectoryDirectory

04/22/2304/22/23

YahooYahoo

Yahoo is an example of a Web Site that is both a Yahoo is an example of a Web Site that is both a Directory and a Search EngineDirectory and a Search Engine

It is like an enormous yellow pages phone bookIt is like an enormous yellow pages phone book Yahoo is an excellent place to start – particularly Yahoo is an excellent place to start – particularly

if you are looking for information about specific if you are looking for information about specific organizations or specific topicsorganizations or specific topics

Yahoo is not, however, a complete collection of Yahoo is not, however, a complete collection of Internet resources – not every organization or Internet resources – not every organization or everyone is listedeveryone is listed

04/22/2304/22/23

California State PageCalifornia State Page

Designed to help meet the basic Designed to help meet the basic information access for all citizens of information access for all citizens of California.California. Census dataCensus data Links to many high quality health resourcesLinks to many high quality health resources Gateway to Federal as well as State Gateway to Federal as well as State

informationinformation One of the best Internet starting points for One of the best Internet starting points for

California informationCalifornia information

04/22/2304/22/23

Librarians’ Index to the InternetLibrarians’ Index to the Internet

The Librarians’ Index to the Internet is a The Librarians’ Index to the Internet is a searchable, annotated subject directory of searchable, annotated subject directory of Internet resources selected and evaluated by Internet resources selected and evaluated by librarians for their usefulness to Library users.librarians for their usefulness to Library users.

It is meant to be used by both librarians and It is meant to be used by both librarians and non-librarians as a reliable and efficient guide to non-librarians as a reliable and efficient guide to described and evaluated Internet resources.described and evaluated Internet resources.

This is an excellent collection of reviewed and This is an excellent collection of reviewed and evaluated resources.evaluated resources.

04/22/2304/22/23

Search EnginesSearch Engines

CharacteristicsCharacteristics ConsiderationsConsiderations Strategy DevelopmentStrategy Development Refining TechniquesRefining Techniques ExamplesExamples

04/22/2304/22/23

Search Engine CharacteristicsSearch Engine Characteristics

Searches by keyword Searches by keyword Creates web site databases by searching Creates web site databases by searching

the web by robots and computer programsthe web by robots and computer programs Economic criteria can determine a place in Economic criteria can determine a place in

the search resultsthe search results Although there are similarities, no two Although there are similarities, no two

Search Engines are exactly the same Search Engines are exactly the same (Kmart v. Wal-Mart)(Kmart v. Wal-Mart)

04/22/2304/22/23

You Need More than A Search You Need More than A Search EngineEngine

Not all of the Internet is indexedNot all of the Internet is indexed You should expect to miss information You should expect to miss information

which is on the Internetwhich is on the Internet Current information is often not available Current information is often not available

through a search enginethrough a search engine Many Web Pages are restricted or fee-Many Web Pages are restricted or fee-

onlyonly

04/22/2304/22/23

Searching StrategySearching Strategy

Be specific. The keywords that best Be specific. The keywords that best describe what you are looking for are the describe what you are looking for are the way to startway to start

Scan the results of your search for clues Scan the results of your search for clues (even poor results can give you clues)(even poor results can give you clues) How would rephrasing your search change How would rephrasing your search change

the results?the results? Is there anything usable in the results?Is there anything usable in the results?

Fifteen-Minute TestFifteen-Minute Test: Know when to give up: Know when to give up

04/22/2304/22/23

Typing Your SearchTyping Your Search

If you are looking for a two-word name, force the Search If you are looking for a two-word name, force the Search Engine to treat the item as a phraseEngine to treat the item as a phrase When you enclose the words in quotes the Engine will look for When you enclose the words in quotes the Engine will look for

the words next to each otherthe words next to each other If your search consistently produces the same poor If your search consistently produces the same poor

results, exclude words to narrow your results.results, exclude words to narrow your results. Use the plus sign (+) to require a word and the minus sign (-) to Use the plus sign (+) to require a word and the minus sign (-) to

exclude a wordexclude a word Host Limiting Host Limiting

If you are looking for government information, limit your results If you are looking for government information, limit your results to only government sitesto only government sites

Type Type host:govhost:gov in your search to limit the results to only sites in your search to limit the results to only sites containing containing .gov.gov in their address in their address

04/22/2304/22/23

GoogleGoogle

Google is “the” search toolGoogle is “the” search tool Very easy to use – Simple formatVery easy to use – Simple format Results are often close to the desired Results are often close to the desired

resultsresults Although, the quality of the information is Although, the quality of the information is

not guaranteednot guaranteed Most effective when the search term is Most effective when the search term is

kept simplekept simple

GoogleGoogleGoogleGoogle

04/22/2304/22/23

Virtual Reference LibrariesVirtual Reference Libraries

University of California at Berkeley - University of California at Berkeley - Reference page with links to University libraries, Reference page with links to University libraries, collections, electronic databases and academic collections, electronic databases and academic disciplinesdisciplines

Internet Public Library Internet Public Library - Replicates a library - Replicates a library reference room "without walls" on the Internet. reference room "without walls" on the Internet. Contains links to reference materials covering Contains links to reference materials covering computers, law, science, entertainment and computers, law, science, entertainment and educationeducation

iTools iTools - Basic reference tools such as - Basic reference tools such as dictionaries and word lookups, as well as dictionaries and word lookups, as well as language translatorslanguage translators

04/22/2304/22/23

Meta Search EnginesMeta Search Engines

All searches are sent to several search engines All searches are sent to several search engines or directories at the same timeor directories at the same time

Results from different tools are displayed on one Results from different tools are displayed on one page. page.

Not all of the Internet is indexed, you should Not all of the Internet is indexed, you should expect some misinformationexpect some misinformation

You cannot use advanced features from specific You cannot use advanced features from specific search engines, since those features may not be search engines, since those features may not be supported by the meta-index toolssupported by the meta-index tools

04/22/2304/22/23

Meta-Index ExamplesMeta-Index Examples

MetaCrawlerMetaCrawler – An excellent searching tool that – An excellent searching tool that allows you to search many of the major search allows you to search many of the major search tools at once. Particularly useful tools at once. Particularly useful Power SearchPower Search tab that allows you to pick and choose which tab that allows you to pick and choose which tools are searchedtools are searched

DogPileDogPile – Customizable meta-index – Customizable meta-index RefDeskRefDesk – Unbelievable resource for everything – Unbelievable resource for everything

InternetInternet Langenberg.ComLangenberg.Com – Simple collection of search – Simple collection of search

boxes to different resourcesboxes to different resources

04/22/2304/22/23

Invisible Web (The Deep Web)Invisible Web (The Deep Web)

Regardless of which tools you use, there Regardless of which tools you use, there will always be information you will be will always be information you will be missing missing

This data is referred to as the Invisible This data is referred to as the Invisible Web, since it is often invisible to most Web, since it is often invisible to most search toolssearch tools

That doesn’t mean that you can’t find That doesn’t mean that you can’t find information on the Invisible Web, it means information on the Invisible Web, it means that you might have to use different toolsthat you might have to use different tools

04/22/2304/22/23

Invisible Web ConsiderationsInvisible Web Considerations

Information is often overlooked by traditional Information is often overlooked by traditional search tools for two basic reasons:search tools for two basic reasons: Internet Directories, Search Engines and Meta-Internet Directories, Search Engines and Meta-

Search Engines do not gather information from every Search Engines do not gather information from every page available on every web site. page available on every web site.

Information in databases (such as library catalogs) Information in databases (such as library catalogs) are not available through search engines. are not available through search engines.

Search engines succeed by gathering documents, but Search engines succeed by gathering documents, but with databases, there are no documents to gatherwith databases, there are no documents to gather

As more web sites use databases to store As more web sites use databases to store information, the amount of information available information, the amount of information available through traditional search tools will become less and through traditional search tools will become less and less useful. less useful.

04/22/2304/22/23

Invisible Web StrategyInvisible Web Strategy

Finding information on the Invisible Web is not Finding information on the Invisible Web is not an easy task, but it may be the only way to find an easy task, but it may be the only way to find the information that you needthe information that you need

Many Internet searchers give up when they do Many Internet searchers give up when they do not find information using a basic Search Enginenot find information using a basic Search Engine

Before giving up, you should try some Invisible Before giving up, you should try some Invisible Web search toolsWeb search tools

Using Invisible Web tools is a two-step process:Using Invisible Web tools is a two-step process: Perform a Subject Search to find an appropriate site Perform a Subject Search to find an appropriate site

(or sites)(or sites) Perform a search of the site that looks like it will be Perform a search of the site that looks like it will be

responsive to your needsresponsive to your needs

04/22/2304/22/23

Access to Invisible DatabasesAccess to Invisible Databases

VivisimoVivisimo – Document clustering – Document clustering Complete PlanetComplete Planet - - Collection of searchable Collection of searchable

databasesdatabases InfoMineInfoMine – A collection created by – A collection created by

librarians. The sites are well-catalogued librarians. The sites are well-catalogued and allow expanding searches based on and allow expanding searches based on related subjects and keywordsrelated subjects and keywords

FreealityFreeality Internet Search Internet Search - Popular - Popular databases databases

04/22/2304/22/23

PortalsPortals

Portals are communities of Web Sites organized Portals are communities of Web Sites organized around similar interestsaround similar interests

Suite 101.comSuite 101.com - built by over 1,000 volunteer - built by over 1,000 volunteer “experts.” offers distractions like chat and “experts.” offers distractions like chat and friendly, popular information as well as the friendly, popular information as well as the seriousserious

Portals Community Portals Community - - A portal of portalsA portal of portals FAST SearchFAST Search – (a/k/a AlltheWeb) Currently – (a/k/a AlltheWeb) Currently

includes more than 200 million unique URLs in includes more than 200 million unique URLs in its databaseits database

04/22/2304/22/23

ExpertsExperts

About.comAbout.com is a site of self-appointed experts in is a site of self-appointed experts in specialized areas. specialized areas.

The experts create lists of sites and current The experts create lists of sites and current events about that topic areaevents about that topic area

The site can be helpful if you are interested in The site can be helpful if you are interested in delving into a particular topic with some depthdelving into a particular topic with some depth

AllExperts.comAllExperts.com - Experts who volunteer to - Experts who volunteer to provide free answers to your individual provide free answers to your individual questionsquestions

04/22/2304/22/23

Who Owns The Site?Who Owns The Site?

After you have found information on the Internet, After you have found information on the Internet, it becomes important to know the sourceit becomes important to know the source

Sometimes it is obvious – and, sometimes it is Sometimes it is obvious – and, sometimes it is not at all obviousnot at all obvious

When all else fails, look up the web site owner, When all else fails, look up the web site owner, and if necessary contact that company to verify and if necessary contact that company to verify the source of the informationthe source of the information

There is only one site to use for this, and that is -There is only one site to use for this, and that is -

04/22/2304/22/23

Network SolutionsNetwork Solutions

Every .com/.net/.org web site is registered Every .com/.net/.org web site is registered with Network Solutionswith Network Solutions

To find the name of the owner of a specific To find the name of the owner of a specific site, use Network Solutions’ site, use Network Solutions’ WHOIS WHOIS LookupLookup Service. Service.

Using Using WHOIS WHOIS allows you to type in a web allows you to type in a web address and retrieve basic contact address and retrieve basic contact information about the owner of that information about the owner of that domain namedomain name

04/22/2304/22/23

Search Tool ChangesSearch Tool Changes

Search Engine WatchSearch Engine Watch – Search tools are – Search tools are constantly changing. Search Engine Watch constantly changing. Search Engine Watch keeps track of those changes, both in terms of keeps track of those changes, both in terms of changing names as well as newly implemented changing names as well as newly implemented features. features. Subscribing to the email newsletter will keep you Subscribing to the email newsletter will keep you

informed of the latest hints, tips, features and informed of the latest hints, tips, features and existence of search toolsexistence of search tools

LII New This Week Mailing ListLII New This Week Mailing List – A weekly – A weekly email newsletter listing recently-evaluated and email newsletter listing recently-evaluated and interesting new web sitesinteresting new web sites

04/22/2304/22/23

Site ChangesSite Changes

Search Engine ShowdownSearch Engine Showdown - compilation of - compilation of studies, reports and news compiled by Greg studies, reports and news compiled by Greg NotessNotess

The BotspotThe Botspot - Focus on Artificial Intelligence. - Focus on Artificial Intelligence. “Bots" - multi-purpose, multi-site, multi-resource, “Bots" - multi-purpose, multi-site, multi-resource, and interactive tools for locating information and interactive tools for locating information about the Web, advanced Web programming, about the Web, advanced Web programming, and Web searching. and Web searching. Browse "Bots by Category" or read "Browse "Bots by Category" or read "What's a botWhat's a bot?" ?"

The FutureThe Future

Our Quest for Knowledge in Space Our Quest for Knowledge in Space Continues…Continues…