The Gears that make the search go round

#SPSBE19Rick Van RousseltApril 26th, 2014

Thanks to our sponsors!

Gold

Silver

About me

- HPW Consultant @ RealDolmen

- @RickVanRousselt

- www.rickvanrousselt.com

- About me

- Introduction

- Architecture

- Components

Agenda

SharePoint 2013

SharePoint 2010

SharePoint 2010 with FAST

SharePoint 2013

HTTPFile sharesSharePointUser profilesLotus Notes DocumentumExchange foldersCustom - BCS

SharePointSP AppsDevicesNon-SP UX

SearchAdmin

Content UXCrawl

ContentProcessing Index

QueryProcessing WFE

API

AnalyticsProcessing

FAST Search Index

Public API

Unit of scale/role boundary

Feeding Chain Index Core

Query Chain

Analytics Service

Crawl Component

Crawl Component

Crawl Component: What does it do? Invokes Connectors/Protocol Handlers to content sources to retrieve data

Crawling is done via a single SharePoint Search SSA

Crawl Database is used to store information about crawled items and to track crawl history

Crawl modes:  Incremental, Full and Continuous

Crawl Component: What’s new A single Search SSA FAST Web Crawler no longer exists Improved Crawl Reporting/Analytics Communicates with all crawl databases No longer responible for parsing and extracting document properties

Content sources

Default:- Web sites - File shares- SharePoint- Exchange- Lotus Notes- Documentum

Custom: BCS Custom Repository

Crawl extension

Demo

Content Processing Component

Content Processing Component

Content Processing Component: What does it do?

Stateless node Analyzes content for indexing Enriches content as needed via Content Enrichment Web Service (web service callout)

Schema mapping.  Produces managed properties from crawled properties

Stores links and anchors in Link database(analytics)

Content Submission Service

Demo

Index Component

Index Component

Index Component: What does it do?

Heart of the search engine Receives processed content from CPC Resides on index partition Searchable via Query Processing Component

Index Component: What’s new No more Fast Index XML => partial update Instant indexing Journaling Update Groups/partial update mechanism No more interaction with the database

Query Processing Component

Query Processing Component

Query Processing Component: What does it do?

Takes query - optimises it - and submits it to indexing component

Result sets are returned Processes the result set and sends it to the front-end

Uses processing flows

Query Processing Component: What’s new

No longer retrieves properties from property store

Not checking the admin database for security trimming

Query Execution flow

WFE

Query Processing Component

Index

Index

IndexP0

Index

Index

IndexP1

Index

Index

IndexP2

Index

Index

IndexP3

Search Provider Flows

Best Bets

Exchange Search

People Search

Personal Favorites

Remote SharePoint

Local SharePoint

Keyw

ord

Query

FlowInput

QueryRuleMatching

QueryTransformer

QueryRouter

FlowOutput

ResultTableAssembler

LayoutSelector

Demo

Analytics Processing Component

Analytics Processing Component

Crawl

ContentProcessing Index

QueryProcessing WFE

API

AnalyticsProcessing

FAST Search Index

Link

Analytics Reporting

Event Stream

Analytics Processing Component:

What does it do? Learns by usage Search Analytics Usage Analytics Enriches index by updating index items Usage reports in Analytics database

Thank you!

Questions?