Enabling Information Discovery by Unifying Search and Data ManagementAmir Halfon, CTOGlobal Financial Services

Slide 2

Some Recent History

1994: First full text web search engines become available

1998: Google is founded 2003-2004: GFS, MapReduce and BigTable

whitepapers 1999-2005: Lucene, Nutch and Hadoop

Slide 3

Some Not So Recent History

1960s: Navigational and hierarchical databases (IMS, IDMS)

1970s: Edgar Codd introduces the relational database model; System R, INGRESS, and Oracle follow

1980s: Object databases and ORM tools 2000s: NoSQL databases

Slide 4

What if the Two Shall Meet?

SEARCHDATABASE

Slide 5

Schema-Agnostic, Hierarchical Data Model

TradeCashflows

PaymentDate

NetPayment

PayerParty Receive

rParty

Payment

Amount

tradeId

PartyIdentifie

r

PartyReferenc

e

currency

amount

Slide 6

Vs. the Relational Approach

Slide 7

Universal Index

Words and phrases... Semantic Web is a collaborative movement led by the World Wide Web Consortium (W3C) ...

Structure Label

Author Ing

Comp

ID Para

Org

Valuesname:sorbitoldate:2012-06-04company:Roche

Entities and positions... ACE inhibitors, since the risk of lithium toxicity is very high in such patients...

Geospatial<location> <lat>46.946584</lat> <lng>93.076172</lng></location>

Universal Index

Slide 8

PDF

Word txt

Use Case: 360 Degree Customer View

UNIFIED DATA

SEARCH

Load and index data “as is”

On-boarding docs, call center logs

PersonalConnections

CardsDDA Mortgages

Slide 9

Use Case: Fraud Prevention

Analytics

Profile Configuration

Profile Data Extracted from Claims

Provider and beneficiary profiles

Slide 10

Use Case: Regulatory Reporting

AUTOMATED LINKAGE

SEARCH; WORKLIST

PDF

Word

Pre-Trade Communication

s

TradeData

ReferenceData

Slide 11

What’s Next?

Semantic technology Even more power – graph traversal,

inference

Slide 12

Amir Halfon

amir.halfon@marklogic.com

Questions?