Enabling Information Discovery by Unifying Search and Data ManagementAmir Halfon, CTOGlobal Financial Services
Slide 2
Some Recent History
1994: First full text web search engines become available
1998: Google is founded 2003-2004: GFS, MapReduce and BigTable
whitepapers 1999-2005: Lucene, Nutch and Hadoop
Slide 3
Some Not So Recent History
1960s: Navigational and hierarchical databases (IMS, IDMS)
1970s: Edgar Codd introduces the relational database model; System R, INGRESS, and Oracle follow
1980s: Object databases and ORM tools 2000s: NoSQL databases
Slide 4
What if the Two Shall Meet?
SEARCHDATABASE
Slide 5
Schema-Agnostic, Hierarchical Data Model
TradeCashflows
PaymentDate
NetPayment
PayerParty Receive
rParty
Payment
Amount
tradeId
PartyIdentifie
r
PartyReferenc
e
currency
amount
Slide 6
Vs. the Relational Approach
Slide 7
Universal Index
Words and phrases... Semantic Web is a collaborative movement led by the World Wide Web Consortium (W3C) ...
Structure Label
Author Ing
Comp
ID Para
Org
Valuesname:sorbitoldate:2012-06-04company:Roche
Entities and positions... ACE inhibitors, since the risk of lithium toxicity is very high in such patients...
Geospatial<location> <lat>46.946584</lat> <lng>93.076172</lng></location>
Universal Index
Slide 8
Word txt
Use Case: 360 Degree Customer View
UNIFIED DATA
SEARCH
Load and index data “as is”
On-boarding docs, call center logs
PersonalConnections
CardsDDA Mortgages
Slide 9
Use Case: Fraud Prevention
Analytics
Profile Configuration
Profile Data Extracted from Claims
Provider and beneficiary profiles
Slide 10
Use Case: Regulatory Reporting
AUTOMATED LINKAGE
SEARCH; WORKLIST
Word
Pre-Trade Communication
s
TradeData
ReferenceData
Slide 11
What’s Next?
Semantic technology Even more power – graph traversal,
inference