+ All Categories
Home > Documents > DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors:...

DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors:...

Date post: 05-Feb-2018
Category:
Upload: dodieu
View: 222 times
Download: 2 times
Share this document with a friend
22
1 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Oracle NoSQL Database Overview Marie-Anne Neimat, VP Development June14, 2012
Transcript
Page 1: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

1 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

Oracle NoSQL Database OverviewMarie-Anne Neimat, VP Development

June14, 2012

Page 2: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Agenda

• Big Data Overview

• Oracle NoSQL Database

• Architecture

• Technical Overview

• Benchmark Results

2 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

• Benchmark Results

• Usage scenarios

Page 3: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

What is Big Data ?

GEODATA

TEXT

3 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

VOLUME VELOCITY VARIETY VALUE

SENSOR

DATA

Page 4: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Big Data Lifecycle

MakeBetter Decisions

DECIDE ACQUIRE

4 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

DecisionsUsingBig Data

ANALYZE ORGANIZE

Page 5: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Big Data Lifecycle

MakeBetter Decisions

DECIDE ACQUIRE

O

Oracle

NoSQL Database

Exalytics &

TimesTen IMDB

5 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

DecisionsUsingBig Data

ANALYZE ORGANIZE

Page 6: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Big Data Use Cases

Today’s Challenge New Data What’s Possible

Healthcare

Expensive office visitsRemote patient monitoring

Preventive care, reduced

hospitalization

Manufacturing

In-person supportProduct sensors Automated diagnosis, support

6 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

Location-Based Services

Based on home zip codeReal time location data

Geo-advertising, traffic, local

search

Utilities

Complex Distribution Grid

Detailed consumption

statistics

Increased availability,

reduced cost, tiered metering

plans

Retail

One size fits all marketingSocial media

Sentiment analysis

segmentation

Page 7: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Why is Big Data important?

US HEALTH CARE US RETAIL MANUFACTURING GLOBAL PERSONAL

LOCATION DATA

EUROPE PUBLIC

SECTOR ADMIN

$300 B 60+% –50% $100 B €250 B

Increase industry

value per year by

Increase net margin

by

Decrease dev.,

assembly costs by

Increase service provider

revenue by

Increase industry

value per year by

7 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

“In a big data world, a competitor that fails to sufficiently

develop its capabilities will be left behind.”

Source: * McKinsey Global Institute: Big Data – The next frontier for innovation, competition and productivity (May 2011)

Page 8: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Oracle NoSQL Database for realtime

data management

Hadoop Distributed File

System (HDFS)Oracle NoSQL Database

File System Database

Parallel scanning Indexed storage

8 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

Parallel scanning Indexed storage

No inherent structure Simple data structure

Bulk writesHigh volume random reads

and writes

Batch Oriented Real-Time

Page 9: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Agenda

• Big Data Overview

• Oracle NoSQL Database

• Architecture

• Technical Overview

• Benchmark Results

9 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

• Benchmark Results

Page 10: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Oracle NoSQL Database Use Cases

SIMPLE QUERIES

DYNAMIC SCHEMA

Customer profile management

Social networks

Personalization

Click-through data processing

10 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

DYNAMIC SCHEMA

HIGH VOLUME DATA

High-throughput event processing

Sensor & statistics data capture

Authentication & Content management

Mobile application backend infrastructure

Archiving

Page 11: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Example: On-line Ads and Content

Scenario

• User clicks on a web page

• Cookie used to look up user profile

• Store new profile if required

• User profile sent to expert system

• Appropriate ad placed on page

11 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

Important Attributes

• Fast response time and high throughput

• High availability and scalability

• Flexible data model

Goal: Optimize Internet Advertising to Increase RevenuesGoal: Optimize Internet Advertising to Increase Revenues

Ad to be

Displayed

Expert

SystemNoSQL

DB

Look Up

User Profile

Page 12: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Customer-Driven Requirements

• Terabytes to petabytes of unstructured or semi-structured data

• No single point of failure

• Cost effective, distributed storage

• Scalable on commodity hardware

• Fast, predictable response to simple queries

12 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

• Fast, predictable response to simple queries

• Fast, reliable transactions

• Simple administration, enterprise support

• Commercial-grade NoSQL solution

• Real 24x7 support

• Real database expertise

• Large vendor & dedicated resources building & testing the software

Page 13: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Oracle NoSQL Database A Distributed, Scalable Key-Value Database

Simple Data Model

Small, distributed footprint

Highly scalable, available

Application

NoSQLDatabase

Driver

Application

NoSQLDatabase

Driver

13 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

Highly scalable, available

Transparent load balancing

Integrates with Oracle Stack

Storage NodesDatacenter B

Storage NodesDatacenter A

Page 14: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Architecture Summary

• Scalability• Dynamic data partitioning and distribution

• Optimized data access via intelligent driver

• High availability• One or more replicas

• Resilient to partition master failures

14 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

• Resilient to partition master failures

• No single point of failure

• Disaster recovery through location of replicas

• Transparent load balancing• Reads from master or replicas

• Driver is network topology & latency aware

• Optimized for high throughput and low latency

Page 15: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Simple Data Model

• Simple data model – key-value pair (major+minor-key paradigm)

• Simple operations – read/insert/update/delete, RMW support

• Scope of transaction – records within a major key, single API call

• Unordered scan of all data (non-transactional)

15 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

userid

addresssubscriptions

email idphone #expiration date

Major key:

Minor key:

Value:

Strings

Byte Array �

Page 16: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Simple Data ModelACID Transactions

• ACID transactions by default

• Transaction Scope

• Single API call

16 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

• Single API call

• All records must have the same major key

• Support for multiple operations within a transaction

• Can be relaxed for increased performance on a

per-operation basis

Page 17: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Simple Data Model

ACID Transactions – Configurability

• Configurable Durability Policy

17 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

• Configurable Consistency Policy

Page 18: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Simple Administration

• Web-based console and

CLI commands

• Manages and Monitors

• Topology

• Configuration changes

• Load: Number of operations,

18 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

• Load: Number of operations,

data size

• Performance: Latency, throughput. Min, max,

average, trailing, …

• Events: Failover, recovery, load distribution

• Alerts: Failure, poor performance, …

Page 19: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Oracle NoSQL Database Differentiation

Commercial Grade

Software and Support Simple Data ModelSimple

Administration

• General Purpose • Simple Major + •Web-based Console

Scalability and

Availability

• Intelligent Oracle

Integrates seamlessly with Oracle Stack (ODI, CEP, OLH)

19 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

• General Purpose

• Reliable – Based

on proven Berkeley

DB JE HA

• Easy to Install &

Configure

• Simple Major +

Minor key and Value

data structure

• ACID transactions

• Configurable

consistency and

durability

•Web-based Console

and CLI commands

• Manages and Monitors: • Topology

• Load

• Performance

• Events

• Alerts

• Intelligent Oracle

NoSQL DB Driver• Evenly distributes Data

• Sends operation to

fastest node

• Bounded network hops

for all operations

• Automatic replication

and failover

Page 20: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Benchmarking Results @ Cisco

• 1.6 billion records

• 94K insert/sec

20 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

• 25K read/update/sec

• Low latency

• Linear scalability

Page 21: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

Oracle NoSQL Database

�Easy to use, easy to manage

�Scalable, Available, Predictable Latency

21 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.

�A NoSQL Database from a vendor you trust

Page 22: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data

22 Copyright © 2012, Oracle and/or its affiliates. All rights

reserved.


Recommended