+ All Categories
Home > Technology > Mega trends in information management

Mega trends in information management

Date post: 20-Aug-2015
Category:
Upload: guy-harrison
View: 421 times
Download: 0 times
Share this document with a friend
123
1 Software Group Confidential 752: Mega trends in database and information management a.k.a. Dell Software Information Management – evolving to meet your data requirements Guy Harrison Executive Director, R&D Information Management
Transcript
Page 1: Mega trends in information management

1 Software GroupConfidential

752: Mega trends in database and information management  

a.k.a. Dell Software Information Management – evolving to meet your data requirementsGuy HarrisonExecutive Director, R&D Information Management

Page 2: Mega trends in information management

2 Software GroupConfidential

Page 3: Mega trends in information management

3 Software GroupConfidential

Page 4: Mega trends in information management

4 Software GroupConfidential

Page 5: Mega trends in information management

5 Software GroupConfidential

Page 6: Mega trends in information management
Page 7: Mega trends in information management

7 Software Group

Page 8: Mega trends in information management

Dell Research Division

Mobility and Internet of Things

6. BYOD is changing from “secure the device” to “make it easy for me to use my device”

7. Internet of things. Opportunity for management, coordination and security of devices, opportunity for servers outside the data center

8. Wearable computing as next potential platform

Modern IT and Application Infrastructure

1. By 2018, majority of apps delivered as services, majority of data will be in cloud

2. Software defined data center – disrupts the network and storage leaders and allows the server leader to win with software on servers

3. Telco networks will transform to software on servers or as virtual appliances in cloud

4. App development moving to composite apps –stitching of existing SaaS and PaaS components

Security

9. New usage paradigms in a connected world needs new kinds of security – Dell opportunity is to develop end-to-end security across our products

10. Using analytics to detect abnormal user and application behavior – big opportunity for Dell to drive security analytics leadership

Dell Technology Outlook

8

Big Data and Data Analytics

5. Most industries will integrate “Big data” analytics into business processes to maintain competitive edge. Dell can be the enabler for the SMB through provision of infrastructure, analytic solutions and data.

Source: IDC, Gartner, Forrester, Everest Group, Company web sites, Dell internal.

8

Page 9: Mega trends in information management

9 Software GroupConfidential

Industry Mega-Trends

Mobility Cloud

Social BigData

Page 10: Mega trends in information management

10 Software GroupConfidential

Mobility

• Quad-core 1.4 GHz CPU

• 2GB RAM

• 32GB SSD

• 1080p display

• LTE/Bluetooth/WiFi

• 16MP & 2MP Camera

• GPS & Compass

Page 11: Mega trends in information management

11 Software Group

Page 12: Mega trends in information management

12 Software Group

Page 13: Mega trends in information management

13 Software Group

Page 14: Mega trends in information management

14 Software Group

Page 15: Mega trends in information management

15 Software Group

Page 16: Mega trends in information management

16 Software Group

Page 17: Mega trends in information management

17 Software Group

Page 18: Mega trends in information management

18 Software Group

Page 19: Mega trends in information management

19 Software Group

Page 20: Mega trends in information management

20 Software Group

Page 21: Mega trends in information management

21 Software Group

Page 22: Mega trends in information management

22 Software Group

Page 23: Mega trends in information management

23 Software Group

Page 24: Mega trends in information management

24 Software Group

Page 25: Mega trends in information management

25 Software Group

Data Input

Page 26: Mega trends in information management

26 Software Group

Page 27: Mega trends in information management

Siri

From now on, I’ll call you ‘An Ambulance’. OK?

“Siri call me an ambulance”

I found 14 bridges nearby:

“I want to jump off a bridge”

Page 28: Mega trends in information management

28 Software Group

Page 29: Mega trends in information management

29 Software Group

Page 30: Mega trends in information management

30 Software Group

Brain Control

Page 31: Mega trends in information management

31 Software Group

Page 32: Mega trends in information management

32 Software Group

Page 33: Mega trends in information management

33 Software Group

Muze

Page 34: Mega trends in information management

34 Software Group

Page 35: Mega trends in information management

35 Software Group

Page 36: Mega trends in information management

36 Software Group

The instrumented human

• Bluetooth Personal Area Network

• 3G/WiFi Wide Area Network

• GPS• Storage

• Pulse, temp monitor

• Silent alarms• Pedometer, sleep

monitoring

• Compass • Camera• Mike/earphones• Heads up display• Emotion/Attention

monitor

Page 37: Mega trends in information management

37 Software Group

Cloud and Internet of Things

Page 38: Mega trends in information management

38 Software Group

Page 39: Mega trends in information management

39 Software Group

Page 40: Mega trends in information management

40 Software Group

Page 41: Mega trends in information management

41 Software Group

Page 42: Mega trends in information management

42 Software Group

Internet of Things

Market Drivers• Declining device and sensor

costs

• Broad availability of network connectivity and CPU power for analytics

• Consumer Electronics (nest, etc)

• Regulations – e.g. Positive Train Control by 2015

• Surveillance Society

Page 43: Mega trends in information management

43 Software Group

Social

Page 44: Mega trends in information management

44 Software Group

“Social media create a revolution in communications and will define society’s evolution”

I need to pee

I peed

This is where I pee

Look at me peeing

Why do I pee?

I am good at peeing

Page 45: Mega trends in information management

45 Software Group

The culmination of cloud, social and mobile

Page 46: Mega trends in information management

46 Software Group

Will Big Data kill retail?

Page 47: Mega trends in information management

47 Software Group

Prevalence of Showrooming

Consumer Electronics

Home Improvement

0 10 20 30 40 50 60 70

Pct

Garter Research G00249458Survey Analysis: Focus on Customer Basics to Challenge Amazon, as 'Showrooming' Is Universal but Not UnbeatablePublished: 12 February 2013

Page 48: Mega trends in information management

48 Software Group

Some novel defences

Page 49: Mega trends in information management

49 Software Group

Battling showrooming

Selection

Stock

Faster

Cheaper

Dynamic Pricing

Predictive ordering

Assortment optimization

Predictive recommendations

Personalization

Page 50: Mega trends in information management

50 Software Group

Data and algorithms are the key to retain survival in the Big Data era

• Online has significant advantages

• Retailers can only survive by embracing online and emulating online practices– Dynamic pricing– Shelf optimization– Personalized service and selection

• Only big data analytics can provide these advantages

Page 51: Mega trends in information management

51 Software Group

There’s a similar story in every industry Web

Transport

Power Grid

Dating

Retail

Security

FinanceGovernment

Science

Healthcare

Insurance

Telecom

Advertising

Page 52: Mega trends in information management

52 Software Group

Generating competitive advantage through “Big Data analytics” Machine

LearningPrograms that evolve with “experience”

Collective IntelligencePrograms that use inputs from “crowds’ to seem intelligent

Predictive AnalyticsPrograms that extrapolate from existing data into the future

Big Data AnalyticsAKA Data Science

Page 53: Mega trends in information management

53 Software Group

Collective Intelligence

Page 54: Mega trends in information management

54 Software Group

Page 55: Mega trends in information management

55 Software Group

Page 56: Mega trends in information management

56 Software Group

Page 57: Mega trends in information management

57 Software Group

Page 58: Mega trends in information management

58 Software Group

Page 59: Mega trends in information management

59 Software Group

Page 60: Mega trends in information management

60 Software Group

Page 61: Mega trends in information management

61 Software Group

Page 62: Mega trends in information management

62 Software Group

Google Flu Trends

Page 63: Mega trends in information management

63 Software Group

Page 64: Mega trends in information management

64 Software Group

Collective Intelligence outsmarts Artificial Intelligence?

Page 65: Mega trends in information management

65 Software Group

Page 66: Mega trends in information management

66 Software Group

Page 67: Mega trends in information management

67 Software Group

Page 68: Mega trends in information management

68 Software Group

Page 69: Mega trends in information management

69 Software Group

Artificial Intelligence Strikes back

Page 70: Mega trends in information management

70 Software Group

Page 71: Mega trends in information management

71 Software Group

Page 72: Mega trends in information management

72 Software Group

Page 73: Mega trends in information management

73 Software Group

Page 74: Mega trends in information management

74 Software Group

Watson is big data AI – and was built on Hadoop

Page 75: Mega trends in information management

75 Software Group

Hadoop

Page 76: Mega trends in information management

76 Software Group

Pioneers of Big Data

Page 77: Mega trends in information management

77 Software Group

Page 78: Mega trends in information management

78 Software Group

Page 79: Mega trends in information management

79 Software Group

Page 80: Mega trends in information management

80 Software Group

Page 81: Mega trends in information management

81 Software Group

Page 82: Mega trends in information management

82 Software Group

Hadoop: Open Source Map-Reduce Stack

Page 83: Mega trends in information management

83 Software Group

Hadoop at Yahoo

Yahoo! Hadoop cluster:

• 4000 nodes• 16PB disk• 64 TB of RAM• 32,000 Cores

Page 84: Mega trends in information management

84 Software Group

Economies

Exadata

Hadoop

$0 $1,000 $2,000 $3,000 $4,000 $5,000 $6,000

$4,911

$750

Exadata vs Hadoop $$/TB (Hardware only)

Page 85: Mega trends in information management

85 Software Group

Schema on Read vs Schema on Write

Data

Analyse

Aggregate

Normalize

Cleanse

Code

ExtractLoad Transform Data

Warehouse

Data LoadHadoop

Analyse

Cleanse

Code

Utilize

Schema on Write

Schema on Read

Utilize

Page 86: Mega trends in information management

86 Software Group

Generating competitive advantage through “Big Data analytics” Machine

LearningPrograms that evolve with “experience”

Collective IntelligencePrograms that use inputs from “crowds’ to seem intelligent

Predictive AnalyticsPrograms that extrapolate from existing data into the future

Big Data AnalyticsAKA Data Science

Page 87: Mega trends in information management

87 Software Group

Predictive Analytics

0 20 40 60 80 100 120

-20

0

20

40

60

80

100

120

f(x) = 0.971521231456065 x + 0.71906459527154

• Linear regression• Non-linear (curve fit)• Multivariate• Time series• Logistical Regression• CART

Page 88: Mega trends in information management

88 Software Group

Classification• Create a model that

identifies/classifies new data

• Spam detection, churn risk, customer value

Page 89: Mega trends in information management

89 Software Group

Clustering• Group data without a

pre-existing classification scheme

• For instance, basket analysis

Page 90: Mega trends in information management

90 Software Group

SupervisedMachine Learning

Raw Data Clean

Validate

Model

Candidate

ModelTraining Set

Validation Set

Production

ModelNew Data

New Business

Existing Business

Prediction

Page 91: Mega trends in information management

91 Software Group

Inmaps.linkedin.com

Unsupervised learning

Page 92: Mega trends in information management

92 Software Group

Page 93: Mega trends in information management

93 Software Group

Big Data Analytics

Data Science

Search Optimization

Recommendation Systems

Security•Vulnerability•Penetration Detection

Fraud Detection

CRM•Churn •Defaults

Medical•Risk analysis•Diagnosis•Prognosis

Game optimization

Advertising•Targeting•Tailoring

Page 94: Mega trends in information management

94 Software Group

Data Science is hard

• Machine learning, collective intelligence, Hadoop, predictive analytics, R, Weka, Mahout, are HARD

• Small-medium businesses need help to compete

Page 95: Mega trends in information management

95 Software Group

Data Scientists to the rescue?

Page 96: Mega trends in information management

96 Software GroupConfidential

Dell Software Information Management

Matt WolkenVice President, Information Management Business

Page 97: Mega trends in information management

97 Software GroupConfidential

Agenda

• What is Information Management and how it fits in Dell Software

• The “data problem” aka why you should care

• Dell’s perspective and our solutions

– Analytics & integration

– Database management

Page 98: Mega trends in information management

98 Software GroupConfidential

Dell Software solutions

Data center & cloud

management• Endpoint management• Performance

management• Virtualization & cloud

mgmt• Windows server mgmt

• Application enablement/delivery

• Desktop virtualization• Mobile device mgmt• Mobile security

Information management

• Application & data integration

• Business intelligence & Big data analytics

• Database management

Mobile workforce management

• Email security• Endpoint security• Identity & access

management• Network security

Security Data protection• Application protection• Disaster recovery• Enterprise backup/recovery• Virtual protection

Page 99: Mega trends in information management

99 Software GroupConfidential

Information Management

Database management Application & data

integration Business intelligence and

Big data analytics

Manage data across structured

and unstructured

data sources

Integrate disparate

data stores, both on-premise and off-premise

Discover trends and

make informed decisions

with analysis

based on all data

Page 100: Mega trends in information management

100 Software GroupConfidential

Data is being created and consumed at a rapid pace

247 BillionEmails are sent everyday. 80% are spam.

$232 Billion dollars will be spent on Big Data through 2016.

$600 BillionDollars in waste annually for bad data or poor quality data.

4.4 MillionIT jobs globally will be created to support big data. Only 1/3 will be filled.

37.5%of large organizations said that analyzing big data is their biggest challenge.

70% of data is created by individuals. Enterprises are responsible for storing and managing 80% of it.

1.8 Zettabytes of business data in use in 2011, up by 30% from 2010.

48 Hoursof video are uploaded to YouTube every minute, resulting in 8 yrs of content daily.

100 BillionRFID tags estimated to be sold in 2015.

Sources: https://www.espatial.com/articles/20-shocking-facts-and-figures-about-big-data/

Page 101: Mega trends in information management

101 Software GroupConfidential

Historically, data was stored mostly in relational databases

Structured Data

Database

Extract, Transform, Load (ETL)

Data provisioning

Data warehouse

Database management

Data analysis

Trained StaffTool Chain

Page 102: Mega trends in information management

102 Software GroupConfidential

Petabyte

Exabyte

Zettabyte

Terabyte

Market situation: Data growth has skyrocketedMultiple data types from many sources

Transactional DataGenerated and stored in databases

• Structured

• Measured growth

Human FilesContent created outside databases

• Facebook, Twitter, RFID, cell phone etc.

• Multiple formats and different speeds of data creation

• Exponential growth

• Docs, Images, Video

• Multiple formats

• Fast growth

Social & Sensor dataIncreased exponentially

Page 103: Mega trends in information management

103 Software Group

The industrial Revolution of data

Page 104: Mega trends in information management

104 Software GroupConfidential

Market problem: Data silos ->fractured tool chain-> fragmented analysis

Structured

Database 1

Extract, Transform, Load

(ETL)

Data provisioning

Data warehouse

Trained StaffTool Chain

Database management

Analysis

Analysis

Analysis

Analysis

Analysis

Structured

Database 2

Extract, Transform, Load

(ETL)

Data provisioning

Data warehouse

Database management

Trained StaffTool Chain

Text

Data store

Extract, Transform, Load

(ETL)

Data provisioning

Data warehouse

Data management

Trained StaffTool Chain

Sensor

Data store

Extract, Transform, Load

(ETL)

Data provisioning

Data warehouse

Data management

Trained StaffTool Chain

Social

Data store

Extract, Transform, Load

(ETL)

Data provisioning

Data warehouse

Data management

Trained StaffTool Chain`

App & Data Integration

Page 105: Mega trends in information management

105 Software GroupConfidential

Dell Information Management solutions break data silos, manage, integrate and discover trends in all data

• Foster collaboration between IT and Line of Business

• Empower more people by offering self service access to data

• Make informed decisions today and into the future

One Vendor – Intuitive Tool Chain - All Data

Man

ag

e

Inte

gra

te

Structured, text, sensor, and social

Data store

Extract, Transform, Load (ETL)

Data provisioning

Data warehouse

Data management

Trained StaffTool Chain

Discover

Page 106: Mega trends in information management

106 Software GroupConfidential

Toad is a best of breed productivity tool for DBAs and developers

Oracle

SQL Server

Sybase

Hadoop

DB2

NoSQL

Cloud

Eclipse

MySQL

Repeatedly named #1 in database development and optimization by IDC1

Over 2 million users, and 3 million visitors to online community Toad World toadworld.com

Similar user experience across different DB platforms

1. Source: IDC, “Worldwide Database Development and Management Tools 2013-2017 Forecast and 2012 Vendor Shares” (Doc #242376)

Page 107: Mega trends in information management

107 Software GroupConfidential

SharePlex: Zero downtime migrations: DB, OS, Apps• Oracle database migrations

• Expired support on older versions

• New features / functionality in newer versions

• Change in edition: Standard / Enterprise

• OS migrations/change hardware

vendors• Moving to new servers (e.g. Solaris to Linux)

• Exadata, RAC, cloud or virtualized environments

• Provide a copy of data to a different platform (i.e. Oracle to Sybase, Oracle to Hadoop)

• Storage migrations• Replace with newer / faster disc array

• Reduce risk during application upgrades• Upgrade the application to a newer version

• Coincides with a hardware and / or database upgrade

Database

Operating

System

Application

CustomApps

Page 108: Mega trends in information management

108 Software GroupConfidential

Clo

ud

ap

ps

Boomi integrates apps and data stores

On

-pre

mis

e

128-bit encryption(metadata only)

Data

DataData

External firewall

Page 109: Mega trends in information management

109 Software GroupConfidential

Toad enables self-service BI

Toad Data Point (Querying and Data Prep)

Toad Intelligence Central

(Data mashups & Collaboration server)

Toad Decision Point

(Data discovery & visualization)

Presentation LayerShare workbooks

Data Sources

RDBMS Big Data Data warehouses

Desktop

Cloud apps

BI sources

Ensures IT governanceProvides rapid and governed access to all traditional and emerging data sources

Enables self service access Easily access underlying data sources using self service tools

Increases ROI of existing BIComplements existing tools and easily snaps into IT/BI and LOB systems

Fosters collaboration between IT and LOBBridges the gap between business users and IT with tools that enable collaboration

Page 110: Mega trends in information management

110 Software GroupConfidential

Leveraging Data & Analytics presents enormous potential for organizations

of CIO’s say they plan to expand Analytics this year or next

Ranking of Analytics & BI in Gartner CIO survey of top technology priorities (2013)

Employment opportunity. By 2015, 4.4M IT jobs globally will be created to support big data, 1.9M IT jobs in US alone!

#1 70% 1.8ZB#1 57%

of mid-market companies consider business analytics critical to operations

90% of all the data in the world has been generated over the last two years

Page 111: Mega trends in information management

111 Software GroupConfidential

The potential benefits are real and are already being experienced today!

Which statement best describes the value you’ve seen from your predictive analytics efforts?

We have measured positive top- and bottom-line impact

We have measured top-line impact only

We believe that we have become more effective, but can’t measure top-line

impact

We have measured a cost reduction only

We believe we have become more efficient, but cannot measure impact

We have gained more insight

36%

7%

18%

2%

12%

25%

Based on 126 active respondents.

Companies that rate themselves substantially ahead of their peers in their use of data are

more likely to rate themselves as substantially ahead in financial performance, according to findings from the Economist Intelligence Unit.

Information Week: State of Analytics report Dec 2013 www.cio.com/article/730457/Data_Driven_Companies_Outperform_Competitors_Financially?page=2&taxonomyId=3002

3X

Page 112: Mega trends in information management

112 Software GroupConfidential

Great data driven opportunities abound but problems emerge with data complexity…Data growth brings opportunity….

….but, there are new challenges

1 in 3

Organization leaders frequently make decisions based on Information they don’t trust, or don’t have

Organization leaders say they don’t have access to the information they need to do their jobs

Of CXOs agree they have more data than they can use effectively

1 in 2

60%

IDC, Gartner miscellaneous reports

Page 113: Mega trends in information management

113 Software GroupConfidential

Key co

mponents

to b

uild

end-

to-e

nd B

I/A

naly

tics

solu

tions

Dell’s offering was not complete…

Data Integration

Database Management

Advanced Analytics

Business Intelligence

Server and Storage

Server and Storage

TOAD & Shareplex

TOAD BI

Boomi

Kitenga

In order to address the demands that face mid-market customers, Dell must offer end-to-end solutions enabled with advanced analytic capabilities

Page 114: Mega trends in information management

114 Software GroupConfidential

• Highest Business Value and Complexity From Predictive Analytics

• There Remains a Dearth of Flexible, Configurable, and Reliable Predictive Analytics Solutions

Evolution of BI Solutions

Query, reporting, & search tools

OLAP

Dashboards, scorecards

Predictive analytics: IBM, SAS, StatSoft

Business Intelligence Technologies

[1] Source: Gartner 2012

Page 115: Mega trends in information management

115 Software GroupConfidential

Dell acquires Statsoft

Data Integration

Database Management

Advanced Analytics

Business Intelligence

Server and Storage

STATISTICA

Server and Storage

TOAD & Shareplex

TOAD BI

Boomi

Kitenga

Key co

mponents

to b

uild

end-

to-e

nd B

I/A

naly

tics

solu

tions

Dell + StatSoft = completes a strong end-to-end analytics driven information management value proposition

Page 116: Mega trends in information management

116 Software GroupConfidentialConfidential

StatSoft is well recognized in the industry“I see a significantly expanding market for predictive analytics software. The best strategy [for Stinger] might not be to go directly after SAS, but rather fill the need for all the new customers who are intimidated by SAS or IBM especially in the mid-market” Mike Gualteri at Forrester

1 Acquired by SAP Sep 2013

StatSoft

StatSoft

Page 117: Mega trends in information management

117 Software GroupConfidential117

Confidential

Page 118: Mega trends in information management

118 Software GroupConfidential118

Confidential

Data Visualization

Page 119: Mega trends in information management

119 Software GroupConfidential119

Confidential

Live scoring – integration into operational systems

Page 120: Mega trends in information management

120 Software GroupConfidential120

Confidential

Industry and cross-industry packaged solutions

Page 121: Mega trends in information management

121 Software GroupConfidential

Over 30 years of Information Management software experience

Tool for Oracle Application Development born in 90’s

Quest Software acquires TOAD in 1998

TOAD expands support for Microsoft SQL Server, Sybase, IBM DB2, and MySQL in 2000’s

In 2009, TOAD supports NoSQL, Hadoop, MongoDB, Cassandra, SimpleDB, Azure

Later in 2009 Toad Data Point is launched for data analysts

2010 Dell Acquires Boomi

2011 Toad Decision Point is launched for business users

2012 Toad Intelligence Central launched for collaboration

2012 Dell acquires Quest Software & Kitenga Big Data Analytics

2013 Toad BI Suite 2.0

Boomi Created in 2000

2013 Boomi MDM launched

Social Network Analytics Platorm

Quest creates SharePlex in 1999

Quest creates Spotlight in 2000

2012 Dell launches Quickstart Data Warehouse to solve needs of SMB

2014 Dell Acquires StatSoft

Dell & StatSoft founded in 1984

Page 122: Mega trends in information management

122 Software Group

Visit the Dell Software Booth

Enter for a chance to win a Dell Venue Pro 11 tablet

Draw is at 2:45pm Thursday

Page 123: Mega trends in information management

#C

14

LV#

C1

4LV

Please complete the session evaluation on the mobile appWe appreciate your feedback and insight

[email protected]@guyharrisonGuyharrison.net


Recommended