Date post: | 20-Aug-2015 |
Category: |
Technology |
Upload: | guy-harrison |
View: | 421 times |
Download: | 0 times |
1 Software GroupConfidential
752: Mega trends in database and information management
a.k.a. Dell Software Information Management – evolving to meet your data requirementsGuy HarrisonExecutive Director, R&D Information Management
2 Software GroupConfidential
3 Software GroupConfidential
4 Software GroupConfidential
5 Software GroupConfidential
7 Software Group
Dell Research Division
Mobility and Internet of Things
6. BYOD is changing from “secure the device” to “make it easy for me to use my device”
7. Internet of things. Opportunity for management, coordination and security of devices, opportunity for servers outside the data center
8. Wearable computing as next potential platform
Modern IT and Application Infrastructure
1. By 2018, majority of apps delivered as services, majority of data will be in cloud
2. Software defined data center – disrupts the network and storage leaders and allows the server leader to win with software on servers
3. Telco networks will transform to software on servers or as virtual appliances in cloud
4. App development moving to composite apps –stitching of existing SaaS and PaaS components
Security
9. New usage paradigms in a connected world needs new kinds of security – Dell opportunity is to develop end-to-end security across our products
10. Using analytics to detect abnormal user and application behavior – big opportunity for Dell to drive security analytics leadership
Dell Technology Outlook
8
Big Data and Data Analytics
5. Most industries will integrate “Big data” analytics into business processes to maintain competitive edge. Dell can be the enabler for the SMB through provision of infrastructure, analytic solutions and data.
Source: IDC, Gartner, Forrester, Everest Group, Company web sites, Dell internal.
8
9 Software GroupConfidential
Industry Mega-Trends
Mobility Cloud
Social BigData
10 Software GroupConfidential
Mobility
• Quad-core 1.4 GHz CPU
• 2GB RAM
• 32GB SSD
• 1080p display
• LTE/Bluetooth/WiFi
• 16MP & 2MP Camera
• GPS & Compass
11 Software Group
12 Software Group
13 Software Group
14 Software Group
15 Software Group
16 Software Group
17 Software Group
18 Software Group
19 Software Group
20 Software Group
21 Software Group
22 Software Group
23 Software Group
24 Software Group
25 Software Group
Data Input
26 Software Group
Siri
From now on, I’ll call you ‘An Ambulance’. OK?
“Siri call me an ambulance”
I found 14 bridges nearby:
“I want to jump off a bridge”
28 Software Group
29 Software Group
30 Software Group
Brain Control
31 Software Group
32 Software Group
33 Software Group
Muze
34 Software Group
35 Software Group
36 Software Group
The instrumented human
• Bluetooth Personal Area Network
• 3G/WiFi Wide Area Network
• GPS• Storage
• Pulse, temp monitor
• Silent alarms• Pedometer, sleep
monitoring
• Compass • Camera• Mike/earphones• Heads up display• Emotion/Attention
monitor
37 Software Group
Cloud and Internet of Things
38 Software Group
39 Software Group
40 Software Group
41 Software Group
42 Software Group
Internet of Things
Market Drivers• Declining device and sensor
costs
• Broad availability of network connectivity and CPU power for analytics
• Consumer Electronics (nest, etc)
• Regulations – e.g. Positive Train Control by 2015
• Surveillance Society
43 Software Group
Social
44 Software Group
“Social media create a revolution in communications and will define society’s evolution”
I need to pee
I peed
This is where I pee
Look at me peeing
Why do I pee?
I am good at peeing
45 Software Group
The culmination of cloud, social and mobile
46 Software Group
Will Big Data kill retail?
47 Software Group
Prevalence of Showrooming
Consumer Electronics
Home Improvement
0 10 20 30 40 50 60 70
Pct
Garter Research G00249458Survey Analysis: Focus on Customer Basics to Challenge Amazon, as 'Showrooming' Is Universal but Not UnbeatablePublished: 12 February 2013
48 Software Group
Some novel defences
49 Software Group
Battling showrooming
Selection
Stock
Faster
Cheaper
Dynamic Pricing
Predictive ordering
Assortment optimization
Predictive recommendations
Personalization
50 Software Group
Data and algorithms are the key to retain survival in the Big Data era
• Online has significant advantages
• Retailers can only survive by embracing online and emulating online practices– Dynamic pricing– Shelf optimization– Personalized service and selection
• Only big data analytics can provide these advantages
51 Software Group
There’s a similar story in every industry Web
Transport
Power Grid
Dating
Retail
Security
FinanceGovernment
Science
Healthcare
Insurance
Telecom
Advertising
52 Software Group
Generating competitive advantage through “Big Data analytics” Machine
LearningPrograms that evolve with “experience”
Collective IntelligencePrograms that use inputs from “crowds’ to seem intelligent
Predictive AnalyticsPrograms that extrapolate from existing data into the future
Big Data AnalyticsAKA Data Science
53 Software Group
Collective Intelligence
54 Software Group
55 Software Group
56 Software Group
57 Software Group
58 Software Group
59 Software Group
60 Software Group
61 Software Group
62 Software Group
Google Flu Trends
63 Software Group
64 Software Group
Collective Intelligence outsmarts Artificial Intelligence?
65 Software Group
66 Software Group
67 Software Group
68 Software Group
69 Software Group
Artificial Intelligence Strikes back
70 Software Group
71 Software Group
72 Software Group
73 Software Group
74 Software Group
Watson is big data AI – and was built on Hadoop
75 Software Group
Hadoop
76 Software Group
Pioneers of Big Data
77 Software Group
78 Software Group
79 Software Group
80 Software Group
81 Software Group
82 Software Group
Hadoop: Open Source Map-Reduce Stack
83 Software Group
Hadoop at Yahoo
Yahoo! Hadoop cluster:
• 4000 nodes• 16PB disk• 64 TB of RAM• 32,000 Cores
84 Software Group
Economies
Exadata
Hadoop
$0 $1,000 $2,000 $3,000 $4,000 $5,000 $6,000
$4,911
$750
Exadata vs Hadoop $$/TB (Hardware only)
85 Software Group
Schema on Read vs Schema on Write
Data
Analyse
Aggregate
Normalize
Cleanse
Code
ExtractLoad Transform Data
Warehouse
Data LoadHadoop
Analyse
Cleanse
Code
Utilize
Schema on Write
Schema on Read
Utilize
86 Software Group
Generating competitive advantage through “Big Data analytics” Machine
LearningPrograms that evolve with “experience”
Collective IntelligencePrograms that use inputs from “crowds’ to seem intelligent
Predictive AnalyticsPrograms that extrapolate from existing data into the future
Big Data AnalyticsAKA Data Science
87 Software Group
Predictive Analytics
0 20 40 60 80 100 120
-20
0
20
40
60
80
100
120
f(x) = 0.971521231456065 x + 0.71906459527154
• Linear regression• Non-linear (curve fit)• Multivariate• Time series• Logistical Regression• CART
88 Software Group
Classification• Create a model that
identifies/classifies new data
• Spam detection, churn risk, customer value
89 Software Group
Clustering• Group data without a
pre-existing classification scheme
• For instance, basket analysis
90 Software Group
SupervisedMachine Learning
Raw Data Clean
Validate
Model
Candidate
ModelTraining Set
Validation Set
Production
ModelNew Data
New Business
Existing Business
Prediction
91 Software Group
Inmaps.linkedin.com
Unsupervised learning
92 Software Group
93 Software Group
Big Data Analytics
Data Science
Search Optimization
Recommendation Systems
Security•Vulnerability•Penetration Detection
Fraud Detection
CRM•Churn •Defaults
Medical•Risk analysis•Diagnosis•Prognosis
Game optimization
Advertising•Targeting•Tailoring
94 Software Group
Data Science is hard
• Machine learning, collective intelligence, Hadoop, predictive analytics, R, Weka, Mahout, are HARD
• Small-medium businesses need help to compete
95 Software Group
Data Scientists to the rescue?
96 Software GroupConfidential
Dell Software Information Management
Matt WolkenVice President, Information Management Business
97 Software GroupConfidential
Agenda
• What is Information Management and how it fits in Dell Software
• The “data problem” aka why you should care
• Dell’s perspective and our solutions
– Analytics & integration
– Database management
98 Software GroupConfidential
Dell Software solutions
Data center & cloud
management• Endpoint management• Performance
management• Virtualization & cloud
mgmt• Windows server mgmt
• Application enablement/delivery
• Desktop virtualization• Mobile device mgmt• Mobile security
Information management
• Application & data integration
• Business intelligence & Big data analytics
• Database management
Mobile workforce management
• Email security• Endpoint security• Identity & access
management• Network security
Security Data protection• Application protection• Disaster recovery• Enterprise backup/recovery• Virtual protection
99 Software GroupConfidential
Information Management
Database management Application & data
integration Business intelligence and
Big data analytics
Manage data across structured
and unstructured
data sources
Integrate disparate
data stores, both on-premise and off-premise
Discover trends and
make informed decisions
with analysis
based on all data
100 Software GroupConfidential
Data is being created and consumed at a rapid pace
247 BillionEmails are sent everyday. 80% are spam.
$232 Billion dollars will be spent on Big Data through 2016.
$600 BillionDollars in waste annually for bad data or poor quality data.
4.4 MillionIT jobs globally will be created to support big data. Only 1/3 will be filled.
37.5%of large organizations said that analyzing big data is their biggest challenge.
70% of data is created by individuals. Enterprises are responsible for storing and managing 80% of it.
1.8 Zettabytes of business data in use in 2011, up by 30% from 2010.
48 Hoursof video are uploaded to YouTube every minute, resulting in 8 yrs of content daily.
100 BillionRFID tags estimated to be sold in 2015.
Sources: https://www.espatial.com/articles/20-shocking-facts-and-figures-about-big-data/
101 Software GroupConfidential
Historically, data was stored mostly in relational databases
Structured Data
Database
Extract, Transform, Load (ETL)
Data provisioning
Data warehouse
Database management
Data analysis
Trained StaffTool Chain
102 Software GroupConfidential
Petabyte
Exabyte
Zettabyte
Terabyte
Market situation: Data growth has skyrocketedMultiple data types from many sources
Transactional DataGenerated and stored in databases
• Structured
• Measured growth
Human FilesContent created outside databases
• Facebook, Twitter, RFID, cell phone etc.
• Multiple formats and different speeds of data creation
• Exponential growth
• Docs, Images, Video
• Multiple formats
• Fast growth
Social & Sensor dataIncreased exponentially
103 Software Group
The industrial Revolution of data
104 Software GroupConfidential
Market problem: Data silos ->fractured tool chain-> fragmented analysis
Structured
Database 1
Extract, Transform, Load
(ETL)
Data provisioning
Data warehouse
Trained StaffTool Chain
Database management
Analysis
Analysis
Analysis
Analysis
Analysis
Structured
Database 2
Extract, Transform, Load
(ETL)
Data provisioning
Data warehouse
Database management
Trained StaffTool Chain
Text
Data store
Extract, Transform, Load
(ETL)
Data provisioning
Data warehouse
Data management
Trained StaffTool Chain
Sensor
Data store
Extract, Transform, Load
(ETL)
Data provisioning
Data warehouse
Data management
Trained StaffTool Chain
Social
Data store
Extract, Transform, Load
(ETL)
Data provisioning
Data warehouse
Data management
Trained StaffTool Chain`
App & Data Integration
105 Software GroupConfidential
Dell Information Management solutions break data silos, manage, integrate and discover trends in all data
• Foster collaboration between IT and Line of Business
• Empower more people by offering self service access to data
• Make informed decisions today and into the future
One Vendor – Intuitive Tool Chain - All Data
Man
ag
e
Inte
gra
te
Structured, text, sensor, and social
Data store
Extract, Transform, Load (ETL)
Data provisioning
Data warehouse
Data management
Trained StaffTool Chain
Discover
106 Software GroupConfidential
Toad is a best of breed productivity tool for DBAs and developers
Oracle
SQL Server
Sybase
Hadoop
DB2
NoSQL
Cloud
Eclipse
MySQL
Repeatedly named #1 in database development and optimization by IDC1
Over 2 million users, and 3 million visitors to online community Toad World toadworld.com
Similar user experience across different DB platforms
1. Source: IDC, “Worldwide Database Development and Management Tools 2013-2017 Forecast and 2012 Vendor Shares” (Doc #242376)
107 Software GroupConfidential
SharePlex: Zero downtime migrations: DB, OS, Apps• Oracle database migrations
• Expired support on older versions
• New features / functionality in newer versions
• Change in edition: Standard / Enterprise
• OS migrations/change hardware
vendors• Moving to new servers (e.g. Solaris to Linux)
• Exadata, RAC, cloud or virtualized environments
• Provide a copy of data to a different platform (i.e. Oracle to Sybase, Oracle to Hadoop)
• Storage migrations• Replace with newer / faster disc array
• Reduce risk during application upgrades• Upgrade the application to a newer version
• Coincides with a hardware and / or database upgrade
Database
Operating
System
Application
CustomApps
108 Software GroupConfidential
Clo
ud
ap
ps
Boomi integrates apps and data stores
On
-pre
mis
e
128-bit encryption(metadata only)
Data
DataData
External firewall
109 Software GroupConfidential
Toad enables self-service BI
Toad Data Point (Querying and Data Prep)
Toad Intelligence Central
(Data mashups & Collaboration server)
Toad Decision Point
(Data discovery & visualization)
Presentation LayerShare workbooks
Data Sources
RDBMS Big Data Data warehouses
Desktop
Cloud apps
BI sources
Ensures IT governanceProvides rapid and governed access to all traditional and emerging data sources
Enables self service access Easily access underlying data sources using self service tools
Increases ROI of existing BIComplements existing tools and easily snaps into IT/BI and LOB systems
Fosters collaboration between IT and LOBBridges the gap between business users and IT with tools that enable collaboration
110 Software GroupConfidential
Leveraging Data & Analytics presents enormous potential for organizations
of CIO’s say they plan to expand Analytics this year or next
Ranking of Analytics & BI in Gartner CIO survey of top technology priorities (2013)
Employment opportunity. By 2015, 4.4M IT jobs globally will be created to support big data, 1.9M IT jobs in US alone!
#1 70% 1.8ZB#1 57%
of mid-market companies consider business analytics critical to operations
90% of all the data in the world has been generated over the last two years
111 Software GroupConfidential
The potential benefits are real and are already being experienced today!
Which statement best describes the value you’ve seen from your predictive analytics efforts?
We have measured positive top- and bottom-line impact
We have measured top-line impact only
We believe that we have become more effective, but can’t measure top-line
impact
We have measured a cost reduction only
We believe we have become more efficient, but cannot measure impact
We have gained more insight
36%
7%
18%
2%
12%
25%
Based on 126 active respondents.
Companies that rate themselves substantially ahead of their peers in their use of data are
more likely to rate themselves as substantially ahead in financial performance, according to findings from the Economist Intelligence Unit.
Information Week: State of Analytics report Dec 2013 www.cio.com/article/730457/Data_Driven_Companies_Outperform_Competitors_Financially?page=2&taxonomyId=3002
3X
112 Software GroupConfidential
Great data driven opportunities abound but problems emerge with data complexity…Data growth brings opportunity….
….but, there are new challenges
1 in 3
Organization leaders frequently make decisions based on Information they don’t trust, or don’t have
Organization leaders say they don’t have access to the information they need to do their jobs
Of CXOs agree they have more data than they can use effectively
1 in 2
60%
IDC, Gartner miscellaneous reports
113 Software GroupConfidential
Key co
mponents
to b
uild
end-
to-e
nd B
I/A
naly
tics
solu
tions
Dell’s offering was not complete…
Data Integration
Database Management
Advanced Analytics
Business Intelligence
Server and Storage
Server and Storage
TOAD & Shareplex
TOAD BI
Boomi
Kitenga
In order to address the demands that face mid-market customers, Dell must offer end-to-end solutions enabled with advanced analytic capabilities
114 Software GroupConfidential
• Highest Business Value and Complexity From Predictive Analytics
• There Remains a Dearth of Flexible, Configurable, and Reliable Predictive Analytics Solutions
Evolution of BI Solutions
Query, reporting, & search tools
OLAP
Dashboards, scorecards
Predictive analytics: IBM, SAS, StatSoft
Business Intelligence Technologies
[1] Source: Gartner 2012
115 Software GroupConfidential
Dell acquires Statsoft
Data Integration
Database Management
Advanced Analytics
Business Intelligence
Server and Storage
STATISTICA
Server and Storage
TOAD & Shareplex
TOAD BI
Boomi
Kitenga
Key co
mponents
to b
uild
end-
to-e
nd B
I/A
naly
tics
solu
tions
Dell + StatSoft = completes a strong end-to-end analytics driven information management value proposition
116 Software GroupConfidentialConfidential
StatSoft is well recognized in the industry“I see a significantly expanding market for predictive analytics software. The best strategy [for Stinger] might not be to go directly after SAS, but rather fill the need for all the new customers who are intimidated by SAS or IBM especially in the mid-market” Mike Gualteri at Forrester
1 Acquired by SAP Sep 2013
StatSoft
StatSoft
117 Software GroupConfidential117
Confidential
118 Software GroupConfidential118
Confidential
Data Visualization
119 Software GroupConfidential119
Confidential
Live scoring – integration into operational systems
120 Software GroupConfidential120
Confidential
Industry and cross-industry packaged solutions
121 Software GroupConfidential
Over 30 years of Information Management software experience
Tool for Oracle Application Development born in 90’s
Quest Software acquires TOAD in 1998
TOAD expands support for Microsoft SQL Server, Sybase, IBM DB2, and MySQL in 2000’s
In 2009, TOAD supports NoSQL, Hadoop, MongoDB, Cassandra, SimpleDB, Azure
Later in 2009 Toad Data Point is launched for data analysts
2010 Dell Acquires Boomi
2011 Toad Decision Point is launched for business users
2012 Toad Intelligence Central launched for collaboration
2012 Dell acquires Quest Software & Kitenga Big Data Analytics
2013 Toad BI Suite 2.0
Boomi Created in 2000
2013 Boomi MDM launched
Social Network Analytics Platorm
Quest creates SharePlex in 1999
Quest creates Spotlight in 2000
2012 Dell launches Quickstart Data Warehouse to solve needs of SMB
2014 Dell Acquires StatSoft
Dell & StatSoft founded in 1984
122 Software Group
Visit the Dell Software Booth
Enter for a chance to win a Dell Venue Pro 11 tablet
Draw is at 2:45pm Thursday
#C
14
LV#
C1
4LV
Please complete the session evaluation on the mobile appWe appreciate your feedback and insight
[email protected]@guyharrisonGuyharrison.net