SABOUC Big Data Discovery and Other Key Analytic Trends

Presentation Title on One Line

Timo ElliottBig Data DiscoveryAnd Other Key Analytic TrendsSession 2507

2015 SAP SE or an SAP affiliate company. All rights reserved.#Congratulations!

2015 SAP SE or an SAP affiliate company. All rights reserved.#

88%How Do Executives Make Decisions?Aspect Consulting, 1997

12%Hard FactsGut Feel90%10%Hard FactsGut FeelEconomist Intelligence Unit, 2014Why the worst-practice shaded 3D donut charts? JUST TO ANNOY DATA VIZ EXPERTS!



Biggest Barriers to Business Intelligence20152003Sources: InformationWeek Survey 2015, BusinessWeek Survey, 2003


Plus a Change

PetabytesDataScientists+ IoTBig Data


Business Intelligence SuccessSources: InformationWeek Survey 2015, BusinessWeek Survey, 2003

?


Use AnalyticsTodayNeedAnalytics by 2020Gartner, 2014The OpportunityInability to see, understand, and optimize new opportunities

Inaccessible dataand technologyInsights remain hidden Complexity, cost, confusionSilos of approaches and analytic technologies

75%10%

Slow decision making lacking future viewRear view mirrorBI mentality


clouddatamobileMORE!competitionspeedsocialconnectedTheres Been An Explosion of New TechnologyMeans new opportunities


Big Data On The Gartner Hype CycleSource: Gartner, August 2014 Innovation triggerPeak of Inflated ExpectationsTrough of DisillusionmentSlope of EnlightenmentPlateau of Productivity

Big Data


Big Data Discovery=Big DataData DiscoveryData ScienceGartner Strategic Planning Assumption: By 2017, Big Data Discovery Will Evolve Into a Distinct Market Category

#2015 SAP SE or an SAP affiliate company. All rights reserved.


Big Data Discovery

Volume, velocity, or variety of dataPotential business impact

Difficult to implementPotentially expensiveLack of skills available

Ease of useAgility and flexibilityTime-to-resultsInstalled user base

Complexity of analysisPotential impactRange of toolsSmart algorithms

Difficult to implementSlow and complexNarrow focus of analysis

Limited depth of information explorationLow complexity of analysis

BIGDATADATASCIENCEDATADISCOVERY


Big Data DiscoverySimpler to use than data scienceAccessible to a wider range of usersBroad range of data manipulation featuresAble to handle new types of data sourcesWith adequate performance for big data

BIGDATADISCOVERY


Potential impact per userPotential user base

The Rise of the Citizen Data Scientist?Business analystData scientistCitizen data scientist


New Products & Services


The Opportunity

New Business Opportunities

Traditional Analytics

Data ValueVolume / Variety / Velocity of DataBig Data Discovery

Data DiscoveryBig DataData Science


SAPs OpportunitySAP HANA (+ Hadoop etc.)SAP Predictive Analytics 2.0SAP Lumira

BigDataDiscovery


Boardroom RedefinedSource:In-Memory Data Management: An Inflection Point for Enterprise Applications. Hasso Plattner Alexander Zeier


Intricate calculations of sales by territories will appear as if by magic in the digital age ahead



Decision Cockpits


SAP Smart Business, Executive Edition


Wal-Marts Data Caf250 Bn rows of data94% of queries run < 2s>1,000 concurrent users even under heavy loads. Data load throughput >20 million records/hour

Suja ChandrasekaranCTO of Walmart TechnologyCollaborative Analytics Facilities for Enterprise: Data from 245M customers/week, 11,000 stores under 71 banners in 27 countries and e-commerce websites in 11 countries with $482.2 Bn sales and 2.2M employees.


Mercy Health40K employees, >8M patients/year, 9 years of data, structured & unstructured

Mercy Named One of Nations Most Wired for 11th Year


The End of the Hadoop Honeymoon?

Despite considerable hype and reported successes for early adopters, only 18% have plans to invest in Hadoop over the next two years. in fact, there are fewer who plan to begin in the next two years than already have.

Nick Heudecker, research director at Gartner.


SAP HANA PlatformBringing Enterprise to Hadoop and Hadoop to The Enterprise

SPATIAL PROCESSINGANALYTICS, TEXT, GRAPH, PREDICTIVE ENGINESCONSUMECOMPUTESTORAGESOURCE

INGEST

Application Development Environment

Transformations & Cleansing

Smart Data IntegrationSmart Data Quality

StreamProcessingSmart Data StreamingSTREAM PROCESSINGLogs

Text

OLTP

Social

Machine

Geo

ERP

Sensor

Store & forwardMobile applications and BISmart Data Access

Virtual TablesUser Defined Functions

101010010101101001110Dynamic Tiering

Aged datain DiskIn-Memory

Data model& data

Calculation engineFastcomputing

Column StorageHigh performance analyticsSeries Data Storage

Store time-series data Reporting &DashboardsHigh Performance ApplicationsData Exploration& VisualizationAdhoc & OLAP AnalyticsPredictiveAnalysisBusiness Planning & ForecastingLumira / BIBut there is more work to do

Hadoop / NoSQLMapReduceYARNHDFS


ENTERPRISEBIG DATABridging the Digital DivideIntroducing SAP HANA Vora

2015 SAP SE or an SAP affiliate company. All rights reserved.25Internal


SAP HANA VoraWhats Inside and What Does It Do?DemocratizeData AccessMake PrecisionDecisionsSimplifyBig DataOwnershipSAP HANA Vora is an in-memory query engine which leverages and extends the Apache Spark execution framework to provide enriched interactive analytics on Hadoop.

Drill Downs on HDFSMashup API EnhancementsCompiled QueriesHANA-Spark AdapterUnified LandscapeOpen Programming

Any Hadoop Clusters


The New Multi-Polar World of Big Data ArchitecturesData Warehouse Third-Party Data FeedsHadoop,MongoDB,Spark, etc

PersonalData / BIWhere does data arrive?When does it need to move?Where does modeling happen?What can users do themselves?What governance is required?Big Data Architectures got complicated

What we want consistent, seamless solution

Hybrid Transaction/Analytical Processing

+Cloud!


Apache Atlas


Data Wrangling Eats Into ETLSelf-service data integration will do for traditional IT-centric data integration what data discovery platforms have done for traditional IT-centric BI shifting much of the activity from IT to the business user

Rita Sallam, Gartner Analyst

New!SAP Agile Data Preparation


Data Visualization is Cool (but)

Not using 3D pie charts

Ease of use, training, data quality, incentives, organization, process, etc. etc. Importance for BI Success of:


We Still Need Reporting and Dashboards!Source: InformationWeek BI Survey 2015Question: To what extent are the following technologies used to share analytic and BI insights within your organization? and response: Used Extensively


Supporting The Analytics Lifecycle


Descriptive:What happened?Diagnostic:Why did it happen?Predictive:What will happen?Prescriptive:What should happen?Taking Analytics To The Next LevelSource: Gartner


Transport For London


Centerpoint Energy


DATA SCIENCEQUIZ.These numbers were found in two tax declarations. One is entirely made up. Which one?EUR

127,-2.863,-10.983,-694,-29.309,-32,-843,-119.846,-18.744,-1.946,-275,-EUR

937,-82.654,-18.465,-725,-98.832,-7.363,-4.538,-38,-8.327,-482,-2.945,-


Benfords LawDistribution of the first digit of real-world sets of numbers that uniformly span several orders of magnitude


DATA SCIENCEQUIZ.These numbers were found in two tax declarations. One is entirely made up. Which one?EUR

127,-2.863,-10.983,-694,-29.309,-32,-843,-119.846,-18.744,-1.946,-275,-EUR

937,-82.654,-18.465,-725,-98.832,-7.363,-4.538,-38,-8.327,-482,-2.945,-

Benford's Law, also called the First-Digit Law


1999 to 2009Greece shows the largest deviation from Benfords law with respect to all measures. [And] the suspicion of manipulating data has officially been confirmed by the European Commission. Fact and Fiction in EU-GovernmentalEconomic Data, 2011



Finance & Analytics: Its Dj Vu All Over AgainCloud

Any Device

SocialCollaboration

Big Data

100101110111011010010100101101010110 00101011001010010101010001001001011010

EnterprisePerformanceManagementGovernance,Risk, andComplianceDiscoverInformAnticipatePlan

BusinessIntelligencePredictiveAnalyticsReal-timeBusiness


Is This Your Finance Team?"With 90% certainty, heres where we closed last month"


And that requires faster, more forward-looking analyticsFinance Wants To Be A Business Partner


Big Data = New Business ModelsEnabling Predictive MaintenanceKaeser Compressor, a global leader in air compressors

500 million, 4,800 employees, 50 countries, partners in additional 60 countries


2015 SAP SE or an SAP affiliate company. All rights reserved.#Modeling Example

E.g. Total energy consumptionAggregation of 10 sec valuesCalculation of typical consumption patternsPattern associated with each compressor and dayRepeat for temperature, pressure, vibration, etc.


High-Level Technical ViewPredictive Model(in-memory)Long-term disk storageUser InterfacesCRMERP

Event Stream Processingallsampled

CustomerField Svs SalesR&DDW


BenefitsCustomersLess downtimeDecreased time to resolutionOptimal longevity and performanceKaeserMore efficient use of spare parts, etcNew sales opportunitiesBetter product development

We are seeing improved uptime of equipment, decreased time to resolution, reduced operational risks and accelerated innovation cycles.

Most importantly, we have been able to align our products and services more closely with our customers needs.

Kaeser CIOFalko Lameter

Next Steps: New Business Models


SAP HANA Cloud Platform - the Internet of Things enabled in-memory platform-as-a-service Machine Cloud (SAP)HANA CloudIoT ServicesEnd Customer(On site)Business owner(SAP Customer)HANA Cloud IntegrationBusiness Suite Systems(ERP, CRM , etc.)SAP Connector

DeviceHANA Big Data PlatformData Processing Extended StorageHadoopIn-Memory EnginesStreaming

StorageHANA Cloud Platform

Machine IntegrationProcess Integration

IoT Applications(SAP, Partner and Custom apps)


SIEMENS Cloud for IndustryThe SIEMENS Cloud for Industry connects the worlds of machines and business via:the HCP for IoTopen APIs easy connectivity.

It is the successor of the SIEMENS Plant Data Services.

It is planned to be an open platform:Open to non-Siemens assets and non-SAP back-endsEndorsing the OPC UA StandardsCreating a separate, yet adjacent & complementary partner developer network

R&DSalesManufacturingAftermarket ServiceSupply ChainIn-Memory Cloud Platform for the Internet of Things

PartnerConnectivityCustomerConnectivitySAPConnectivitySIEMENSConnectivity

PartnerApplicationsCustomerApplicationsSAPApplicationsSIEMENSApplications

Machine connectivity to SIEMENS customers plantsBusiness Process Integration (SIEMENS or SIEMENS customers)Cloud for Industry


Tweeting Sharks!


Drones


Its Not You, Its Your DataWe found, on average, that 45% of the data business people use resides outside of the enterprise BI environments.An astonishingly miniscule 2% of business decision-makers reported using solely enterprise BI applications.This is undoubtedly connected to 76% of business respondents indicating they continue to resort to spreadsheets and other homegrown BI applications to analyze BI data. Source: Forrester


Fix Your Culture: Suits AND Hoodies


Build and Nurture a CommunityRegular face-to-face meetingsBring people together across silos: IT, Analysts, Business Leaders, ExecsPresentations of successes best practicesInvite external speakersVirtual communitiesLeverage internal social tools for people to share informationCommunity-driven BI contentCommunity self-policingAct as BICC eyes and ears to discover projects, opportunitiesSocial mechanisms to ensure the right behaviorsEnsure support at all levelsNot just executives middle and users


Theres a LOT going on in AnalyticsBig data discoveryThe boardroom redefinedSAP HANA & HadoopMulti-polar big data architecturesSelf-service data preparationSupporting the analytics lifecyclePrescriptive and predictive analyticsInternet of things for businessFinance and analytics converge (again)Analytics culture & governance

KEY LEARNINGSJudge a man by his questions rather than his answers.Voltaire

STAY INFORMED

Timo Elliott: @timoelliottAsug News Team:Tom Wailgum: @twailgumChris Kanaracus: @chriskanaracusCraig Powers: @Powers_ASUG

SESSION CODE2507

Date post:	18-Jan-2017
Category:	Technology
Upload:	timo-elliott
View:	3,073 times
Download:	0 times