Rocking the World of Big Data at Centrica

Slide 1

ROCKING THE WORLD OF BIG DATA AT CENTRICA

Reuben Banga Big Data Infrastructure & Operations Manager

15:00 15:40 Hadoop Summit Dublin Jennifer Beucler Speaker Content Work Room Liffey Work Room 2B. 1

BIG DATA TIME FOR CHANGE?

Change has a considerable impact on the human mind

To the fearful it is threatening because it means things may get worse

To the hopeful it is encouraging because things may get better

To the confident it is inspiring because the challenge exists to make things better

- Whitney Young

Rocking the World of Big Data at Centrica

#Whitney Moore Young Jr was an American civil rights leader. He spent most of his career working to end employment discrimination in the United States. He spearheaded the drive for equal opportunity for blacks in U.S. industry and government service during his 10 years as head of the National Urban League (196171), the worlds largest social-civil rights organization. He was particularly credited with almost singlehandedly persuading corporate America and major foundations to aid the civil rights movement through financial contributions in support of self-help 2

LIVING IN A NEW AGE?

The Millennial Generation Highly educatedSelf-confidentTechnologically savvyAmbitious Connected

Acceleration in Societal changeSocial MediaSmartphonesMobile Computing New Technology

Instant gratification Netflix, Sky, Amazon, Apple, Spotify

Hard to please spoilt for choice


#When How - Where Millennial Generation - most researchers and commentators use birth years ranging from the early 1980s to the early 2000s.TV Channels BBC ITV Now hundeds Music iTunes / Spotify

3

CENTRICA ABOUT US

We are an energy and services company. Everything we do is focused on satisfying the changing needs of our customersRocking the World of Big Data at Centrica

#Our Strategy - is about satisfying the changing needs of our customers. Serving our customers is what we are known for, what we are good at and where we have distinctive capabilities.4

Rocking the World of Big Data at CentricaCENTRICA KEY FIGURES

Multinational Utility Company

FTSE 100 Company

28 Billion Revenue

1.5 Billion Operating Profit

28 Million Customer Accounts

38,000 Employees Worldwide

#CENTRICA OUR BRANDS


#Direct Energy is one of North America's largest energy and energy services providers. We are active in energy supply and trading and downstream delivery of electricity and natural gas to homes and businesses.

Dyno specialise in Plumbing, Heating and Drainage services. Dyno is part of British Gas and operates around 45 franchises all over the country with over 1,000 fully qualified engineers.

Bord Gais Energy - Leading energy supplier in the Republic of Ireland, serving over 600,000 home gas and electricity customer accounts and 30,000 Business supply pointsOffering a 24/7 365 days-a-year Emergency Breakdown service, BGE has been servicing and repairing boilers for over 30 years. Our team of engineers will carry out over 50,000 boiler services in a year, ensuring that customers' boilers are running efficiently and safely.

Centricas Energy Marketing & Trading (EM&T) business operates in UK and European energy markets, trading in energy produced both inside and outside the business.

Centrica Storage - Our Rough gas storage facility is the largest in the UK, able to meet approximately 10% of the UK's winter peak day demand and representing more than 70% of the UK's current storage capacity.

Hive is a British Gas innovation creating connected products designed to give people the control they want for their homes, anytime, anywhere. Not a HIVE Database6

CENTRICA - BRITISH GAS

UKs leading energy and home services provider

More than 11 million homes and businesses choose British Gas and depend on us to meet their energy needs

National network of trusted British Gas engineers

Developed innovations Hive App - Honeycomb IoT Platform

Smart metering to all our customers by 2020


#Honeycomb platform innovations allowed apps Open source 7

SMART METERINGRocking the World of Big Data at Centrica

#BRITISH GAS INFORMATION SYSTEMS

Provides application development, design, physical infrastructure and architecture for entire organization

Impacts Centrica at every level

Our innovations make our customers lives simpler

Led Big Data (Hadoop) innovation in British Gas Rocking the World of Big Data at Centrica

#

9

BACKGROUND WHY DO THIS?

You have to think of how the traditional SQL-based answers cant really cope with joining the structured and unstructured data together for a unified view of your customers. In this new paradigm of IoT [Internet of Things] and devices you need to go beyond that.

- Daljit Rehal, Strategic Systems Director Rocking the World of Big Data at Centrica

#BACKGROUND WHY DO THIS?

Creation of a single view of a customer

High costs for development and infrastructure in upgrading existing platforms to host more data and alleviate bottlenecks

Data loading issues from source into underlying data analytics, MI and reporting platforms

Turnaround time and cost for delivering new data to the business was high

System landscape was complicated and could not sustainably integrate and exploit new and growing data volumes


#Traditional platforms old school Cost of development star schema/deisgn/ in flexible design (ODS) 11

Slide 12

BACKGROUND COMPLICATED ESTATE?

#12Text slide, with title and body text [from Slide Master]This slide exists as a Slide Master and all type specifications and graphic elements are fixed. Simply type into the prompt boxes.The layout is set as a Title Box and Text Box within the Text Box there are five levels of type:Level 1 Body text set in Arial Regular (18pt on 24pt linefeed) with 0.3 line space below each paragraph.Level 2 Bulleted body text set in Arial Regular (18pt on 24pt linefeed) with 0.3 line space below each paragraph.Level 3 Bulleted body text (using a horizontal dash) set in Arial Regular (16pt on 20pt linefeed) with 0.3 line space below each paragraph.Level 4 Bulleted body text set in Arial Regular (15pt on 18pt linefeed) with 0.3 line space below each paragraph.Level 5 Bulleted body text (using a horizontal dash) set in Arial Regular (14pt on 17pt linefeed) with 0.3 line space below each paragraph.Within standard body text, subheads are set in Arial Bold at the same size as the body text. Subheadings should not use different colouring or style attributes.While the text position is fixed, the text box will grow as you enter further content in the slide therefore, care should be taken to keep within the present text box margins.

Advancing through the text levelsTo advance to each text level from the previous one you can use the Increase Indent and Decrease Indent buttons on the Formatting toolbar in PowerPoint.

Footer detailsFooter details appear in the bottom-left corner of the slide and appear in fixed positions and order. Editing of Footer details is done by accessing Header and Footer under the View menu in PowerPoint.

IN THE BEGINNING


NodeNodeNodeNodeNodeNodeNodeNodeNodeNode

#Built relationships with local universities higher degree lecture to under grads collaborations 13

IT DOESNT GET MUCH SEXIER THAN THIS.DOES IT? Rocking the World of Big Data at Centrica

#WHY HORTONWORKS?

100% Open Source commitment

Relationship / Partnership

Strong alliances with our strategic partners, such as SAP / HP

Open, Honest, Flexible Culture

Value


#Tied in support 15

HADOOP (HDP) ITS A MATURE TECHNOLOGY

Operational BAU for 18 months +

Large user community

Variety of use cases

Successful platform migrations & upgrades

Vendor relationships progressed/partnerships

HDF use cases


#Now rolling out HDF, especially in SMART infrastructure area / Rev R / SAS 16

How well did we do? Rocking the World of Big Data at Centrica

#TYPICAL BILL BEFORE Rocking the World of Big Data at Centrica

#SMART ENERGY REPORT AFTER Rocking the World of Big Data at Centrica

#SER Ability for customer to actively manage their consumption 19

ENGINEERS VIEW BEFORE Rocking the World of Big Data at Centrica

#Describe as problem equipped about the task they were about to preform but not about the customer themselves.

Whether the customer had special needs etc. 20

ENGINEERS VIEW NOWRocking the World of Big Data at Centrica

#Engineers have more insight of their customers 21

ENGINEERS VIEW NOW Rocking the World of Big Data at Centrica

Engineers can see what complaints have gone before them to drive excellent and focussed serviceAnd engineers can now generate immediate leads based on discussions with the customers

#DASHBOARDS BROKEN PROMISE Rocking the World of Big Data at Centrica

#MSOP Dashboard Regulatory Dashboard (Metering Standards Of Performance) Helps us to track Broken Appointments clear MSOP payments in time.We have access to over 9 Billion data items (& growing) and over 170 SAP tables and build on the Hadoop Data Lake Big Data in action! Refer back to MI on slide 18..Broken Promise Ensures we compensate customers correctly, whilst providing insight into customer experience 23

DASHBOARD SMART METER INSTALL Rocking the World of Big Data at Centrica

#Smart Meter install dashboard - Meter installs by geographical locationIncluding country, county, Region, MP Constituency, Electricity region, Meter Type ======================================================Each of these dashboards would have been 100s BO reports. 24

EXAMPLE CUSTOMER TESTIMONIALSMI all in one place. Will help ensure our customers have an amazing experience when they call BGSM Central Hub Expert

Has given us the capability to profile & visualise over 1 years worth of Half Hourly energy usage from the UK view right down to individual meter points - Senior Commercial Manager (Analytics)

This report has delivered a view of our smart appointment channels that we simply didnt have before. We can see each day & each hour how we are performing and adjust our strategy accordingly. - Customer Experience Manager

Removed 3 databases, 5 reports and delivered a single view of the truth for BGSM field KPIs simplifying our MI estate for maintenance and for our customer Smart MI business partner


#AWARD WINNING Rocking the World of Big Data at Centrica

#Sponsor people to do PHD research Many more are coming.

26

HOW DO WE DO BIG DATA?

Agile

Continuous Integration

Continuous Testing

Continuous Delivery

DevOps


#DEVOPS WHAT IS IT?

Its a Methodology?

Its a Culture?

Its a Movement?

Its a Practice?

Its a Salary Bracket?

Its like true love, youll just know?


#DEVOPS THE EQUATION

DevOps = Time EfficiencyRocking the World of Big Data at Centrica

#Dev to Operations time 29

FUTURE

Success breeds success

Collaboration across our brands

Cloud

Physical Data Centre's Stretch & OffloadManage cost


#THE SECRET TO OUR SUCCESS

The data strategy was driven from C-Level with strong leadership and vision from the Strategic Director.

Big Data is not only a technological revolution its an organization and cultural challenge.

To ensure success you need to challenge the status-quo and inspire people to do things betterRocking the World of Big Data at Centrica

#BIG DATA ARE YOU READY FOR THE CHALLENGE?

Change has a considerable impact on the human mind

To the fearful it is threatening because it means things may get worse

To the hopeful it is encouraging because things may get better

To the confident it is inspiring because the challenge exists to make things better

- Whitney Young


#Have you got leadership / culture to do this? \750,000 initial hardware 1.8 million 2 years Legacy/traditional platformData quality issues 32

Date post:	06-Jan-2017
Category:	Technology
Upload:	hadoop-summit
View:	458 times
Download:	0 times