+ All Categories
Home > Documents > Appendices: Introduction to Business Intelligence DATE.

Appendices: Introduction to Business Intelligence DATE.

Date post: 29-Dec-2015
Category:
Upload: aileen-lambert
View: 212 times
Download: 0 times
Share this document with a friend
Popular Tags:
14
Appendices: Introduction to Business Intelligence DATE
Transcript
Page 1: Appendices: Introduction to Business Intelligence DATE.

Appendices: Introduction to Business Intelligence

DATE

Page 2: Appendices: Introduction to Business Intelligence DATE.

Current landscape Solution Architecture

APPENDIX A

Page 3: Appendices: Introduction to Business Intelligence DATE.

Current Architecture - LIME

Page 4: Appendices: Introduction to Business Intelligence DATE.

Target Architecture - LIME

Page 5: Appendices: Introduction to Business Intelligence DATE.

Current Architecture - Bahamas

Page 6: Appendices: Introduction to Business Intelligence DATE.

Target Architecture - Bahamas

Page 7: Appendices: Introduction to Business Intelligence DATE.

EDS scope and roadmap

APPENDIX B

Page 8: Appendices: Introduction to Business Intelligence DATE.

Phase 1• Comverse SLU CDRs: Voice, SMS, MMS, content, mobile data• Liberate unbilled (preload) and billed Itemized Messages (IMs).• Archived Liberate IMs: 18-24 months billed IMs

Phase 2• Network raw CDRs (i.e. fixed and mobile).• Network DPI data (mobile data usage detail)• Archived Comverse call history records• Archived RTBS call history records (offload of legacy reporting

DB)

Phase 3 (possible candidates)• Portal and self-service app activity logs• LIMEWare and Gateway logs• Radio network probe data (radio coverage and quality KPIs)

Event Data Store –Phasing of data sources

Introduction to Business Intelligence | Appendix B8

EDS will store up to 7 years detailed usage online for search and queries

Page 9: Appendices: Introduction to Business Intelligence DATE.

To meet the full set of EDS requirements, and to standardize on a technology approach, we are leveraging a fully-integrated Apache stack comprising Cassandra, Hadoop and Hive.

Cassandra provides the underlying resilient and fast database storage, Hadoop provides the bulk-analytics and search, with Hive providing the SQL Layer.

Selected Solution from Cartesian/TMNG

This cost-effective approach reduces risk by using some of the most popular deployed open-source Big-Data technologies available.

Introduction to Business Intelligence | Appendix B9

Page 10: Appendices: Introduction to Business Intelligence DATE.

EDS - Integration Architecture

Digital Route’s Mediation Zone provides the mediation layerArchitectural approach permits easy extension for further data sources such as mobile data usage and raw network CDRsEDS is deployed in Virtacore

EDS versus ODSEDS keeps full record contents whereas ODS takes stripped down record setsEDS keeps records for up to 7 years, whereas ODS keeps usage detail for 3 months and then summarisesODS produces regular reports & KPIs

cmp Target Arch

Comv erse ONE RT+ (Charging & Balance Mgmt)

Mediation Zone (ETL)

CIS (CRM & Billing) Insight (DWH) Business Objects (Self-Serv ice Reporting)

Ev ent Data Store

ODS/EDW

4a. CIS Reference Data

«flow»

3c. Postpaid IMs

«flow»

1c. CDRs «flow»

JCC

2a. DWH,MTR, RECH

«flow»

3a. Postpaid IMs(Unbilled, Bil led)

«flow»

1a. CDRs

«flow»

1b. CDRs

«flow»

1d. CDRs

«flow»

2b. DWH,MTR, RECH

«flow»

2c. DWH,MTR, RECH

«flow»

2d. DWH «flow»

3b. Postpaid IMs

«flow»

4b. CIS Ref. Data

«flow»

Introduction to Business Intelligence | Appendix B10

Page 11: Appendices: Introduction to Business Intelligence DATE.

Data Storage: Datastax and HDFSTo improve data storage capacity per node and reduce cost a parallel data store is to be configured next to each Datastax data store.

This data store will not be a part of the Datastax storage limit of 4TB and can provide another 4TB of storage per node. (Before replication and compression)

Datastax provides job and task scheduling for each node. Regardless of the data store. Therefore Datastax is required on each node. (Datastax controls what tasks the processors should be working on)

Concurrent tasks will impact performance. No nodes are reserved for Real-Time searches

Ascertain EDS Nodes

Ascertain

Web Interface Job Controller

Analytics Controller

8 Cores32GB Ram1TB Disk

Ascertain

MetaData2 Cores16GB Ram120GB Disk

Node 14TB Disk

DataStax

Real Time &Analytics

4TB Disk

Node 24TB Disk

DataStax

Real Time &Analytics

4TB Disk

Node 34TB Disk

DataStax

Real Time &Analytics

4TB Disk

Node 44TB Disk

DataStax

Real Time &Analytics

4TB Disk

Node 54TB Disk

DataStax

Real Time &Analytics

4TB Disk

Node 64TB Disk

DataStax

Real Time &Analytics

4TB Disk

HDFS StoreCassandra Store

&Job/Task Trackers for

each node

HDFS

HDFS

HDFS

HDFS

HDFS

HDFS

Each node contains Datastax controller

software, Datastax Data store (Cassandra) and a HDFS data store

HDFS Store is controlled by the Datastax

Job/Task Trackers. Datastax ‘OpsCenter’

will track running map reduce tasks on either

store

Datastax software is required on each node

for the node to contribute to processing

requests

Introduction to Business Intelligence | Appendix B11

Page 12: Appendices: Introduction to Business Intelligence DATE.

Searches and Queries

Introduction to Business Intelligence | Appendix B12

Page 13: Appendices: Introduction to Business Intelligence DATE.

Extended Search Screen Shot

Page 14: Appendices: Introduction to Business Intelligence DATE.

Phase 2 Architecture

Introduction to Business Intelligence | Appendix B14


Recommended