AN INTRODUCTION TO BIG DATA

BYB.M.BRINDA

AP/IT

What is Big Data? Is it a single data ? – No Collection of large and complex data

sets

DEFINITIONA massive volume of both structured and unstructured data that is so large that it's difficult to process using traditional database and software techniques.

It includes Capture Storage Search Sharing Transfer Analysis Visualization.

Big data originates fromSpace Science Science & ResearchIndustries & MarketingGovernment & Private SectorInternet & Social Networks

Example Petabytes (1,024 terabytes) Exabyte (1,024 petabytes) of data

consisting of billions to trillions of records of millions of people

SOURCES OF BIG DATA

EXAMPLESRFIDsensor networkssocial networksbig social data analysis Internet documents Internet search indexingcall detail records atmospheric science genomics biogeochemicalbiologicalscientific researchmilitary surveillancemedical records photography archivesvideo archiveslarge-scale e-commerce etc..,

BIG DATA VECTORS (3V’S)Big Data are high-volume, high-velocity,

and/or high-variety information assets that require new forms of processing to enable enhanced decision making, insight discovery and process optimization.

Big Data CharacteristicsVolumeVelocity Variety

Big Data Characteristics High-Volume

amount of data

High-Velocity Speed rate in collecting or acquiring or

generating or processing of data

High-Variety different data type such as audio, video, image

data (mostly unstructured data)

Big Data Characteristics (Contd.)

Big Data - Support

OLTP: Online Transaction Processing (DBMSs)OLAP: Online Analytical Processing (Data Warehousing)RTAP: Real-Time Analytics Processing (Big Data Architecture & technology)

OPEN SOURCE TOOLSwww.bigdata-startups.com

THANK YOU

QUERY?