Asynchronous Data Processing

Post on 15-Apr-2017

610 views 0 download

transcript

 www.anant.us | solutions@anant.us | 202.905.28181010 Wisconsin Ave, NW | Suite 250 | Washington, DC 20007 

Services & Messages

Asynchronous Data Processing

What do we do?

Streamline, Organize & Unify Business Information

Agenda

•Challenge - Why does this matter?•Old vs. New - Async is the Future•Methods - Batch, Mic-Batch, Stream•Queue/Bus/Actors - What and how• Ideas - Open Discussion

Challenge – Why does this matter?

Information Overload

Challenge – Why does this matter?

Knowledge = Decisions

Old vs. New – Sync vs. Async

The current thinking is that the state of the systems in an enterprise are synchronous and that analysis must be done sequentially, iteratively from beginning to end in batch.

Old vs. New – Sync vs. Async

The new thinking is that the state of the systems in an enterprise are dynamically asynchronous and that there is no “state” at a particular time but rather a stream of events.

Current - Processing TechnologiesBatch processing , micro-batch processing, and stream processing are different ways to do things. 

BATCH

● Has all the Data● Throughput● Latent ● Complexity is

crushed by computing power

● Synchronous● Computing is King

MICRO

● Computes on small samples

● Has Access to Data

● Halfway● Semi-

Synchronous● Computing +

Workflow

STREAM

● Computes one thing at a time

● Or small sample

● Near Real Time● Independent

Operations● Asynchronous● Workflow is

King

STREAM PROCESSING

MICRO BATCHINGBATCHING

Queue / Bus / Actor – What / HowLet’s talk about what these technologies offer us. 

Ideas – Open Discussion

Questions & Contact

 www.anant.us | solutions@anant.us | 202.905.28181010 Wisconsin Ave, NW | Suite 250 | Washington, DC 20007 

@anantcorp

facebook.com/anantCorp

linkedin.com/company/anant

rahul@anant.uslinkedin.com/in/xingh

Rahul SinghCEO & Founder

Questions & Contact

• Brown Bag Session or Meetup?• Modern Enterprise• Mastering Services in the Service of Others• Hybrid Agile Project Management• Building Search Engines• CICD / DevOps• Connecting Internet Software

 www.anant.us | solutions@anant.us | 202.905.28181010 Wisconsin Ave, NW | Suite 250 | Washington, DC 20007 

Streamlined DataIntegration / Data PipelinesOrganized Knowledge

Search / Data WarehousesUnified Interfaces

Portals / Dashboards / Mobile