© 2013 SpringOne 2GX. All rights reserved. Do not distribute without permission.

Tackling Big Data Complexity With Springwith Mark Fisher, Mark Pollack, Adam Zwickey

WEB

Controllers, REST,WebSocket

INTEGRATION

Channels, Adapters,Filters, Transforms

BATCH

Jobs, Steps,Readers, Writers

BIG DATA

Ingestion, Export,Orchestration, Hadoop

DATA

NON-RELATIONALRELATIONAL

CORE

GROOVYFRAMEWORK SECURITY REACTOR

GRAILS

Full-stack, Web

XD

Stream, Taps, Jobs

BOOT

Bootable, Minimal, Ops-Ready

S P R I N G I O E X E C U T I O N :

Spring XD

Agenda• Big Data Landscape• Spring XD Features and Architecture• Deep dive into modules• Taps• Analytics• Jobs• Big Juicy Demo – Retail Fraud Detection• Runtimes• Resources

Spring XD – Features

• Unified Platform• Developer Productivity• Modular Extensibility• Distributed Architecture• Portable Runtime • Hadoop Distribution Agnostic• Proven Foundation

Spring XD

TapsCompute

HDFS

Workflow Export

Spring XD Runtime

Inge

st

Jobs

Export

Files Sensors Mobile Social

RDBMS

NoSQL

R, SAS

Spring XD Shell

Streams

Redis

Gemfire

Predictive modeling

Stream Processing Model

How can we make this easier?http | filter | file

Single Node

Distributed Mode

D I S T R I B U T E D

Demo

Taps

TA P

Demo

Analytics• https://github.com/spring-projects/spring-xd/wiki/Analytics

A N A LY T I C S

Demo

Jobs• https://github.com/spring-projects/spring-xd/wiki/Batch-Jobs

J O B S

Demo

F R A U D D E T E C T I O N

Demo

XD Runtimes

http | filter | file

Rabbit, Redis, (Pluggable)

XD Admin

CLUSTERED NODE

FilterModule

CLUSTERED NODE

HTTPModule

CLUSTERED NODE

FileModule

In MemoryTransport

http | filter | file

SINGLENODE

AllModules

Portable Runtimes

CLOUDFOUNDRY

AWS

GEMFIRE YARN

SIMPLECLUSTER

Spring YARN• http://bit.ly/spring-yarn-blog

Resources• Project: http://projects.spring.io/spring-xd/ • Issues: https://jira.springsource.org/browse/XD• GitHub: https://github.com/spring-projects/spring-xd/• Wiki: https://github.com/spring-projects/spring-xd/wiki • Blogs:

– https://spring.io/blog/2013/06/12/spring-xd-1-0-milestone-1-released/– https://spring.io/blog/2013/08/14/spring-xd-1-0-milestone-2-released/

• Release 1.0 M3 (just now)– http://bit.ly/spring-xd-m3-release

RELATED SESSIONS

Real Time Analytics with Spring