The New Tech Stack for Devices and Their Apps
Ryan Tabora Senior Data Engineer
February 2014
CONFIDENTIAL |
What is Device Data?
!2
Customers Home Base
Parser
Parser
Parser
System of
RecordETL Data Access
CONFIDENTIAL | !3
Reference Architecture
CONFIDENTIAL | !4
Ingestion Technologies
Storm
kinesis
Log Aggregation Streaming Bulk Import/ETL
CONFIDENTIAL |
Data Stores
!5
redshift
Core Storage Classic NoSQL Search Oriented MPPs
dynamodb
CONFIDENTIAL |
Data Transformation Technologies
!6
Pig
Batch Faster-than-batch