+ All Categories
Home > Documents > Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency)...

Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency)...

Date post: 15-Oct-2020
Category:
Upload: others
View: 0 times
Download: 0 times
Share this document with a friend
48
Messages (and the geeks who love them) Toby DiPasquale | Invite Media, Inc.
Transcript
Page 1: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Messages(and the geeks who love them)

Toby DiPasquale | Invite Media, Inc.

Page 2: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple
Page 3: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Deferred Processing

Page 4: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Work Partitioning

Page 5: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Fault Tolerance

Page 6: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Component Isolation

Page 7: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple
Page 8: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

~150

Page 9: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple
Page 10: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Synchronous

Page 11: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Asynchronous

Page 12: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Point-to-point

Page 13: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Publish/subscribe

Page 14: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Store-and-forward

Page 15: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple
Page 17: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Store-and-forward

Page 18: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Ubiquitous (even more so than HTTP)

Page 19: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

High latency

Page 22: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Enterprise-y

Page 23: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Fast, low-overhead

Page 24: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

‣ Point-to-point

‣ Publish/subscribe (topics)

‣ Store-and-forward

Page 27: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

‣ Point-to-point

‣ Publish/subscribe

Page 28: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Built-in presence and location

Page 29: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Easily extensible

Page 30: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

AMQP > XMPP(vis a vis wire efficiency)

Page 33: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Store-and-forward

Page 34: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Memcached protocol

Page 35: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Simple and simplistic

Page 37: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Store-and-forward

Page 38: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Internet scale

Page 39: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

High latency

Page 40: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Invisibility

Page 42: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple
Page 43: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Video Encoding

Page 44: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Temp Store

video uploads

Temp Store

video uploads

Temp Store

video uploads

Encoder

Encoder

Encoder

Encode Queue

encode jobs

Final Store

Final Store

Final Store

encode jobs

CopyQueue

copy jobs

copy jobs

SQS

Page 45: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Twitter

Page 46: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple
Page 47: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Web

IM

Ingress

Ingress

Ingress

Mbox

Mbox

Mbox

Graph

Graph

SMS

User data

Tweets

Page 48: Messages - cbcg.netcbcg.net/talks/Messaging-NYCrb.pdf · AMQP > XMPP (vis a vis wire efficiency) xmpp4r(-simple) ejabberd djabberd. Store-and-forward. Memcached protocol. Simple

Thanks!


Recommended