+ All Categories
Home > Technology > Integrating Systems in the Cloud using Message Queuing

Integrating Systems in the Cloud using Message Queuing

Date post: 21-Nov-2014
Category:
Upload: stormmq
View: 2,893 times
Download: 1 times
Share this document with a friend
Description:
Integrating Systems in the Cloud using Message QueuingSlides for talk given at EuroCloud Ireland 2010.
46
Integrating Systems in the Cloud [email protected] 1
Transcript
Page 2: Integrating Systems in the Cloud using Message Queuing

The Integration Tag Soup

WS – File Transfer

!"#$%&'(#)#*#+%+

Message QueuingSOAP

EMail

SMTP

FTP

RSYNC

NTFS

!','-

!).$%&'/$.0%&1$%+

234%5)6!%$7%$

SOAMessage

OrientatedMiddleware

JMS

MQ

MQSeries

AMQP

Amazon SQS

Tibco

StormMQ

RabbitMQ

HTTP

TCP/IPDCE / RPC

CORBA

DCOM

REST

RMIXML-RPC

.NET Remoting

Remote Procedure Call

XML-RPC

2

Page 3: Integrating Systems in the Cloud using Message Queuing

The Integration Tag Soup

WS – File Transfer

!"#$%&'(#)#*#+%+

Message QueuingSOAP

EMail

SMTP

FTP

RSYNC

NTFS

!','-

!).$%&'/$.0%&1$%+

234%5)6!%$7%$

SOAMessage

OrientatedMiddleware

JMS

MQ

MQSeries

AMQP

Amazon SQS

Tibco

StormMQ

RabbitMQ

HTTP

TCP/IPDCE / RPC

CORBA

DCOM

REST

RMIXML-RPC

.NET Remoting

Remote Procedure Call

XML-RPC

2

Page 4: Integrating Systems in the Cloud using Message Queuing

Under Examination, though

File Transfer

!"#$%&'(#)#*#+%+

Remote Procedure Call

Don’t Work in the Cloud

3

Page 5: Integrating Systems in the Cloud using Message Queuing

Under Examination, though

Deployment

Intimate System Knowledge

Configuration

Admin

File Transfer

!"#$%&'(#)#*#+%+

Remote Procedure Call

Don’t Work in the Cloud

Scaling

3

Page 6: Integrating Systems in the Cloud using Message Queuing

Ideal: Message Queuing

Systems are “loosely-coupled”

MessageQueuing

Systems don’t know each other

4

Page 7: Integrating Systems in the Cloud using Message Queuing

Why Use it: Loose Coupling

BillingCatalogue

Shipping S-a-a-S Inventory

How do we connect them, without one outage or system change taking everything down like a pack of cards?

5

Page 8: Integrating Systems in the Cloud using Message Queuing

Why Use it: Loose Coupling

BillingCatalogue

Shipping S-a-a-S Inventory

How do we connect them, without one outage or system change taking everything down like a pack of cards?

Message Queuing lets Systems and Components exchangedata, events, commands and actions with one another

with no explicit knowledge or need for them to be online

5

Page 9: Integrating Systems in the Cloud using Message Queuing

It should be ideal for the cloud

6

Page 10: Integrating Systems in the Cloud using Message Queuing

It should be ideal for the cloud

6

Page 11: Integrating Systems in the Cloud using Message Queuing

!!!Until today, messaging is …

(ZeroMQ)

(SQS uses HTTP)

(MSMQ uses COM)

(memcached)

(Java JMSuses

Source)

(MQSeries / WebsphereMQ)

(Talarian, Rendezvous, etc)

Platform Restricted BespokeProprietary

7

Page 12: Integrating Systems in the Cloud using Message Queuing

!!!Until today, messaging is …

(ZeroMQ)

(SQS uses HTTP)

(MSMQ uses COM)

(memcached)

(Java JMSuses

Source)

(MQSeries / WebsphereMQ)

(Talarian, Rendezvous, etc)

7

Page 13: Integrating Systems in the Cloud using Message Queuing

However, there’s a solution

8

Page 14: Integrating Systems in the Cloud using Message Queuing

A-MQPAdvanced Message Queue Protocol

However, there’s a solution

8

Page 15: Integrating Systems in the Cloud using Message Queuing

AMQP is Open and Neutral

A common wire-level binary format and protocol

An explicit definition of a server (aka broker)’s

semantics

Open Means

Interoperable

“AMQP will be to Messaging what HTTP was to the Web”

9

Page 16: Integrating Systems in the Cloud using Message Queuing

That is good …

“And it works perfectly in the cloud”

MRG

Clients run on any Platform Vendors are Interoperable

10

Page 17: Integrating Systems in the Cloud using Message Queuing

That is good …

“And it works perfectly in the cloud”

MRG

Clients run on any Platform Vendors are Interoperable

64K

10

Page 18: Integrating Systems in the Cloud using Message Queuing

From Anywhere to Anywhere

11

Page 19: Integrating Systems in the Cloud using Message Queuing

From Anywhere to Anywhere

11

Page 20: Integrating Systems in the Cloud using Message Queuing

From Anywhere to Anywhere

11

Page 21: Integrating Systems in the Cloud using Message Queuing

From Anywhere to Anywhere

11

Page 22: Integrating Systems in the Cloud using Message Queuing

From Anywhere to Anywhere

11

Page 23: Integrating Systems in the Cloud using Message Queuing

Instant Cloud Architecture

12

Page 24: Integrating Systems in the Cloud using Message Queuing

Instant Cloud Architecture

Cloud Service

Managed Service

On-Site Service

No-Lock™ Option

Locate-It™ Option

Real SLA

12

Page 25: Integrating Systems in the Cloud using Message Queuing

Instant Cloud Architecture

Self-Configure: REST API

Cloud Service

Managed Service

On-Site Service

No-Lock™ Option

Locate-It™ Option

Real SLA

Any Programming Language

Secure by Default

Isolated Environments

12

Page 26: Integrating Systems in the Cloud using Message Queuing

Store and Forward

Billing

“Could you send me a duplicate of my bill please”

REST

14

Page 27: Integrating Systems in the Cloud using Message Queuing

Store and Forward

Billing

“Could you send me a duplicate of my bill please”

REST !14

Page 28: Integrating Systems in the Cloud using Message Queuing

Store and Forward

Billing

“Could you send me a duplicate of my bill please”

REST

StormMQMessaging

Billing

!14

Page 29: Integrating Systems in the Cloud using Message Queuing

Store and Forward

Billing

“Could you send me a duplicate of my bill please”

REST

StormMQMessaging

Billing

!!14

Page 30: Integrating Systems in the Cloud using Message Queuing

Store and Forward

Billing

“Could you send me a duplicate of my bill please”

REST

StormMQMessaging

Billing

!14

Page 31: Integrating Systems in the Cloud using Message Queuing

Fire and Forget

Shipping

“Too many orders. The website is running like a dog.”

SQL Push SQL Pull

15

Page 32: Integrating Systems in the Cloud using Message Queuing

Fire and Forget

Shipping

“Too many orders. The website is running like a dog.”

SQL Push SQL Pull

StormMQMessaging

Shipping

15

Page 33: Integrating Systems in the Cloud using Message Queuing

One-To-Many

“There’s a new widget in the Catalogue: Tell all the systems.”

CatalogueShipping

S-a-a-S Inventory

File Transfer

ETL

16

Page 34: Integrating Systems in the Cloud using Message Queuing

One-To-Many

“There’s a new widget in the Catalogue: Tell all the systems.”

CatalogueShipping

S-a-a-S InventoryStormMQMessaging

16

Page 35: Integrating Systems in the Cloud using Message Queuing

Publish-Subscribe (“Topics”)

“Shipments Sent, Delivered and Returned”

Shipping

S-a-a-S InventoryBilling

AnySentSent or Returned

17

Page 36: Integrating Systems in the Cloud using Message Queuing

StormMQMessaging

Publish-Subscribe (“Topics”)

“Shipments Sent, Delivered and Returned”

Shipping

S-a-a-S InventoryBilling

AnySentSent or Returned

17

Page 37: Integrating Systems in the Cloud using Message Queuing

Round-Robin

Billing

“How do we easily scale a massive batch job like Billing?”

EMail BillGenerate

18

Page 38: Integrating Systems in the Cloud using Message Queuing

StormMQMessaging

Round-Robin

Billing

“How do we easily scale a massive batch job like Billing?”

EMail BillGenerate

18

Page 40: Integrating Systems in the Cloud using Message Queuing

A History of Messaging

Manual Telegraphy Machine Assisted Telegraphy

1920s1911 - 192019th Century 1900s

Telegrams sent using“Store and Forward”

1900

1930s

22

Page 41: Integrating Systems in the Cloud using Message Queuing

A History of Messaging

Electronic Telegraphy

1950s1940s1950s1940s

Electronic Telegram Machines, eg Plan 55-A

1948

IBM System/360 with BTAM & QTAM

Message Switching

Machine Assisted Telegraphy

1920s1911 - 1920 1930s

22

Page 42: Integrating Systems in the Cloud using Message Queuing

A History of Messaging

Telcos UseElectronic Telegraphy

1950s1940s 1960s

IBM System/360 with BTAM & QTAM

Message Switching

1964

First Electronic Mail Solutions

1965

Banking Users

1970s

IBM TCAM which is the first true solution

Retired 1990!

1971

Machine Assisted Telegraphy

22

Page 43: Integrating Systems in the Cloud using Message Queuing

A History of Messaging

First Electronic Mail

Financial Trading UsersBanking Users FMCG & Utilities

1980s 1990s

Growth of SMTPOrigins of Tibco in

Stock Price Messaging

1980s

IBM Launch MQSeries(now WebsphereMQ)

1992

1970s

IBM TCAM which is the first true solution

Retired 1990!

1971

Machine Assisted Telegraphy

22

Page 44: Integrating Systems in the Cloud using Message Queuing

A History of Messaging

First Electronic Mail

FMCG & Utilities

1990s

IBM Launch MQSeries(now WebsphereMQ)

1992

Machine Assisted Telegraphy Corporates Large Websites YOU

Noughties Today

Sun Release Java JMS, Reinvigorating

Enterprise Messaging

2001

AMQP Working Group Formed by Investment Banks

2006

Cloud Enables and Drives StormMQ

Adoption

2009

22

Page 45: Integrating Systems in the Cloud using Message Queuing

Jargon Buster: Messaging

EMail(SMTP, POP3, IMAP)

VoIP(VoiceMail, XMPP)

Texting(SMS)

Instant Messaging(ICQ, MSN, Jabber)

Twitter

Enterprise Service Bus(ESB)

Dynamic OO Languages(eg Ruby)

Message Queuing(MQ)

Message Queuing(MQ)

What do wemean by

Messaging?

23

Page 46: Integrating Systems in the Cloud using Message Queuing

Essential Terms

Message Queue What’s a Message?

Envelope

Payload

Header

24


Recommended