25
Lior Nabat, CTO E-mail:[email protected] The Need for: Kubernetes Native Message Queue Broker Twitter:@lior_nabat
Lior Nabat, CTO E-mail:[email protected]
The Need for:Kubernetes Native Message Queue Broker
Twitter:@lior_nabat
2www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
MQ
- Decoupling creates potential for massive amount of connections- Point to Point- No Multicast- No Queuing
The need for messaging in Kubernetes
4 services12 connections
8 services56 connections
8 services, 8 connections
Direct connection (such as HTTP/REST) With message queue
3www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
The need for Kubernetes Native message queue (1)
• Robust messaging queue system
• Secured system
• Low DevOps maintenance
• Well-connected ecosystem for all Kubernetes services
• Rapid development and deployment
Kubernetes effectiveA messaging system cannot be effective if it is not native to Kubernetes. Enterprises must ensure that when implementing a message queue system, it is native to Kubernetes to leverage the advantages:
4www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
Ease of Use A message queue system in microservices architecture can save time, money, as long as it is super easy to use in Kubernetes
The need for Kubernetes Native message queue (2)
• Dedicated IT experts is not needed
• Unifies operation workflows and development
• Saves costs
5www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
The need for Kubernetes Native message queue (3)
• Security
• Double traffic
• Additional environment maintenance
• Additional operational overhead
• Enable ability to serve edge and small clusters
Integrated in the Kubernetes cluster and to the edgeUse the message queue inside the K8S cluster to avoid issues of
6www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
Cloud native integration
Cache Connector KubeMQ
Queues
EventsEvents Store
Commands Queries
SQL Connector
NoSQL Connector
Storage Connector
Search Connector
The need for Kubernetes Native message queue (4)
7www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
The need for Kubernetes Native message queue (5)
• Multi-stage pipeline
• Task / Job Distributed Queue
• Streaming data workflows
• Pub/Sub in real time
• Application decoupling - microservices
Use casesSupporting most common use cases of the messaging in Kubernetes
8www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
Multistage Data Processing Pipeline
12www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
Application decoupling / Microservices
14www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
Let’s look on Users domain
Register Create a user and get verification code
Verify Send verification code and activate user account
Login Login with credentials
Logout Logout from user account
15www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
SQL Connector
Search Connector
Cache Connector
Kibana
Web API
The Setup
Monitor Point
Monitor Point
Monitor Point
16www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
SQL Connector
Search Connector
Kibana
Web APINotification Event
History Event
Users Query
Register Flow
17www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
SQL Connector
Search Connector
Kibana
Web APIHistory Event
Users Command
Verify Flow
18www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
SQL Connector
Search Connector
Cache Connector
Kibana
Web APIHistory Event
Users Query
Cache Commands / Query
Login Flow
19www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
SQL Connector
Search Connector
Cache Connector
Kibana
Web APIHistory Event
Users Query
Cache Commands / Query
Logout Flow
20www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
Users Service
History Service
Cache Service
Kibana
Web API
Let’s See Some Errors
21
www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
Migration to microservices environment
Companies with legacy IT infrastructure need
to gradually migrate to microservices or start
building new components separately.
Using a bridge to provide connectivity
between legacy on-prem monolithic and new
microservices architecture
This bridging capability enables gradual
migration by implementing a step-by-step
replacement of components from the old
environment or the creation of new services
that can still connect with the legacy
resources.
23www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMq
Migrating Financial Based app from MSMQ to Kubernetes
25www.kubemq.ioLior Nabat, CTO [email protected] Twitter: @KubeMqLior Nabat, CTO
KubeMQ is an enterprise grade message broker for Kubernetes
VISIT US AT: www.kubemq.ioCONTACT US AT: [email protected]
Thank you
![Middlesex University Research Repository · 2019. 11. 8. · 2.1. The Message Queue Telemetry Transport (MQTT) Protocol As stated in Reference [3], the Message Queue Telemetry Transport](https://static.documents.pub/doc/80x56/6018d4d3346b180b532e106c/middlesex-university-research-repository-2019-11-8-21-the-message-queue-telemetry.jpg)
![[MS-MQOD]: Message Queuing Protocols Overview... · The queue is the central abstraction in Microsoft Message Queuing (MSMQ). Applications send messages to a queue and/or receive](https://static.documents.pub/doc/80x56/5fe312b0ddd9b00a9379bb52/ms-mqod-message-queuing-protocols-overview-the-queue-is-the-central-abstraction.jpg)
