34
© Copyright IBM Corporation 2016 Introduction to the MQ Appliance Mark Taylor [email protected] IBM Hursley
Overview
• The scalability and security of IBM MQ in a physical appliance form factor• Rapid, reliable, simple, secure exchange of data across applications, systems and services
• Convenience, fast time-to-value, and low total cost of ownership of an appliance• Use as a messaging hub to extend connectivity within your enterprise, in branch offices, factories or stores
What’s in the IBM MQ Applianceü Integrates seamlessly into MQ networks and clustersü Simple out of the box High-Availability and Disaster Recovery with paired connectivity to other appliances
ü Simpler maintenance with fixpacks delivered as certified firmware updates onto a locked down applianceü Appliance delivered pre-optimized for maximum performance out-of-the-box
ü New MQ Console to provide a browser-based user interface offering personalized monitoring and configuration
General Availability: March 13th 2015
IBM MQ Appliance
2
IBM MQ Appliance offers:
Optimized solutions to meet the needs of these use casesDifferentiation compared to MQ software deployment approaches2 price points to meet different deployment-based business needs
What do you want to do?
Consolidate my MQ
infrastructure into an “MQ
Hub” for lower TCO
Deploy to remote
premises, e.g. Branch, Factory,
Warehouse
Deploy to business partner,
e.g. Dealer, Broker
3
Challenges
Mixture of platforms and versionsComplex dependenciesMigrations difficult –lack of standardizationApplication downtime impacts other applications
Consolidate MQ infrastructure into Hub for lower TCO
Objectives
Reduce TCOReduce footprintStandardise deploymentsBuild 'hub' -concentrate expertise
Benefits
Easy to deploySimplified maintenanceFamiliar administrationSeparates applications from InfrastructureSupports existing MQ definitions, concepts and security modelHA avoiding external dependencies
Challenges
Avoiding single points of failureOutside assistance needed – lack of local skills and resources
Deploy to a remote premises
Objectives
Resilient connectivity to remote locationRobust and secureFlexibility, minimal time to value at new sites
Benefits
Standardization makes ‘pre-canned’ rollout simplerRemote configuration and managementHigh availability requires no additional systems or skills
Challenges
Partner may not have MQ or MQ skills todayTime to build and deployConfiguration needs to meet our standardsDowntime directly effects business relationship
Deploying to business partner: Appliances as ‘Gateways’
Objectives
Extend connectivity to external business partner Rapid onboardingControl and limit accessQOS expectations from both parties
Benefits
Easy to deploySimplified maintenanceAbility to preconfigure a very standard system both helps ensure standards applied and speed deploymentHA avoiding external dependencies
Machine Types
• 2015 release was the M2000
• 2016 announcement of the M2001
§ High-end solution for enterprise consolidation use case§ Capable of handling large MQ workloads for persistent
and non-persistent messaging§ Host multiple Queue Managers to act as a messaging
hub§ A replacement for multiple separate MQ servers§ Built-in High Availability when paired to a 2nd appliance
and off-site disaster recovery to another Appliance§ Supports MQ AMS, and can be used to move MQ MFT
files between MFT endpoints
§ Lower-end solution for branch office or factory deployment
§ Same software and hardware as the Enterprise appliance, but processor usage limited
§ Designed to meet lower messaging throughput requirements
§ Supports all features of M2001A, including High Availability, Disaster Recovery and MQ AMS
§ Trade-up part available from M2001B capacity to M2001A capacity
IBM MQ Appliance M2001A (for Enterprise) IBM MQ Appliance M2001B (Branch etc.)
EasilydeployandmaintainMQmessaginginminutes!
Which MQ Appliance is right for you?
§ PrebuiltforHubpattern– noAppsondevice§ Noadditionalsoftwareinstallation
§ NouserExitsinMQ
§ Monitoringagentsmustberemote
§ HighAvailabilityout-of-the-box§ SingleFirmwareupdateforwholeappliance
§ Firmwareupdateinc.applianceandMQFixpack
§ Canberolledbackasansingleunit
§ Controlledadministrationenvironment§ Web,MQExplorerandMQSC/cmd-lineadminofMQ
IBMMQAppliance IBMMQV8onCustomServer
AppsTuning
MQ / Middleware
OS
Hardware
§ DIYHubor Genericserver– Apps+Middleware§ Installanysoftware
§ Build&maintainyourowncustomextensions
§ Addlocalmonitoringagents
§ NeedsHAClusterSWorNetworkStorageforHA§ Customtuningforeachlayer(OS/Middleware)§ Discretemaintenanceforeachlayer
§ MQFixpacks;OSmaintenance,securitypatchesetc.
§ GenericOSshellforlocaladministration§ MQExplorerandMQSC/cmd-lineadministrationofMQ
Key Differences with Appliance Form-factor
QM1 QM2 QM3
QM1 QM2 QM3
Fully synchronousreplication (HA) or asynchronous (DR)
• No persistent data loss on failure (HA mode)
• No external storage• No additional skills
required
• Manual control of failover for migration/maintenance
• Queue manager level active/passive (i.e. both appliances can run workload)
Designed to be configured in seconds with no external dependencies
Availability options in the MQ Appliance
IBMMQApplianceM2001• Optimizedmessaging,rightoutofthebox
• SecureyourbusinesswithHighAvailabilitybuilt-in
• LoweryourTCOwithsimplermaintenance,and
lowerdatastoragespaceandpowerrequirements
• Deploytopartnersandremotepremises,without
requiringlocalMQexpertise
IBMIntegrationBusV10• IncreasedflexibilitywithseparatedeploymentforMQ
• Installinminutes
• Newpatternstorapidlycreatemobileintegrations
• Flexibleclouddeploymentoptions
The Complete Messaging and Integration Solution
MQ Appliance key capabilities
Lets really simplify it…
AnMQApplianceisaboxwhereyoucreateandrunqueuemanagers…
Queue manager 1 Queue manager 2 Queue manager 3
ApplicationApplication
Application
ApplicationApplication
Queue manager 4
Physical configuration
2xManagement1GBEthernet(alsoIPMI)
Display(includescapacityandversioninformation)
Serial/KVMconnectionN.B.REQUIREDforinitialsetup Generalpurpose1GBEthernet
(MQApplicationtraffic)
Generalpurpose10GBEthernet(SPF+)(MQApplicationtraffic)
2x1GBEthernet:HAor generalpurpose
10GBEthernet(SPF+):HAor generalpurpose
HBA(unused)
• Combined HA and DR consumes both currently provided 10GB interfaces
• This will be addressed by replacing the 2 port NMC module with a revised adapter giving 4x10GB ports
Minimum of two spare ports available for MQ/application use – which may also be aggregated for availability and bandwidth
• 1.2 TB HDDs replaced by 3.2 TB SSDs• Same RAID 1 configuration
Notes:1. A and B capacity (CPU) options will remain as today2. Customers with M2000 models – contact IBM sales
representative for migration options.
Initial results show up to around 3x performance improvement for some (heavily persistent) messaging workloads
Hardware Update (‘M2001’)
M 2 0 0 0 ( m q c l i ) # c r tm q m te s t
P l e a s e w a i t w h i l e 6 4 G B f i l e s y s te m i s i n i t i a l i z e d fo r q u e u e m a n a g e r 'te s t '.
IB M M Q A p p l i a n c e q u e u e m a n a g e r c r e a te d .
T h e q u e u e m a n a g e r i s a s s o c i a te d w i th i n s ta l l a t i o n 'M Q A p p l i a n c e '.
C r e a t i n g o r r e p l a c i n g d e fa u l t o b j e c ts fo r q u e u e m a n a g e r 'te s t '.D e fa u l t o b j e c ts s ta t i s t i c s : 8 3 c r e a te d . 0 r e p l a c e d . 0 fa i l e d .
C o m p l e t i n g s e tu p .
S e tu p c o m p l e te d .
M 2 0 0 0 ( m q c l i ) # s tr m q m te s tIB M M Q A p p l i a n c e q u e u e m a n a g e r 'te s t ' s ta r t i n g .
T h e q u e u e m a n a g e r i s a s s o c i a te d w i th i n s ta l l a t i o n 'M Q A p p l i a n c e '.
5 l o g r e c o r d s a c c e s s e d o n q u e u e m a n a g e r 'te s t ' d u r i n g th e l o g r e p l a y p h a s e .
L o g r e p l a y fo r q u e u e m a n a g e r 'te s t ' c o m p l e te .
T r a n s a c t i o n m a n a g e r s ta te r e c o v e r e d fo r q u e u e m a n a g e r 'te s t '.IB M M Q A p p l i a n c e q u e u e m a n a g e r 'te s t ' s ta r te d u s i n g V 8 .0 .0 .4 .
M 2 0 0 0 ( m q c l i ) # r u n m q s c te s t
5 7 2 4 - H 7 2 ( C ) C o p y r i g h t IB M C o r p . 1 9 9 4 , 2 0 1 4 .
S ta r t i n g M Q S C fo r q u e u e m a n a g e r te s t.
Serial/SSHHTTP
M 2 0 0 0 ( m q c l i ) # c r tm q m te s t
P l e a s e w a i t w h i l e 6 4 G B f i l e s y s te m i s i n i t i a l i z e d fo r q u e u e m a n a g e r 'te s t '.
IB M M Q A p p l i a n c e q u e u e m a n a g e r c r e a te d .
T h e q u e u e m a n a g e r i s a s s o c i a te d w i th i n s ta l l a t i o n 'M Q A p p l i a n c e '.
C r e a t i n g o r r e p l a c i n g d e fa u l t o b j e c ts fo r q u e u e m a n a g e r 'te s t '.D e fa u l t o b j e c ts s ta t i s t i c s : 8 3 c r e a te d . 0 r e p l a c e d . 0 fa i l e d .
C o m p l e t i n g s e tu p .
S e tu p c o m p l e te d .
M 2 0 0 0 ( m q c l i ) # s tr m q m te s tIB M M Q A p p l i a n c e q u e u e m a n a g e r 'te s t ' s ta r t i n g .
T h e q u e u e m a n a g e r i s a s s o c i a te d w i th i n s ta l l a t i o n 'M Q A p p l i a n c e '.
5 l o g r e c o r d s a c c e s s e d o n q u e u e m a n a g e r 'te s t ' d u r i n g th e l o g r e p l a y p h a s e .
L o g r e p l a y fo r q u e u e m a n a g e r 'te s t ' c o m p l e te .
T r a n s a c t i o n m a n a g e r s ta te r e c o v e r e d fo r q u e u e m a n a g e r 'te s t '.IB M M Q A p p l i a n c e q u e u e m a n a g e r 'te s t ' s ta r te d u s i n g V 8 .0 .0 .4 .
M 2 0 0 0 ( m q c l i ) # r u n m q s c te s t
5 7 2 4 - H 7 2 ( C ) C o p y r i g h t IB M C o r p . 1 9 9 4 , 2 0 1 4 .
S ta r t i n g M Q S C fo r q u e u e m a n a g e r te s t.
MQ Channel (PCF)
New for Version 8!
New for Appliance
Administration
Web UI and MQ Console
M 2 0 0 0 ( m q c l i ) # c r tm q m te s t
P l e a s e w a i t w h i l e 6 4 G B f i l e s y s te m i s i n i t i a l i z e d fo r q u e u e m a n a g e r 'te s t '.
IB M M Q A p p l i a n c e q u e u e m a n a g e r c r e a te d .
T h e q u e u e m a n a g e r i s a s s o c i a te d w i th i n s ta l l a t i o n 'M Q A p p l i a n c e '.
C r e a t i n g o r r e p l a c i n g d e fa u l t o b j e c ts fo r q u e u e m a n a g e r 'te s t '.D e fa u l t o b j e c ts s ta t i s t i c s : 8 3 c r e a te d . 0 r e p l a c e d . 0 fa i l e d .
C o m p l e t i n g s e tu p .
S e tu p c o m p l e te d .
M 2 0 0 0 ( m q c l i ) # s tr m q m te s tIB M M Q A p p l i a n c e q u e u e m a n a g e r 'te s t ' s ta r t i n g .
T h e q u e u e m a n a g e r i s a s s o c i a te d w i th i n s ta l l a t i o n 'M Q A p p l i a n c e '.
5 l o g r e c o r d s a c c e s s e d o n q u e u e m a n a g e r 'te s t ' d u r i n g th e l o g r e p l a y p h a s e .
L o g r e p l a y fo r q u e u e m a n a g e r 'te s t ' c o m p l e te .
T r a n s a c t i o n m a n a g e r s ta te r e c o v e r e d fo r q u e u e m a n a g e r 'te s t '.IB M M Q A p p l i a n c e q u e u e m a n a g e r 'te s t ' s ta r te d u s i n g V 8 .0 .0 .4 .
M 2 0 0 0 ( m q c l i ) # r u n m q s c te s t
5 7 2 4 - H 7 2 ( C ) C o p y r i g h t IB M C o r p . 1 9 9 4 , 2 0 1 4 .
S ta r t i n g M Q S C fo r q u e u e m a n a g e r te s t.
M 2 0 0 0 ( m q c l i ) # c r tm q m te s t
P l e a s e w a i t w h i l e 6 4 G B f i l e s y s te m i s i n i t i a l i z e d fo r q u e u e m a n a g e r 'te s t '.
IB M M Q A p p l i a n c e q u e u e m a n a g e r c r e a te d .
T h e q u e u e m a n a g e r i s a s s o c i a te d w i th i n s ta l l a t i o n 'M Q A p p l i a n c e '.
C r e a t i n g o r r e p l a c i n g d e fa u l t o b j e c ts fo r q u e u e m a n a g e r 'te s t '.D e fa u l t o b j e c ts s ta t i s t i c s : 8 3 c r e a te d . 0 r e p l a c e d . 0 fa i l e d .
C o m p l e t i n g s e tu p .
S e tu p c o m p l e te d .
M 2 0 0 0 ( m q c l i ) # s tr m q m te s tIB M M Q A p p l i a n c e q u e u e m a n a g e r 'te s t ' s ta r t i n g .
T h e q u e u e m a n a g e r i s a s s o c i a te d w i th i n s ta l l a t i o n 'M Q A p p l i a n c e '.
5 l o g r e c o r d s a c c e s s e d o n q u e u e m a n a g e r 'te s t ' d u r i n g th e l o g r e p l a y p h a s e .
L o g r e p l a y fo r q u e u e m a n a g e r 'te s t ' c o m p l e te .
T r a n s a c t i o n m a n a g e r s ta te r e c o v e r e d fo r q u e u e m a n a g e r 'te s t '.IB M M Q A p p l i a n c e q u e u e m a n a g e r 'te s t ' s ta r te d u s i n g V 8 .0 .0 .4 .
M 2 0 0 0 ( m q c l i ) # r u n m q s c te s t
5 7 2 4 - H 7 2 ( C ) C o p y r i g h t IB M C o r p . 1 9 9 4 , 2 0 1 4 .
S ta r t i n g M Q S C fo r q u e u e m a n a g e r te s t.
M 2 0 0 0 ( m q c l i ) # c r tm q m te s t
P l e a s e w a i t w h i l e 6 4 G B f i l e s y s te m i s i n i t i a l i z e d fo r q u e u e m a n a g e r 'te s t '.
IB M M Q A p p l i a n c e q u e u e m a n a g e r c r e a te d .
T h e q u e u e m a n a g e r i s a s s o c i a te d w i th i n s ta l l a t i o n 'M Q A p p l i a n c e '.
C r e a t i n g o r r e p l a c i n g d e fa u l t o b j e c ts fo r q u e u e m a n a g e r 'te s t '.D e fa u l t o b j e c ts s ta t i s t i c s : 8 3 c r e a te d . 0 r e p l a c e d . 0 fa i l e d .
C o m p l e t i n g s e tu p .
S e tu p c o m p l e te d .
M 2 0 0 0 ( m q c l i ) # s tr m q m te s tIB M M Q A p p l i a n c e q u e u e m a n a g e r 'te s t ' s ta r t i n g .
T h e q u e u e m a n a g e r i s a s s o c i a te d w i th i n s ta l l a t i o n 'M Q A p p l i a n c e '.
5 l o g r e c o r d s a c c e s s e d o n q u e u e m a n a g e r 'te s t ' d u r i n g th e l o g r e p l a y p h a s e .
L o g r e p l a y fo r q u e u e m a n a g e r 'te s t ' c o m p l e te .
T r a n s a c t i o n m a n a g e r s ta te r e c o v e r e d fo r q u e u e m a n a g e r 'te s t '.IB M M Q A p p l i a n c e q u e u e m a n a g e r 'te s t ' s ta r te d u s i n g V 8 .0 .0 .4 .
M 2 0 0 0 ( m q c l i ) # r u n m q s c te s t
5 7 2 4 - H 7 2 ( C ) C o p y r i g h t IB M C o r p . 1 9 9 4 , 2 0 1 4 .
S ta r t i n g M Q S C fo r q u e u e m a n a g e r te s t.
Administrative user repository
Messaging user repository
Administrators are always defined locally on the appliance and can connect via SSH or WebUI to administer all aspects of the system
Messaging Users may be defined locally or in LDAP repository (choice per QM), and remote applications always connect with these credentials.
Secure administration
Traditional MQ (software) Queue Manager
Application
Application
M 2 0 0 0 ( m q c l i ) # c r tm q m te s t
P l e a s e w a i t w h i l e 6 4 G B f i l e s y s te m i s i n i t i a l i z e d fo r q u e u e m a n a g e r 'te s t '.
IB M M Q A p p l i a n c e q u e u e m a n a g e r c r e a te d .
T h e q u e u e m a n a g e r i s a s s o c i a te d w i th i n s ta l l a t i o n 'M Q A p p l i a n c e '.
C r e a t i n g o r r e p l a c i n g d e fa u l t o b j e c ts fo r q u e u e m a n a g e r 'te s t '.D e fa u l t o b j e c ts s ta t i s t i c s : 8 3 c r e a te d . 0 r e p l a c e d . 0 fa i l e d .
C o m p l e t i n g s e tu p .
S e tu p c o m p l e te d .
M 2 0 0 0 ( m q c l i ) # s tr m q m te s tIB M M Q A p p l i a n c e q u e u e m a n a g e r 'te s t ' s ta r t i n g .
T h e q u e u e m a n a g e r i s a s s o c i a te d w i th i n s ta l l a t i o n 'M Q A p p l i a n c e '.
5 l o g r e c o r d s a c c e s s e d o n q u e u e m a n a g e r 'te s t ' d u r i n g th e l o g r e p l a y p h a s e .
L o g r e p l a y fo r q u e u e m a n a g e r 'te s t ' c o m p l e te .
T r a n s a c t i o n m a n a g e r s ta te r e c o v e r e d fo r q u e u e m a n a g e r 'te s t '.IB M M Q A p p l i a n c e q u e u e m a n a g e r 'te s t ' s ta r te d u s i n g V 8 .0 .0 .4 .
M 2 0 0 0 ( m q c l i ) # r u n m q s c te s t
5 7 2 4 - H 7 2 ( C ) C o p y r i g h t IB M C o r p . 1 9 9 4 , 2 0 1 4 .
S ta r t i n g M Q S C fo r q u e u e m a n a g e r te s t.
New certificate management commands
TLS (SSL) on channels
End to end and at-rest encryption using AMS built in and included as standard
Secure messaging
Secure updates
Mq-appliance-8.0.0.3.scrypt3
Visit fix central to download appliance updates to a local server ready to deploy
Updates are supplied as a simple single file download, signed and secure, and are the only thing which can be installed on the appliance hardware. Copy to appliance – update,
and reboot. All driver, system and MQ updates are applied as a single operation
Logdatabaseorfile
§ The MQ Appliance can be the Queue Manager to provide both regular MQ Queue Manager capabilities § No other MQ server deployment
needed§ Also Coordination Queue Manager
capabilities§ No files are stored on the appliance
§ No MQ MFT Agent needed on the appliance to support this
§ Highly available and robust§ Secure with MQ AMS entitlement built in
– Content encrypted based on policies
Applications exchanging file data
Agent Agent Agent
“Coordination”Queue Manager
Commands
Using MQ MFT and the MQ Appliance
Connectivity
• The MQ Appliance supports a number of protocols for message transmission• Today:
– MQ client protocol – for connectivity from applications• Client libraries available in the usual places, not shipped with the appliance– MQ server protocol – for connectivity with other queue managers• This will support sender-receiver channels and server-requester channels,
including cluster flows• Subject to customer interest we may add further protocols such as
– MQTT – for internet of things and mobile/web messaging– AMQP – for MQ Light API client connectivity
Connect MQ Light apps directly to MQ Appliance
• Very simple messaging API• Support in variety of languages and runtimes; Node.js, Python, Java, etc…
• MQ support through a new channel type AMQP now (8.0.0.5) also available on the Appliance.• Similar in style to an MQTT channel
• Supports the subset of the AMQP 1.0 Oasis specification required for MQ Light applications
• MQ Light applications interoperable with all other MQ applications
• All share the same topic space
C
JMS
MQTT.NET
COBOL
QMgr
QMgr
QMgr
Messaging that application developers will love to use, helping them make responsive applications that scale easily
QM1 QM2 QM3
QM1 QM2 QM3
Fully synchronousreplication
Key design points:- No (persistent) message loss- No external dependencies- Transparent to application
HA Overview
QM1 QM2 QM3
QM1 QM2 QM3
HA – When things go wrong
DR ReplicationAsynchronous(10 Gb Ethernet)
• New function in 8.0.0.4 update• Provides for longer distance
recovery than HA• e.g. Out Of Region standby site
• Still ultimately requires high bandwidth connectivity as all persistent data fully mirrored
• But - asynchronous so better choice than HA for higher latency, ‘bursty’ or ‘lossy’ networks)
• Also means most recent messages are potentially lost on failover, and application logic must consider
• Manual interaction required to trigger failover/fail back.
Disaster Recovery
DR ReplicationAsynchronous(10 Gb Ethernet)
8.0.0.4 introduced DR but with one major restriction – appliances and the queue managers they host can participate either in HA Groups, or DR but not both at the same time
The DR appliance is asynchronously updated from whichever HA node is active
HA Replication
Synchronous(10Gb Ethernet)
8.0.0.5 will improve upon this - by using two network links one HA partner (per appliance) and one DR recovery site (per queue manager) may be configured
Note that this does still not (yet) allow symmetrical HA pair to HA pair replication
Disaster Recovery for HA groups
Monitoring MQ on the appliance
Typically, third party (or other IBM product) tooling will already support MQ appliance queue managers without changes.
This image shows Tivoli Remote Agent displaying queue and channel information from an appliance queue manager.
Various third party vendors have already explicitly confirmed support (check with vendor for specific product information).
But there are also appliance specific features…
• To create, click hotspot
¡ Configure the widget
¡ Display appliance resource use� Platform-wide or queue manager� CPU, Disk, memory, etc
¡ Select:� Resource class/type/element� Queue manager(s) to monitor
¡ Choose Resource class� CPU� Data stores� API Usage stats
Monitoring System ResourcesChart ‘widgets’ and new API
Monitoring applications
Classic use cases for dedicated/specialised exit code is addressed by enhanced application ‘activity trace’ –dynamic publish subscribe API for inspection of application MQ activity.
Which applications make use of which resources (e.g. queues)
What is coming in off this set of channels right now?
How can I keep an audit log of all messages put by a particular application?
Performance and capacity reports
• Two appliance models suit a range of performance and capacity needs• Appliance is dedicated to running messaging server workload
– With no other workload, performance should be predictable– Capacity planning should be easier
• Firmware comes pre-tuned for maximum messaging performance– Placement of workload, resource utilisation, etc.
• Performance reports MPA1 and MPA2 available– MPA1 includes scenario driven examples– MPA2 covers HA and DR configurations– Updated for M2001A/B
Find out more
Dedicated appliance KnowledgeCenter – particularly covers differences from software MQ installationshttp://www-01.ibm.com/support/knowledgecenter/SS5K6E/welcome
GitHub community with example remote configuration scripts https://github.com/ibm-messaging/mq-appliance
RedBook, particularly useful for first time setup and hardware configurationhttp://www.redbooks.ibm.com/Redbooks.nsf/RedpieceAbstracts/sg248283.html
Online
