+ All Categories
Home > Technology > Connectivity for a Smarter Planet

Connectivity for a Smarter Planet

Date post: 11-May-2015
Category:
Upload: prolifics
View: 720 times
Download: 2 times
Share this document with a friend
Description:
http://prolifics.com/ This presentation takes a deep dive into the latest features of IBM WebSphere MQ and Message Broker to see how these new capabilities are changing the world. It examines how MQ and Message Broker can connect anything, anywhere and achieve universal connectivity with: - Enhanced file and messaging capabilities of IBM WebSphere Message Broker 8.0 and WebSphere MQ 7.5, including the ability to handle many formats (i.e. XML, CSV, etc.) - The ability of WebSphere MQ Telemetry Transport (MQTT) to connect through the web or through devices - An extended reach of WebSphere MQ via the new HTTP and FTP bridges - High Availability that makes the system more reliable than ever and allows WebSphere MQ clients to automatically reconnect
Popular Tags:
51
Presented by: A.J. Aronoff Connectivity Practice Director Email: [email protected] Desk: 646-201-4943 Connectivity for a Smarter Planet How MQ and Message Broker will change the world Many Thanks to Mark Taylor, Anthony O’Dowd & David Locke
Transcript
Page 1: Connectivity for a Smarter Planet

Presented by: A.J. Aronoff

Connectivity Practice Director

Email: [email protected]

Desk: 646-201-4943

Connectivity for a Smarter PlanetHow MQ and Message Broker will change the world

Many Thanks to Mark Taylor, Anthony O’Dowd & David Locke

Page 2: Connectivity for a Smarter Planet

2

Agenda – Connectivity

Universal Connectivity: The Path to the Future Latest features of MQ 7.5 and MB 8

• Enhanced file and messaging capabilities• HTTP and FTP Bridges

MQ Telemetry – MQ Without wires

• Smarter Planet:– Technology for the Retail Industry

• Security and High Availability

Page 3: Connectivity for a Smarter Planet

3

Prolifics wins IBM Awards

AWARDS: 2012 Outstanding Business Agility Solution Award

2012 IBM Smart SOA Impact Award Winner

2012 Global WebSphere Community Customer Recognition Award Winner

2012 ICS Award for Best Industry Oriented Social Business Solution

2012 IBM Awarding Client Excellence (ACE)Award Winner

2010 Impact Best BPM Solution Award

2010 Lotus Best End-User Solution Award

2010 Lotus Best Industry Solution Award

2009 Rational Solution Award

2008 Outstanding SOA Solution Award

2008 Overall Technical Excellence Award

2007 Overall Technical Excellence Award

2007 Impact SOA Process Solution Award

2006 Best Portal Solution Lotus Award

2005 5-Star Partner Award

SKILLS and RESOURCES: Serviced over 1500 IBM software accounts in the past 8 years;

implemented over 300 portals

Conducted migrations to WebSphere from other technologies for over 140 clients encompassing more than 2,000 applications

Prolifics boasts over 400 J2EE, WebSphere, ICS, Security, Business Analytics, ECM, Tivoli, Rational certifications for architecture, development, administration, and project management

IBM’s highest technical rating (Level 5)

Highly Accredited - IBM Tivoli “AAA Accredited;” IBM Cloud Certified; Accredited with Ready for Rational; IBM Authorizations for Security, Insurance, Finance, Healthcare & Life Sciences, Banking, Energy & Utilities, Social Business and Enterprise Content Management.

8 Technical Staff are "IBM Champions"

Prolifics has worked with internal development teams multiple times for the development of IBM technologies.

Strategic relationship gains internal access to IBM’s resources, labs, and product development teams

Page 4: Connectivity for a Smarter Planet

4

by doing great work with Great CustomersF i n a n c i a l S e r v i c e s

H e a l t h c a r e G o v e r n m e n t

E d u c a t i o n

R e t a i l & D i s t r i b u t i o n U t i l i t i e s

I n s u r a n c e

Page 5: Connectivity for a Smarter Planet

IBM MQ Connectivity for a Smarter & Secure PlanetA Universal Message Bus providing connectivity to, from and within your Enterprise to

access data wherever it exists to support your business

Provides a comprehensive range of Messaging capabilities to support your Business requirements for data integration:

-- Messaging integration patterns-- Reliability and availability QoS-- Managed File Transfer -- SOA foundation -- EDA foundation

Provides appropriate data accessand data privacy controls to help meet audit and regulatory requirements

Provides a range of messaging on-ramps appropriate to your business needs and developer skills

Provides a range of messaging topologies and deployments to meet your business and IT needs

Eve

nts

Mo

bile

Clo

ud

Mai

nfr

ame

File

s

Pro

cess

es

Sen

sors

Par

tner

s

Universal ConnectivityUniversal Connectivity

Dat

a

Ap

ps

Ser

vice

s

CSS: F S

Page 6: Connectivity for a Smarter Planet

WebSphere MQ V7.5: Content Summary

For Windows, Unix and Linux

CSS: F S

WebSphere MQ V7.5Announced: 24 April 2012Availability: 20 June 2012

New Feature Benefits Details

Integrated InstallationMakes it easier to deploy systems

Simpler licensing

Combines several products into a single package

Common experience

Enhanced ClusteringImproves ease-of-use

Improves application isolationSplit Cluster Transmission Queue

Java Application Identification

Makes it easier to distinguish applications Applications no longer to all have the same name

AMS channel interceptionProvides a level of message protection even when application environment cannot run AMS

Interception in the SVRCONN still protects messages before hitting queues

FTE Logger Options Can write FTE audit records to flat fileNo longer a requirement for an enterprise database

Easier to read data immediately

Simplification

Page 7: Connectivity for a Smarter Planet

WebSphere MQ V7.1: Feature Summary

New Feature Benefits Details

Multi-Version Install capability on Distributed platforms

Makes it easier to deploy and upgrade systems and stage version to version migration

Unix and Windows support for multiple versions of MQ V7.x (AND one copy of MQ V7.0.1) down to fixpack levels.Relocatable installation support.Applications can connect to any Qmgr

Enhanced SecuritySimplified Configuration

Enhanced Authorisation and Auditing

IP address Authorisation capability

Additional crypto algorithms

More granular authorisation for non-local queues

Application Activity Reports

Cloud Support Simplifies and support Cloud deployments Additional HVE images

Enhanced Clustering Improves ease-of-useAuthorisation on Cluster Q rather than XMIT Q on Dist. Platforms

Bind-on-Group Support

Multicast capability New messaging QoS provides low latency with high fan-out capability

MQ Pub/Sub Topic space can now map to multicast Group AddressesProvides direct interoperability with MQ LLM

Improved scalability and availability on z/OS

Further exploitation of z196

Customer control over CF storage useCF Connectivity Loss improvements

Code contention reduced to improve multi-processor linear scalingUse of MQ Datasets rather than DB2 significantly improves “large” message capabilityStructure rebuild capability for CF Connectivity Loss scenarios

Improved Performance on Dist platforms

Improved multiprocessor exploitation Various code improvements

8 CSS: F S

WebSphere MQ V7.1Announced: 4 October 2011Availability: 11 November 2011

Simplification

Page 8: Connectivity for a Smarter Planet

WebSphere MQ V7.5

Integrated Messaging Offering Single install, packaging & tooling for all Messaging options Reduce time to value, simplify usage

What’s being delivered? Integration of MQ with MQ FTE, MQ AMS and MQ Telemetry Single install, common integrated tooling and management,

simplified licensing and entitlements Updated MQ Explorer tooling for all platforms More complete, easy to use messaging infrastructure,

enabling you to gain full range of messaging, swiftly & easily

All messaging functions & capabilities available to all customers, new and existing with rich choice of qualities of service

Removal of charge for MQ XA client Reduced pricing metric for standard MQ Telemetry client

• Lower cost for larger numbers of clients

Advanced Msg Security

AMS Documentation

WebSphere MQ

Advanced Message Security

MQ Server (Queue manager)

MQ Client

MQ Documentation

File Transfer Edition

FTE Server

FTE Client

FTE Docs + tools

WebSphere MQ

MQ Server (Queue manager)

MQ Client

Multi-Language Documentation

+ MQ TT Gateway+ Advanced Message Security+ Managed File Transfer Service+ MQ Explorer with built-in AMS & managed file transfer

+ AMS Enablement+ MQ TT Clients

Managed File Transfer Agent+ AMS Enablement

+ Security (AMS) sections+ Managed File Transfer sections

CSS: F S

Page 9: Connectivity for a Smarter Planet

Simplifying access to WebSphere MQ V7.5 capabilities

Flexible configurations seamless selection of enhanced security, managed file transfer and Telemetry capabilities in one package

Rapid exploitation of new technologies built-in integration of applications on any platform, any devices spanning mainframe to mobile and cloud

Seamless, single console shared backbone for all messaging solutions, mobile/device integration, application messaging and managed file transfers

Enhanced utilization of messaging through use Managed File Transfer solutions over the messaging backbone

Page 10: Connectivity for a Smarter Planet

11

MQ FTEQuick Overview

Directory Monitoring

FTP & SFTP Bridging agents

File to Message - Message to File

Page 11: Connectivity for a Smarter Planet

FTP Spaghetti Infrustructure (haphazard growth)

X Unreliable transport mechanisms Each link in a chain reduces reliabilityX No central set-up, logging or monitoringX Poor documentation of overall systemX Expensive, one-off solutionsX High maintenance costs (60 – 70% of a company’s IT budget)X Lack of business agility

Page 12: Connectivity for a Smarter Planet

MQ FTE allows you to…go from this

…to this

Page 13: Connectivity for a Smarter Planet

Ideal File Transfer Infrastructure

CentralizedMonitoring

Event basedCentralized

Logging

Automation&

CentralizedSet-up

Reliable Transport

Reliable Transport

Reliable Transport

Reliable Transport Reliable

Transport

Reliable Transport

Reliable Transport

Documented,Standardized

Solutions

Page 14: Connectivity for a Smarter Planet

15

/incoming/monitor

/A /B /C

Resource Monitor

FTE Sending Agent

FTE Receiving AgentOfficeA

FTE Receiving AgentOfficeB

FTE Receiving AgentOfficeC

• Three sub directories with the same names of three destination FTE Agents• When a file with an extension of “doc” is added to one of the sub directories

• The Resource monitor detects the file, and• creates a file transfer request for the file where the destination agent has the

same name as the sub directory.http://www.ibm.com/developerworks/websphere/library/techarticles/0910_bonney/0910_bonney.html• A company in Florida is using the above system and planning to scale up further

1.Doc

MQ FTE: Use Case 1: Directory Monitor

Page 15: Connectivity for a Smarter Planet

MQ FTE 7.0.2 Protocol BridgeSupport for transferring files located on FTP and SFTP servers

The source or destination for a transfer can be an FTP or an SFTP server

Fully integrated into graphical, command line and XML scripting interfacesJust looks like another FTE agent…

Enables incremental modernization of (S)FTP-based Legacy solutionsThis helps ease migration from a non-managed (FTP or SFTP) network to a managed network

based on WebSphere MQ File Transfer Edition. (I.E. less rip & replace).Ensures reliability of transfers across FTP/SFTP with checkpoint restartProvides auditability of transfers across FTP/SFTP to central audit log

FTP

FTP

FTP

MQ network

FTP FTP / SFTPnetwork

FTP/SFTPServer

Audit information

FTE

BridgingAgent

Files exchanged between FTE and FTP/SFTP

FTE

FTE

FTE

ProtocolBridgeAgent

FTPServer

Page 16: Connectivity for a Smarter Planet

17

Two Implementation Options Available

Support Pac MA0Y & WMQ V7: HTTP Bridge implemented as Servlet Suitable for deployment to existing J2EE app. servers (WAS, Geronimo, JBOSS) Back end connectivity uses the WMQ JCA resource adapter and WMQ JMS JMS ConnectionFactory config determines if MQ connection uses client/bindings

mode Support Pac MA94: Standalone HTTP Listener

Available for Windows, AIX, and Linux Client or bindings mode, Security exits

Page 17: Connectivity for a Smarter Planet

18

Options for converting data between files & messages

WMQFTE

WMQFTE

WMQFTE

WMQFTE

The file can be split based on:

SizeBinary delimiterRegular expression

One message becomes one file

Optionally, a delimiter can be inserted between each message used to compose the file

One file becomes one message

A group of messages (or all messages on the queue) to one file

One message to one file

One file to a group of messages

One file to one message

Page 18: Connectivity for a Smarter Planet

AuditableRecords complete and detailed audit log of entire file journey“What went where, when and to whom”

ReliableFile contents not corrupted or partially transmitted Files only appear at destination whole and intact

SecureFiles content encrypted during transmission File access authenticated and controlled

AutomatedEliminates need to manually detect problems and restart transfersProviding scheduling and triggering for event-driven transfers

Centralized Remote control and monitoring of file progress from anywhere

FlexibleAble to deploy and re-configure file transfers instantaneously from anywhereManaging transfers end-to-end across a network – not just between 2 points

Any file size No upper limit on the size of file that can be moved

Integrated With SOA infrastructure: Messaging, ESBs, Governance, B2B and BPM

Cost Effective

Provides a consolidated transport for moving both Files and Messages

Customer Survey: Of the points below:Which point(s) matters most to you?

Page 19: Connectivity for a Smarter Planet

Securing the Universal Messaging BusWebSphere MQ Advanced Message SecurityWhat is it?

New product - WebSphere MQ Advanced Message Security Replaces WebSphere MQ Extended Security Edition Component added to WebSphere MQ V7 or V6

Enhances MQ security processing Provides additional security services over and above base QM Designed to assist with requirements such as PCI DSS compliance

Application ---> Application protection for point-to-point messagingIndustry standard asymmetric cryptography used to protect individual messagesUses Public Key Infrastructure (PKI) to protect MQ messages

Uses digital certificates (X.509) for applications

Non-invasiveNo changes required to MQ applications

Security policies used to define the security level required Administratively controlled policies applied to queues

• Command line• Explorer

Page 20: Connectivity for a Smarter Planet

Message Level ProtectionEnables secure message transfers at application levelAssurance that messages have not been altered in transit

When issuing payment information messages, ensure the payment amount does not change before reaching the receiver

Assurance that messages originated from the expected sourceWhen processing messages, validate the sender

Assurance that messages can only be viewed by intended recipient(sWhen sending confidential information.

Page 21: Connectivity for a Smarter Planet

Interceptors

Page 22: Connectivity for a Smarter Planet

MQ AMS interceptorsMQ AMS functionality is implemented in interceptors.

There are no long running processes or daemons (Except in z/OS).Existing MQ applications do not require changes.Three interceptors are provided:1.Server interceptor for local (bindings mode) MQI API & Java applications.

Implemented as queue manager API exit.2. MQI API client interceptor for remote (client mode) MQ API applications.

MQ AMS interceptor imbedded in MQ client code.3. Java client interceptor for remote (client mode) MQ JMS and MQ classes

for java applications (J2EE and J2SE).MQ AMS interceptor imbedded in MQ java client code.MQ V7.0 java client required.SupportPac MQC7 WebSphere MQ V7.0 clients.

Page 23: Connectivity for a Smarter Planet

MQ & MQTT: Connectivity to, from & within an Enterprise

The path to the future A Universal Message Bus for access to data wherever it exists to support your business

Provides a comprehensive range of Messaging capabilities to support your Business requirements for data integration

Managed File Transfer Messaging integration patterns Reliability and availability QoS SOA foundation

Provides appropriate data accessand data privacy controls to help meet audit and regulatory requirements

WMQ Telemetry is one step in extending the reach of WMQ to a wider world of data relevant to your business

Recent technology demonstration of MQ Web Messaging using HTML5 WebSockets continues this progress

24

Petrol Forecourt

BranchOutlet

Regional Office

Retail Store

Refinery

MobilePhone

Sensore.g. RFID

Enterprise

PervasiveDevice

CSS: F S

Page 24: Connectivity for a Smarter Planet

25

MQTT: Key Features

Open published spec designed for the world of “devices”

Invented by IBM and Euro tech

MQTT client code (C and Java) donated to the Eclipse "Paho" M2M project

Three qualities of service: 0 – at most once delivery 1 – assured delivery but may be duplicated 2 – once and once only delivery

In-built constructs to support loss of contact between client and server.

“Last will and testament” to publish a message if the client goes offline.

Stateful “roll-forward” semantics & “durable” subscriptions.

• Minimized on-the-wire format Smallest possible packet size is 2

bytes No application message headers

• Reduced complexity/footprint Clients: C=30Kb; Java=100Kb

• Simple / minimal pub/sub messaging semantics• Asynchronous (“push”) delivery

Simple set of verbs Connect, publish, subscribe and

disconnect.

Page 25: Connectivity for a Smarter Planet

26

MQTT: Key Features (cont.)

240,000 concurrent clients tested with <5% CPU on a single IBM WebSphere MQ queue manager

“Would have gone higher but the Lab ran out of load testing client machine”

By comparison:

Apache Web Servers max out at 25,000 connections

Direct connection between your enterprise and devices

Network: TLS/SSL Authentication: JAAS Authorization: OAM

Page 26: Connectivity for a Smarter Planet

27

MQ Telemetry Implementation

New WebSphere MQ Telemetry component – also known as MQXR (‘eXtended Reach’)

Now included in MQ 7.1 and MQ 7.5

Fully integrated/interoperable with WMQ

MQTT messages translated to standard MQ messages

Administration included as part of MQ explorer

Telemetry Channels enable MQTT connections to the queue manager

Supports MQTTv3 protocol (which is the most common one in use)

Page 27: Connectivity for a Smarter Planet

28

Mobile Is Driving Changes to the Traditional Web

One of the problems we experienced was long latency when sending a message. The method we were using to send was reliable but slow, & there were limitations on how much we could improve it. With just a few weeks until launch, we ended up building a new mechanism that maintains a persistent connection to our servers. To do this without killing battery life, we used a protocol called MQTT. MQTT is specifically designed for applications like sending telemetry data to & from space probes, so it is designed to use bandwidth & batteries sparingly. By maintaining an MQTT connection & routing messages through our chat pipeline, we were able to often achieve phone-to-phone delivery in the hundreds of milliseconds, rather than multiple seconds.

- Building Facebook Messenger by Lucy Zhang (tinyurl.com/makingfbmessenger)

Page 28: Connectivity for a Smarter Planet

29

MQTT: Business ScenariosScenario Key Industries ExampleAutomated Metering

Chemical & Petroleum Energy & Utilities

Solution provider enables smart metering of home energy by using MQ Telemetry technology

Distribution Supply Chain and Logistics

Retailers Distributors Consumer products Transportation

Shipping company improves customer loyalty by providing up-to-the-moment detailed tracking information for cargo

Industrial Tracking & Visibility

Automotive Industrial manufacturingAerospace Defense

Transportation company improves customer safety and satisfaction with improved tracking of fleet

Healthcare Personal & Resource Tracking

Pharmaceutical companies Manufacturing company automates inventory checking to improve management of stock and optimize production rates

Location Awareness and Safety

Health trials Hospitals Nursing Homes

Medical organization uses MQ Telemetry to track health of at-risk patients to increase safety and quality of patient care

Executive Alerting Chemical & Petroleum Energy & UtilitiesHomeland Defense

Hospital uses MQ Telemetry to track expensive surgery equipment to maximize utilization and reduce waiting lists

Page 29: Connectivity for a Smarter Planet

Retail: RFID: Solution Architecture

30

Page 30: Connectivity for a Smarter Planet

Home Pace Maker Monitoring Solution

31

• Monitor large numbers of patient’s pace makers in their home • Collect diagnostics and periodically dial health care provider• Immediately dial if abnormality detected • Often over “old” – very slow, fragile dial up connections• Remove need for patient to visit to clinic on fixed interval • Clinician only sees patients with problems

Page 31: Connectivity for a Smarter Planet

Message Broker 8 Summary: Themes Simple & Productive

Making it easier and quicker to develop and manage MB solutions• Learn, Develop, Deploy, Manage, Migrate quickly and easily

Universal & Independent Connecting MB to a range of different systems

• Universal connectivity includes standards, de facto standards, industry and custom systems

Industry Specific & Relevant Provide industry connectivity packs to solve domain specific problems

• Industry specific nodes, solution-oriented patterns & user-oriented tooling

Dynamic & Managed Allow the creation of dynamic and governed solutions

• Design solutions for easy, flexible change with appropriate control

High Performing & Scalable Provide a platform and technology neutral connectivity option

• Work on widest possible range of hardware, software & virtualized environments

32

Page 32: Connectivity for a Smarter Planet

Easy Data Modeling with DFDL

33

Simple & powerful standard for data modeling New standard for binary, text & industry data formats

• Logical structure with physical annotations• e.g. endian, ASCII/EBCDIC, padding, justify

Data Format Description Language (DFDL)• For use in IBM and non-IBM products• forge.gridforum.org/projects/dfdl-wg

Built-in facilities to model data easily Quick wizards for (e.g.) CSV, record oriented data Auto-model importers (e.g.) COBOL copybooks DFDL editor for power users

• Create logical model & physical refinements

Test parsing and test data generation Test whether sample data fits with DFDL definition

• Parse trace provide success & error case explanation• Auto-generate test data for test & debug scenarios

All broker nodes can exploit new DFDL parser Configure as existing XML, JSON, MRM, MIME... parsers

• Interacts with message tree in usual manner Excellent performance characteristics

• (e.g.)element type, size, structural complexity, etc.• Supports streaming, partial parsing, etc.

Page 33: Connectivity for a Smarter Planet

Graphical Transformations

34

IBM Graphical Data Mapper (GDM) Visually map & transform source to target data

• Code-free, high performing & scalable GDM designed for whole IBM product set

• e.g. Full map exchange with MDM Server V9• Mapping Script Language(MSL)format

Simple & powerful graphical mapping experience Apply transformations to single and multiple elements

• Conditionals (if then else), Loops(for each), Functions(target=f(source)) & more! Database mapping sources and targets for routing and enrichment scenarios

• Broad data base support(Oracle,DB2,SQLServer,Sybase,Informix...) Complements and supports existing transformation languages

• Call user defined transformation in Java, SQL, XPath, .NET...

Simple deployment, high performing & scalable Maps can be deployed with solution BAR file or stand-alone JIT compile means technology advances improves existing, deployed solutions

• Source deploy + runtime compilation = enhanced performance

Page 34: Connectivity for a Smarter Planet

Enhanced Patterns Support User Defined Patterns

Add your own patterns to Patterns Explorer• Complements IBM supplied patterns

Create reusable assets according to best practices • Typically performed with Enterprise Architect • Generated Flow always create conforming logic

Generate pattern starting from an existing message flow Identify key message flow (node) properties Create pattern parameters & property mappings Create pattern documentation and help; Preview Add your pattern to Patterns Explorer for reuse

User-defined subflows for black-box style reuse Create user-defined node packages from subflows Implementation remains opaque Excellent for library style node reuse Distribute & share via any Library Control System

Patterns Explorer Expansion 1-way MQ reliable invocation of Web Service Includes error handling

35

Page 35: Connectivity for a Smarter Planet

Why use Patterns?A pattern in Message Broker is a template that generates one or more production ready projects. All the projects that a pattern creates share a set of common properties. Creates top-down, parameterized connectivity solutions

• Web Service façades, message oriented processing, queue-to-file Reduces common problems in flow development

• “Brilliant People Solve Problems - Geniuses Prevents Them” A. Einstein.

Communicates best practices to the Broker community Complements existing bottom-up construction for connectivity Reduces time-to-value for solution development Patterns are a first class citizen in Message Broker Patterns have bubbled right to the top in the navigator view!

36

Page 36: Connectivity for a Smarter Planet

WebSphere MQ V7.1: Feature Summary

New Feature Benefits Details

Multi-Version Install capability on Distributed platforms

Makes it easier to deploy and upgrade systems and stage version to version migration

Unix and Windows support for multiple versions of MQ V7.x (AND one copy of MQ V7.0.1) down to fixpack levels.Relocatable installation support.Applications can connect to any Qmgr

Enhanced SecuritySimplified Configuration

Enhanced Authorisation and Auditing

IP address Authorisation capability

Additional crypto algorithms

More granular authorisation for non-local queues

Application Activity Reports

Cloud Support Simplifies and support Cloud deployments Additional HVE images

Enhanced Clustering Improves ease-of-useAuthorisation on Cluster Q rather than XMIT Q on Dist. Platforms

Bind-on-Group Support

Multicast capability New messaging QoS provides low latency with high fan-out capability

MQ Pub/Sub Topic space can now map to multicast Group AddressesProvides direct interoperability with MQ LLM

Improved scalability and availability on z/OS

Further exploitation of z196

Customer control over CF storage useCF Connectivity Loss improvements

Code contention reduced to improve multi-processor linear scalingUse of MQ Datasets rather than DB2 significantly improves “large” message capabilityStructure rebuild capability for CF Connectivity Loss scenarios

Improved Performance on Dist platforms

Improved multiprocessor exploitation Various code improvements

37 CSS: F S

WebSphere MQ V7.1Announced: 4 October 2011Availability: 11 November 2011

Page 37: Connectivity for a Smarter Planet

Scalability & Performance – Distributed platforms Performance measured and improved for a range of scenarios

Hardware capabilities have evolved over years to have more CPUs, more memory etc

MQ topologies have evolved to have more clients and larger/fewer queue managers

“Fastest MQ ever”: better performance than V6 and V7

Multicast faster than traditional non-persistent

Over 5x for one-many publications

Performance reports to be released on availabilityCSS: F S

CSS: F S

Page 38: Connectivity for a Smarter Planet

SET CHLAUTH(*) TYPE(ADDRESSMAP) ADDRESS(‘*’) USERSRC(NOACCESS)

Channel Access Policy (1)

“We must make sure our system is completely locked down”

CSS: F

Page 39: Connectivity for a Smarter Planet

“Our Business Partners must all connect using SSL, so we will map their access from the certificate DNs”

SET CHLAUTH(*) TYPE(ADDRESSMAP) ADDRESS(‘*’) USERSRC(NOACCESS)

SET CHLAUTH(BPCHL.*) TYPE(SSLPEERMAP) SSLPEER(‘O=Bank of Shetland’) MCAUSER(BANK123)

SET CHLAUTH(BPCHL.*) TYPE(SSLPEERMAP) SSLPEER(‘O=Bank of Orkney’) MCAUSER(BANK456)

Channel Access Policy (2)

CSS: F

Page 40: Connectivity for a Smarter Planet

“Our Administrators connect in using MQ Explorer, but don’t use SSL. We will map their access by IP Address”

SET CHLAUTH(*) TYPE(ADDRESSMAP) ADDRESS(‘*’) USERSRC(NOACCESS)

SET CHLAUTH(BPCHL.*) TYPE(SSLPEERMAP) SSLPEER(‘O=Bank of Shetland’) MCAUSER(BANK123)

SET CHLAUTH(BPCHL.*) TYPE(SSLPEERMAP) SSLPEER(‘O=Bank of Orkney’) MCAUSER(BANK456)

SET CHLAUTH(SYSTEM.ADMIN.SVRCONN) TYPE(ADDRESSMAP)ADDRESS(‘9.20.1-30.*’) MCAUSER(ADMUSER)

Channel Access Policy (3)

CSS: F

Page 41: Connectivity for a Smarter Planet

SET CHLAUTH(*) TYPE(ADDRESSMAP) ADDRESS(‘*’) USERSRC(NOACCESS)

SET CHLAUTH(BPCHL.*) TYPE(SSLPEERMAP) SSLPEER(‘O=Bank of Shetland’) MCAUSER(BANK123)

SET CHLAUTH(BPCHL.*) TYPE(SSLPEERMAP) SSLPEER(‘O=Bank of Orkney’) MCAUSER(BANK456)

SET CHLAUTH(SYSTEM.ADMIN.SVRCONN) TYPE(ADDRESSMAP)ADDRESS(‘9.20.1-30.*’) MCAUSER(ADMUSER)

SET CHLAUTH(TO.CLUS.*) TYPE(QMGRMAP)QMNAME(CLUSQM*) MCAUSER(CLUSUSR) ADDRESS(‘9.30.*’)

Channel Access Policy (4)

“Our internal cluster doesn’t use SSL, but we must ensure only the correct queue managers can connect into the cluster”

CSS: F

Page 42: Connectivity for a Smarter Planet

MQ High Availability: Multi-Instance Queue Managers

Owns the queue manager data

MQClient

Machine A Machine B

QM1

QM1Active

instance

QM1Standbyinstance

can fail-over

MQClient

network

192.168.0.2192.168.0.1

networked storage

1. Normal Execution

Page 43: Connectivity for a Smarter Planet

Multi-Instance Queue Managers

MQClient

Machine A Machine B

QM1

QM1Active

instance

QM1Standbyinstance

locks freed

MQClient

network

192.168.0.1

networked storage

2. Disaster Strikes

Connections broken from clients

192.168.0.2

Page 44: Connectivity for a Smarter Planet

Multi-Instance Queue Managers

MQClient

Machine B

QM1

MQClient

network

networked storage

Owns the queue manager data

QM1Active

instance

3. Standby Comes to Life Connections

still broken

192.168.0.2

Page 45: Connectivity for a Smarter Planet

Multi-Instance Queue Managers

MQClient

Machine B

QM1

QM1Active

instance

MQClient

network

networked storage

Owns the queue manager data

4. Recovery Complete Clients reconnected.

Processing continues.

192.168.0.2

Page 46: Connectivity for a Smarter Planet

Multi-Instance Queue Managers: How it Looks As a graphical example, SupportPac MS0P V7.0.1

Page 47: Connectivity for a Smarter Planet

Message Broker exploits MQ 7.0.1 multi-instance queue manager capability

Active and stand-by queue managers Start multiple instances of a queue manager on different machines One is “active” instance; other is “standby” instance Shared data is held in shared networked storage but owned by active instance

Exploitation by Message Broker If standby instance of the queue manager becomes active, then

the newly active MQ instance will start message broker once MQ recovery is complete

Message Broker H.A. using MQ 7.0.1 multi instance queue managers

Page 48: Connectivity for a Smarter Planet

Automatic Client Reconnection Client library provides necessary reconnection logic on detection of a

failure Hides failure from application code

QM1

MQ Client

Application

QM3

QM2

Page 49: Connectivity for a Smarter Planet

Automatic Client Reconnection Tries to hide queue manager failures by restoring current state automatically

For example, if MQPUT returns error, client reruns MQCONN/MQOPEN/MQPUT internally

Uses the list of addresses in CONNAME to find queue manager MQSERVER environment variable also understands list MQSERVER=SYSTEM.DEF.SVRCONN/TCP/host1(1414),host2(1414)

Can reconnect to the same or different Queue Manager

Re-opens queues and other qmgr objects, re-establishes subscriptions

Reconnection interval is backed off exponentially on each unsuccessful retry Total timeout is configurable – default 30 minutes.

Page 50: Connectivity for a Smarter Planet

Universal Messaging with WebSphere MQ

51

Any skillsAny skills

Any networkAny network

Any dataAny data

Any QoSAny QoSAny platformAny platform

Any deviceAny device

Any speedAny speed

Any delivery levelAny delivery level

Universal Messaging

CSS: F S

Page 51: Connectivity for a Smarter Planet

52


Recommended