© 2013 IBM Corporation
What Every Enterprise Architect Needs to Know about the Evolution of IMS
Betty Patterson – May 2013
IMS Chief Architect
IBM Silicon Valley Laboratory
© 2013 IBM Corporation2
Availability. References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates.
Acknowledgements and Disclaimers
© Copyright IBM Corporation 2013. All rights reserved.
– U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
IBM, the IBM logo, ibm.com, IMS, DB2, CICS and WebSphere MQ are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml
Other company, product, or service names may be trademarks or service marks of others.
The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.
All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.
© 2013 IBM Corporation3
Agenda The role of IMS in IT History and your world
A day in the life of an enterprise architect
It’s all about the connectivity
The sum is much larger than the parts
Wrap Up
© 2013 IBM Corporation
THE ROLE OF IMS IN IT HISTORY AND IN YOUR WORLD
4
© 2013 IBM Corporation
IMS is part of our daily lives and has been for 45 years
We don’t have to think about where the data that drives each of these scenarios resides, or how safe it is, or how quickly it’s
delivered, but we have come to rely on it…..
5
© 2013 IBM Corporation6
© 2013 IBM Corporation
IMS runs the world’s most critical workloads2000 enterprises worldwide run IMS
3 of the top 5 Health Insurance companies run IMS
75% of the top 100 banks worldwide run IMS
The top 5 European and top 5 U.S. banks run IMS
16 petabytes of production data managed by IMS
$3.0 trillion ($US) per day is transferred through IMS.....by one customer
300+ million users served worldwide every day
500 million accounts…..for one customer
46,000 transactions per second…..on a single IMS system
45
© 2013 IBM Corporation
A DAY IN THE LIFE OF AN ENTERPRISE ARCHITECT
8
© 2013 IBM Corporation
2009: Gartner Identifies New Approach for Enterprise Architecture
“Enterprise architects must adopt a new style of enterprise architecture (EA) to respond to the growing variety and complexity in markets, economies, nations, networks and companies…”
First key characteristic: “Architect the lines, not the boxes…” – manage the connections between different parts of the business rather than the actual parts of the business themselves.
9
© 2013 IBM Corporation
The practical implications
Employees want to use their personal devices for business purposes when necessary
Employees and business processes see increased integration with partners and suppliers
Customers want access to information using the technology of their choice
Regulators demand more information—and compliance requirements change regularly.
10
© 2013 IBM Corporation
In the beginning there was IMS……
11
IMS IMS
© 2013 IBM Corporation
Geographically disperse connected systems
12
IMS IMS
Multiple Systems Coupling
© 2013 IBM Corporation
High Availability
13
Message QueuesIMS IMS
© 2013 IBM Corporation
Emergence of online – all roads lead to IMS
14
IMS
Web Browser WebSphereApplication
Server
Distributed Systems
ATM Network
WebSphere MQ
SysplexDistributor
IMS ConnectIMS
ConnectIMS ConnectIMS
Connect
© 2013 IBM Corporation
Key Considerations of the Enterprise Architect
Application Containers
Database Management
SQL Communications
Data Protection and Security
Clustering and Workload Management
Connectivity
Appliances
Analytics, Big Data, Cloud
15
Enterprise Architecture Considerations
JBoss, .Net, etcTomcat
WebLogicWAS
ESB
X86 (Linux, Win), System P (AIX), System z (z/Linux, z/OS)
Intelligent WLM & Routing
Web Session Management
Database
Messaging
Analytics and Data Warehousing Tools
IMS Implementation / Integration
Application Servers
DataPower, WAS ESB, WMB
z/OS Workload Manager, z/OS Sysplex Distributor
IMS Connect, OTMA
IMS Database
SOAP MQ JCA VTAM APPC
CognosUniversal JDBC Driver
Application Servers
IMS TM
CICS WAS
……System z……
© 2013 IBM Corporation
Application Containers
Formerly known as Application Server
Application “container” is essentially a host
Software applications live in a container and take advantage of services such as security, data services, management, performance, and more.
17
IMS
IMS Connect
Database Manager
OTMA
ODBM
Transaction Manager
IMS application
• IMS provides an Application Container
• Dependent regions provide system services, application logic, database calls, message handling, and more.
• Dependent regions specialized for Java, batch, and their permutations
© 2013 IBM Corporation
Database Management
Where does the data reside? In what language it is accessible?
IMS DB can be standalone or share everything
18
IMS
IMS Connect
Database Manager
OTMA
ODBM
Transaction Manager
IMS application
• IMS DB supports DL/I, SQL, and XML
• Specialized IMS DBs provide enhanced performance (Fast Path) and scalability (HALDB)
• Direct connections to IMS database
© 2013 IBM Corporation
SQL Communication IMS Open Database introduced standardized SQL
access to IMS data– Universal DB resource adapter for JEE
– Universal JDBC driver
– Universal DL/I driver
19
© 2013 IBM Corporation
Data Protection and Security
IMS is frequently the home of your most critical customer data
Open integration makes data protection and security simple– IBM InfoSphere Guardium Data Security
– IBM InfoSphere Guardium Data Encryption
– IBM InfoSphere Optim Designer
20
© 2013 IBM Corporation
Clustering and Workload Management
Clusters: sets of servers that are managed together and participate in workload management.
IMS cluster = IMSPlex
IMS images can be clustered up to 255 at a time but managed as one system
21
IMS Database Manager
IMS Transaction
Manager
z/OS
IMS Database Manager
IMS Transaction
Manager
z/OS
IMS Database Manager
IMS Transaction
Manager
z/OS
IMS Database Manager
IMS Transaction
Manager
z/OS
• Share IMS databases
• Share IMS message queues
• Single Point of Control
IMS ConnectIMS Connect
OTMA OTMA OTMA
CQS CQS CQS
Shared Queues
IMS1 IMS2 IMS3
Dependent Regions
Dependent Regions
Dependent Regions
IMS DB
Sysplex Distributor -active
Sysplex Distributor -backupTCPIP
IMS Connect
Workload Balancing Failover Support
Workload Balancing
Shared Queues are maintained by Coupling
Facility hardware
Shared databases
IMS Shared Queues maintain IMS service via: Planned outages Failover routing Automatic workload balancing
Parallel Sysplex creates a Single Image view of multiple IMS systems
SNA / VTAM
Global Lock Managementand
Data Sharing
IMS for High Availability
© 2013 IBM Corporation
Active/Active Sites Multi-site workload lifeline (SASP-enabled switch)
InfoSphere IMS replication for z/OS
Transactions
Workload Distributor
Replication
InfoSphere Replication Server for z/OS
Tivoli Enterprise PortalController
IMSDB2
IMSDB2
Two or more sites, separated by unlimited distances, running the same applications having the same data to provide:
• Cross-site Workload Balancing• Continuous Availability• Disaster Recovery• Asynchronous Software replication
© 2013 IBM Corporation
IT’S ALL ABOUT THE CONNECTIVITY
24
© 2013 IBM Corporation
IMS Connect – the Hub
The TCP/IP Gateway into IMS
Opens IMS systems to servers distributed across the enterprise
The IMS Connect solution includes:– Open Transaction Manager Access (OTMA)
– Open Database Manager (ODBM)
– IMS Operations Manager (OM)
– Multiple Systems Coupling (MSC)
– IMS Connect APIs
25
IMS D
B
Resource A
dapterIM
S D
B
Res
ourc
e A
dapt
er
System z - z/OS
IMS System z - z/OS
IMS Connect
Other Vendor solutions
Database Manager
OTMA
ODBM
LUW / Distributed
IMS TM
Resource A
dapter
WebSphereMessage Broker
IBM Business Process Manager
WebSphere ESB
IMS Connect API Clients
IMS SOAP Gateway
InfoSphereMashup Hub
Cognos
WebSphereTransformation
Extender
WebSphereApplication Server
RYO - sockets
WebSphereDataPower
MFS Web Solutions
Cognos
IMS
TM R
esou
rce
Ada
pter WebSphere
Message Broker
IBM Business Process Manager
WebSphere ESB
JDBC Type-2 drivers
WebSphereApplication Server
RYO - sockets
SAP
MFS Web Solutions
IMS SOAP Gateway
Transaction Manager
IMS application
JDBC Type-4 drivers
Discovery
IMS Connect Opens Access
WebSphereTransformation
Extender
© 2013 IBM Corporation
Enterprise-wide Messaging Capabilities
Which messaging protocols does IMS support?– VTAM
– WebSphere MQ
– APPC
– SOAP
– JCA
Which message-passing paradigms?– Synchronous
– Asynchronous
– Two-phase
– Global
– Local
27
© 2013 IBM Corporation
THE SUM IS MUCH LARGER THAN THE PARTS
28
© 2013 IBM Corporation
ESB Integration Enables standards-based
integration between loosely coupled applications and services within and across…– SOAs, where distributed
applications are composed of granular re-usable services with well-defined, published and standards-compliant interfaces
– Message driven architectures, where applications send messages through the ESB to receiving apps
– Event driven architectures, where applications generate and consume messages anonymously
29
© 2013 IBM Corporation
ESB+ for IMS IBM WebSphere Enterprise Service Bus
– Built on top of IBM WebSphere Application Server
– Supports common connectivity patterns
Use WebSphere ESB to: – Create services from existing assets
– Connect service providers with service consumers
– Connect virtually any business application
Additional services available through:– WebSphere Message Broker
– IBM Business Process Manager
– WebSphere Transformation Extender
30
© 2013 IBM Corporation
Appliances – IBM WebSphere DataPower
31
Service Originator
SOAP
HTTP
DataPower XI50
IMS Connect ClientTCP/IP
COBOL/MQ
System z Service Provider
MQ Server
IMS Connect
IMS
MQ Bridge
IMS Universal JDBC driver
TCP/IP
MQ Client
DB
Future Direction
© 2013 IBM Corporation32
IBM Workload Deployer – Build Your Private Cloud Secure, self-service cloud management
hardware appliance
Design and deploy consistent and repeatable middleware patterns into a cloud of virtualized hardware running a supported hypervisor, such as VMware ESX, z/VM, and PowerVM.
Bring your own cloud to leverage your existing underutilized hardware
Full lifecycle management for IBM Middleware; limited lifecycle management for third party products
X86 Power System z
© 2013 IBM Corporation
Analytics and IMS data
33
CognosBI
DataStore
IMS
IMS Universal
JDBC
DataModel
PublishedReports
Report Authoring Cognos
FrameworkManager
Consumer
Author
JDBC
Benefits of Cognos reporting with IMS:
– Ad hoc reporting access
– Report on data reflecting the most current state of the business
– React faster to trusted data
– Market-leading BI solution for IMS customers
© 2013 IBM Corporation
System z Data – core to Big Data projects
34
Runs the world’s stock exchanges
and banking networks
24x7 ATM
Deposits and Withdrawals
Tracks the world’s packagesReserves airline seats
IMS: 80% of the global life/healthinsurance providers
8 of every 10 of the largest retail banks in Australia, Germany, Japan,and the United States use IMS for their core banking
IMS: Top 5 US BanksTop 5 European Banks
IMS: Top US Manufacturing and Shipping Companies
© 2013 IBM Corporation35
Big Data and IMS - FORRESTER research
© 2013 IBM Corporation
Big Data – the Big Picture
36
Low Latency Copy
IMS IMS Operational / Operational / Production Production
DataData
Operational Operational ApplicationsApplications
Delivering insights from multi-structured data pervasively across the organization embedded in the
operational applications
Operational Analytics
Transactional Information
DB2 Analytics
Accelerator
Data Data WarehouseWarehouse
System zSystem z
Big DataBig DataMulti-Structure Data
Combine multi-structured data with historical data warehouse information to increase understanding
Pervasively enable decision makers and other end users across the organization
Provide analytic information at the point of decision enabling fact-based decisions
Provide real-time operational data from IMS
Accelerate long running DB2 for z/OS queries from minutes to seconds for greater business value with Analytics Accelerator.
© 2013 IBM Corporation37
BigInsights Connectivity to DBMS and Warehouse
Netezza
BigInsights
JDBCDBMS
DB2LUW,
IW with DPF
• BigInsights drives RDBMS work
© 2013 IBM Corporation38
IBM Big Data Platform
HadoopSystem
Stream Computing
Data Warehouse
Information Integration and Governance
MDA Accelerator
Machine Data Accelerator
IBM Big Data Platform
Systems Management
Application Development
Visualization & Discovery
Accelerators
Information Integration and Governance
HadoopSystem
Stream Computing
Data Warehouse
Generic
Dom
ain
Specific
IT use cases: Server, performance, troubleshooting
Business use cases: Click stream and transaction analysis Optimize production, advance planning
Custom Applications Shrink Wrap Solutions
Health Care Telco
InsuranceNetworking
“x2020” “Unity”
Telco RetailFinancial Services Healthcare
Tools Client Specific Customizations, Visualization tools (“zInsights”)
Parsers and Extractors(applications, services, servers and devices )
Federated Discovery, Pattern Discovery, Search, Visualization Tools for
root cause analysis
© 2013 IBM Corporation
WRAP UP
39