© 2011 IBM Corporation
IMS, Fit For the FutureMay 2011
Helene Lyon
DE, European IMS Architecture Team Technical Executiv e
© 2011 IBM Corporation2
Announcement … European IMS Symposium
� European IMS Symposium – 14 to 17 November 2011– http://www.ibm.com/training/conf/ims
© 2011 IBM Corporation3
IMS Position in IBM Smarter Planet
“Data is exploding and it’s in silos”
IMS & Information Integration
IMS & Operational BI
“Our resources are limited”IMS & Autonomics
“New business and process demands”
IMS & Business Process Mgmt
“My infrastructure is inflexible and costly”
IMS & Parallel Sysplex
DB2
Optim
WAS
BRMSRational
z/OSParallel SysplexSecurity Server
WLMLowest TCO
Datapower
System z Data Compres.
IMS DB
Cognos
IMS TOOLS
De-duplication
InfoSphere Classic Federation & Publication &Replication
VSAM
DM Tools
IMS TM CICS
Business Event & Business Monitor
Tivoli
Mashup
Master Data management
NEW INTELLIGENCE
GREEN & BEYOND
SMART WORK
SMARTER COMPUTING
© 2011 IBM Corporation4
IMS Position within the Smarter Computing DomainsMany different workloads which can benefit from the power of IMS!
Message Driven
Web Facing� Business on the Web� Java front ends
� ERP, CRM, Financials, etc.� Custom or Packaged applications
� Business on a global scale� Huge transaction rates and high
database activity
� Periodic business cycles� Limited batch windows
Data Processing
Transaction Processing
Batch Processing
� Event driven business models� High message processing rates
TM – Numerous call in & callout capabilitiesDB – JDBC access to hierarchical data from
every platforms (distributed or z/OS)Web 2.0 support or how to quickly transform
IMS assets into RESTful Services
DB – Smarter data management DB – Smarter data governanceDB – Smarter operational BI
Leading On-line Transaction & DatabaseManagement System
TM - Easy integration with BRMS, Events, MDM
Efficient Batch management thanks to z/OS capabilities
Highly parallel processing
TM – Generation of Business EventsTM – Inbound and outbound integration with
WMQ
And More …
© 2011 IBM Corporation5
Agenda
� IMS Applications – Rejuvenate, Leverage and Grow– SOA Integration– WOLA IMS Support– Enhancing application development environment– Using Business Rules Management Services– Accessing Master Data – Integration with Business Event Services
� IMS Database – Build their Future – Smart Data Access– Smart Data Governance– Smart Data Integration– Smart Operational Business Intelligence
© 2011 IBM Corporation6
DB2
What assets in IMS can be leveraged?
� IMS Transaction– No presentation layer– Access to Resource Managers (RM)
•IMS DB, DB2, MQ– Very simple design
•Get Input Message•RM calls•ISRT Output Message
� IMS Database– Hierarchical design– JDBC access– XML datastore
� IMS MFS – Description of input and output
messages and device map– Not used in client/server implementations
B
D
P
IMS ConnectWMQ
Appl. . . . Appl.
IMS Transaction
Manager
IMS Message Queues
IMS Data Comm.
Open Transaction Manager AccessAPPC/IMS
Common Interface (XCF)
APPC/MVS
VTAM(LU0 LU1 LU2 LU6.1 LU6.2) TCP/IP for zOS
z/OS
Telnet
B B
IMS Database Manager
D
MFS P
DB2 SP
ODBAWMQ
ODBM
© 2011 IBM Corporation7
Positioning IMS Assets in SOA Architecture
Business TierPresentation Tier Enterprise Tier
DB
Core Business Services
User and Interaction Domain Core and Information Domain
Channel Interaction Services
Enterprise Service Bus
Integration/Process Domain
Des
ktop
Cha
nnel
s
Data Services
Business Services
Business Processes
Integration Services
JDB
CW
eb
Ser
vice
sJC
AJM
S
External Systems Applications
External Business Partners
External Services Providers
External Systems
D
B
© 2011 IBM Corporation8
WebSphere MQ
WebSphere Application Server
WebSphere Message Broker
Increased capabilities / automation
A new version of our proven product that delivers an advanced Enterprise Service Bus. Provides universal connectivity and data transformation. Built on WebSphere MQ.
Business Process
ESB
Provides reliable integration messaging to connect applications and Web services across more than 80 supported platform configurations.
WebSphere Process ServerFor customers who want a higher level solution to design, automate and manage composite applications and operational business processes. Built on WebSphere ESB.
WebSphere ESBA new product that delivers an Enterprise Service Bus. Provides Web Services connectivity and data transformation. Built on WebSphere Application Server.
IMSCICS
Application/Transaction Servers
A complete solution from existing systems to the full SOA Lifecycle
Service integration
Process integration
The WebSphere “Universal Transformer”
DB2
Service enablement
Datapower
© 2011 IBM Corporation9
SOA with IMS Applications
� When designing an SOA, much of the business logic t o be deployed as services is already implemented in exis ting IT application systems
– And much of this runs on the mainframe - Bottom-Up approach
� New services may also be written– It might be appropriate to write this as an EJB or Web Service
• For example, using IMS JDBC to directly access the IMS Databases– But in many cases the best solution will be to create new IMS transactions – Top-Down
approach
� When the existing transaction does not exactly matc h the business requirement, the most efficient solution is to modify the existing t ransaction
– Modify or add COBOL or PL/I logic– Add JAVA classes to existing COBOL or PL/I programs– Take benefit of a Business Rules management system
• Business Rules mining using Rational Asset Analyzer– Take benefit of Business Event management system
• Generate events from IMS application– Study all Call in/Callout capabilities– Be creative ☺
� Rational Developer for System z (RDz) provides the best platform for IMS application program development, maintenance and renovation
“ A study of 35 SOA projects across 11 industries worldwide revealed improved flexibility (100%), decreased costs (97%), reduced risk (71%), and increased revenue (51%).”
IBM Institute for Business Value http://www-935.ibm.com/services/us/gbs/bus/html/soa-industry-series-tl.html
© 2011 IBM Corporation10
SOA Connectivity with IMS TM - Inbound to IMS
IMS Connect
OTMA
IMS DB &XML DB
IMS
WebSphere ServersWAS, WPS, WESB,
WTX and WMB
IMS SOAP Gateway
WebSphereDataPower
Connect API
MQMQ Client
RYO Client
Web Service
Consumer
IMS TM Resource Adapter
WAS – WebSphere Application ServerWOLA - WebSphere z/OS Optimized Local AdaptersWPS – WebSphere Process ServerWESB – WebSphere Enterprise Service BusWTX – WebSphere Transformation ExtenderWMB – WebSphere Message Broker
IBM MashupCenter /
WebSpheresMash
Web 2.0 Client
DB2
WOLA
D
B
JCA
JMS or MQ API
SOAP over IP
WMB & DataPower
MQ IMS Bridge
MQ Trigger Monitor
© 2011 IBM Corporation11
SOA Connectivity with IMS TM - Outbound from IMS
� Asynchronous support with– IMS API (ISRT ALTPCB)– MQ API– APPC API– TCP/IP calls with IMS Connect
� Synchronous (not in 2PC scope) support with– IMS API - New ICAL with IMS 10 – MQ API– APPC/IMS (also in 2PC scope)– SQL calls to DB2 stored procedures
B
IMSAppls.
B
IMSAppls.
B
Output Gateway
?
B
IMSAppls.
B
Output Gateway
?
© 2011 IBM Corporation12
IMS Connect
OTMA
IMS DB &XML DB
IMS
DB2
WOLA
D
B
SOA Connectivity with IMS TM - Outbound from IMS
� Asynchronous and synchronous capabilities
IMS TM Resource Adapter
WAS
IMS SOAP Gateway
MQMQ Server
RYO Server
Web ServiceProvider
Event ProcessingWBE, WBM
WAS – WebSphere Application ServerWOLA - WebSphere z/OS Optimized Local AdaptersWBE – WebSphere Business EventsWBM – WebSphere Business MonitorWMB – WebSphere Message BrokerRYO Server - .Net, BizTalk, Oracle SP, SAP, PayPal services, and any application server, etc.
WMB
© 2011 IBM Corporation13
IMS SOA Solutions & Development Tools
� WebSphere using IMS Resource Adapter– WebSphere Application Server (WAS) – Rational Application Developer (RAD)– WebSphere ESB (WESB) – WebSphere Integration Developer (WID)– WebSphere Message Broker (WMB) – WebSphere Message Broker Toolkit (WMBT)– WebSphere Process Server (WPS) - WebSphere Integration Developer (WID)– WebSphere Transformation Extender (WTX) – WTX Design Studio– WebSphere Application Server Community Edition (WASCE)
� WebSphere DataPower – WTX Design Studio– DataPower offers many built-in functions, e.g. WS-security, WS-management,
firewalling, XML performance, etc
� IMS SOAP Gateway – Rational Developer for System z (RDz)– Direct SOAP connectivity for IMS (not an Application Server)
© 2011 IBM Corporation14
IMS Transactions SOA Integration - Solution Summary
Consider as option to service enable IMS applications when WMB is already used as enterprise ESB.
IMS Connect node available in addition to MQ supportIMS Connect (enhanced with IMS Connect Extension Tool)WMB server
WebSphereMessage Broker
Use as ESB gateway for security functions, message transformation and routing
Synchronous and AsynchronousInbound CM1 with sync-level=NoneNo CM0 support32 KB limit (single segment)No support for IMS conversational transaction
IMS Connect (enhanced with IMS Connect Extension Tool)DP Appliance
DataPower
Exploit JMS and WMQ for basic messaging and flowing Web services.
Asynchronous, with almost-synchronous capabilitiesInbound and outboundCM0 and CM1 supportAssured delivery
MQ IMS BridgeWAS Server
JMS
Most appropriate solution when service requester is JEE component and when high QoS required (2PC, connection pooling, identity propagation etc.)
Synchronous with Asynchronous output retrieve options Inbound and outbound (with IMS 10)CM0 and CM1 supportNO maximum message size: IMS Connect supports multi segment message (32K limit for one single segment)
IMS Connect (enhanced with IMS Connect Extension Tool)WAS Server
JCA
Still has some limitation today; work with IMS lab if you have specific customer requests
Synchronous access over HTTPInbound and outbound (with IMS 10)CM1 with sync-level=NoneNo CM0 supportNo support for IMS conversational transaction
IMS Connect (enhanced with IMS Connect Extension Tool)&IMS SOAP Gateway
SOAP
RecommendationCapabilitiesMiddlewareStandard architecture
© 2011 IBM Corporation15
WebSphere Optimized Local Adapters – What is it?
� Providing a highly scalable transactional solution
� New cross-memory communication structure for WAS V7 , extension of a WAS “Local Comm” used inside of WAS .– Introduced in May of 2009 in WAS 7.0.0.4, and enhanced in WAS 7.0.0.12 …
This extension is implemented with a new set of mod ules that provide an API for programs in external a ddress spaces to access servers using this Daemon shared space mecha nism
CR SR
AppServer
CR SR
DMGRDaemon
Shared Space
WOLACICSAssembler/Cobol/PLI/C or C++
z/OS BatchAssembler/Cobol/PLI/C or C++
UNIX Systems ServicesAssembler/Cobol/PLI/C or C++
Airline Control SystemAssembler/Cobol/PLI/C or C++
WOLA
WOLA
WOLA
This is bi-directional
Cross memory “Local Comm”
CR SR
AppServer
IMSAssembler/Cobol/PLI/C or C++
WOLA
New in 7.0.0.12!
LPAR
© 2011 IBM Corporation16
WOLA - Interface with Batch, CICS, IMS
Enterprise Java Bean(Or Servlet)
Enterprise Java Bean
WOLA Execute()ExecuteHome()
WOLA JCA Adapter
WOLA
CICS Program
CICS Program
WOLA BBO$/BBO#
WOLA Modules/APIs
Batch Program
WOLA Modules/APIs
WebSphere Environment
CICS EnvironmentBatch Environment
EJBs that initiate a call to WOLA do so through a supplied JCA adapter.
Several WOLA-specific methods used to invoke services over WOLA
EJBs that will be the target of inbound calls need to implement the WOLA-supplied Execute() and ExecuteHome() classes.
Calls into CICS come across WOLA-supplied BBO$/BBO# task and transaction. Target CICS program unchanged if able to be invoked over COMMAREA or Channel/Container
A CICS program that wishes to initiate an outbound connection must write to the WOLA APIs
A Batch program that wishes to initiate an outbound connection
must write to the WOLA APIs
You make modules/classes available: STEPLIB, DFHRPL, DFSESL, ola.rar and ola_apis.jarBatch CICS WAS Development ToolIMS
BMP/MPP/ IFP
WOLA IMS
ESAF
IMS Dependent regionsWOLAOTMA
A WAS application can call an existing unchanged IMS transaction using OLA over OTMA
© 2011 IBM Corporation17
WOLA – IMS Support - Basics
� WOLA OTMA support– A WAS application can call an existing unchanged IMS transaction using OLA over
OTMA
� IMS WOLA APIs support– Allow IMS applications in the following IMS dependent regions to use the WOLA APIs for
bi-directional calling between WAS / IMS when co-located on the same z/OS system• Message Processing Programs (MPPs)• IMS Fast path Programs (IFPs)• Batch Message Programs (BMPs)• Batch DL/I apps
– Based on External Subsystem Attach Facility (ESAF) use• ‘WOLA’ subsystem – with all required exits (new BBOAI- modules)• WOLA APIs are enhanced to detect when under IMS and pass requests to WOLA Normal Call
ESAF exit – then on to WAS.• Positions for global transactions support
© 2011 IBM Corporation18
Relative Advantage Favors …
WOLA ICON
Part of the WebSphere Application Server z/OS Produ ctWOLA II shipped with WAS z/OS 7.0.0.12, IMS Connect is a separate FMID that ships with IMS
Able to be used for local or remote access to IMSWOLA is a local technology only, IMS supports both a local mode as well as TCP-based remote access
Propagation/assertion of User Identity from IMS in to WASWOLA can propagate the thread-level ID over a call into the WAS EJB container and assert it
Bi-directional and able to call existing unchanged IMS transactions
Multi-segment messages WOLA over IMS OTMA does not yet support multi-segme nt messages. This is coming soon.
WOLA is a complementary technology with IMS Connect. Both will have their place within an enterprise architecture.
Global Transactions WAS to IMS WOLA does not yet support this.
Global Transactions IMS to WASNeither IMS ICAL callout or WOLA support this yet.
WOLA – IMS Support & IMS Connect (ICON)
© 2011 IBM Corporation19
Enhancing z/OS Application Development ExperienceWith Rational Developer for System z (RDz)
� Eclipse-based application development tool for mode rnizing and developing System z applications– COBOL, PL/I, C, C++, HL Assembler, Java– Supports IMS, CICS, Batch, USS, etc.– Interactive access to z/OS system– Access PDS and run JCL from your workstation
� Premier IBM Integrated Development Environment for development and test of IMS applications – RDz V7.6 adds drag-and-drop code snippet function for IMS DLI calls– Or RDz V8.0.1
� Also supports IMS SOA enablement– Enables CICS and IMS applications for Web
Services and SOA– Built-in wizard for SOAP Gateway and Web 2.0– Generate XML COBOL/PLI converters for XML
transformation– Generate WSDL, correlator files for Web
Services access
** Unwarranted two complimentary copies of RDz 7.6. x for IMS 10 or 11 users
© 2011 IBM Corporation20
Enhancing z/OS Application Development Experience on x86 workstationWith Rational Developer for System z Unit Test (RDz)
� Rational Developer for System z Unit Test feature c an greatly enhance the way organizations develop, maintain and test mainframe applications
– Based on the IBM z Personal Development Tool (zPDT) – Small-scale, personal test environment for developers that can run z/OS and z/OS middleware from
IBM, but on an Intel or Intel-compatible (x86) personal computer (PC)
� Features / Business Value– Develop and test z/OS applications on a desktop machine – Lower testing costs over traditional mainframe environments– Facilitates quick changes to test configurations during development
20
© 2011 IBM Corporation21
� Standardware COPE mainframe virtualization solution for IMS integrates with RDz to enable additional productivity and cost savings for z/OS development projects
– The Standardware COPE solution allows IMS development teams to virtualize their IMS test environments for potential savings in test resources, process time and set-up systems skills without associated application program changes.
– The COPE JCL integration with IBM Rational Developer for System z used in conjunction RDz remote interactive testing, debugging and deployment capabilities can help achieve business objectives by making the IMS test deployment less CPU costly and more transparent for the developer
� More information about COPE can be found in the IMS Newsletter: – http://www-
931.ibm.com/bin/newsletter/tool/landingPage.cgi?lpId=2337&open&cm_mmc=6231-_-n-_-vrm_newsletter-_-11069_137321&cmibm_em=dm:0:18016073
� Or at the Standardware site:– http://www.standardware.com/index.php/site/products/
Virtualization of IMS Application Development Environment on z/OS
© 2011 IBM Corporation22
Collaborative Application Development including IMS applications
� The nature of applications has changed– loosely coupled components– teams need to collaborate– use multiple platforms that are fit-for-purpose
� Coordination required– requirements management– work item management– iteration planning (what should go into what level/release)– multi-platform build processing
Integrated application
development tools enable developer
productivity
© 2011 IBM Corporation23
Repository
Jazz Server
Application Server
Jazz Team Server
Clients
Collaboration
Tomcat, WAS
Sametime or Jabber, Google Talk
DB2, or Derby,Oracle,
SQL Server
AgentAgent
AgentAgent
AgentAgent
AIX
Solaris
z/OS
IBM i
HPUX
WindowsLinux
Linux for System z
Build Agents
Collaborative Application Development including IMS applications …
� Rational Team Concert - Single Collaborative Develop ment environment for all types of teams
– Development in any language– Development for any platform– Traditional or Agile Planning
Extensions for z/OS�Native z/OS build support �Integration with RDz�Integrated SCM solution for z/OS and distributed assets
© 2011 IBM Corporation24
Bringing Agility to IMS transactions
� Value of a Business Rules Management System– Manages the business rules allowing them to be visible and easily maintained by business analysts– Provides a knowledge base that is accessible for application understanding and ongoing
management– Enables decision services for SOA and other modernization strategies– Reduces risk through reuse of proven, existing logic in a modernized architecture while rationalizing
software assets that are misaligned with corporate priorities.
VALIDATION & MANAGEMENTIBM WebSphere ILOG BRMS
IDENTIFICATIONIBM Rational Asset Analyzer
REMEDIATIONIBM Rational Developer for System z
— What decisions— Using which rules— Where in the source
— Adjust the source to match the rule— Extract the rule to a callable element— Extract the rule to a rule server
— Align rules with business goals— Manage business rules life cycle— Test and validate rules
© 2011 IBM Corporation25
Application Developer, Architect
Business Analyst, Business Manager
CICS, IMS, Batch Applications
Decision ValidationServices
Rule Studio(Eclipse)
Rule TeamServer (RTS Web)
RTS Rule Repository
ILOG Rules for COBOL
ILOG Jrules Rule Execution Server z/OS
Development
Rule Management
ILOG BRMS Management and Development
WebSphere ILOG Business Rules for z/OS
Bringing Agility to IMS transactions with ILOG BRMS Solutions on z/OS
© 2011 IBM Corporation26
Accessing “Operational Master Data” in a z/OS environment
� InfoSphere MDM Server– High performance, high scalability foundation
to access master data•Server and/or Data can be distributed or z/OS
– Enabled as an SOA Library with 800 pre-packaged business services
� When data is in DB2 for z/OS, a COBOL Adapter enables COBOL programs to access Master Data Management Server services
– Both the MDM Server Central Transaction server (for Update request) and MDM Server “Query” Connect (for Read-only requests)
– Based on MQ communication
� More on MDM Server “Query” Connect – z/OS MDM Server component to service high
volume read only transactions (around 1000 tps)
– Mirror typical use scenarios where a large portion of transactions is search or inquiry (read-only)
– Java SE application (like a long-running batch job for z/OS) – WAS not prereq
Mainframe z/OS
MDMDatabase
Distributed AIX
JDBC
MDMQuery
Connect
ApplicationServer
MQ Server
Client Apple.g. Cobol
Client Appl
Client Apple.g. Web UI
JDBC/SQLJ
JMS
RMI
JMS
JMS
MDMApplication
JMS
© 2011 IBM Corporation27
Batch Framework COBOL
AdapterJMS/MDBAdapter
JMS Notification
Query Connect(zSeries)
Event Manager
SQL
DataWarehouse
KnowledgeMaster Data
ServicesMaster Data
Database
IBM InfoSphere Master Data Management Server
Interfaces and message formats
Web Services XML Interface Java Object
MDM Server - Integration Options
• Technical Connectivity to many other application
• Adaptable Message format• Non proprietary technologies
© 2011 IBM Corporation28
Sending « Business Events » from IMS Applications
� What is … a Business Event?– Any electronic signal (message) indicating a
change in the state of the business has occurred
� Event message is created by the IMS application
– Based on data included in IOPCB– Based on database content– Based on application logic
� Event message is sent based on IMS Calloutsolutions
– Using IMS API•Enhanced with IMS SOAP Gateway Business Event Support
– Using MQ API– Synchronous or asynchronous
Event Processing
Business Users
A PIN is changed
A call to the help desk
A New Location is Detected
A sale is made
“Events… pass silently back and forth… as unrelated pieces of communication. They are a source of great power, for when they are correlated, they yield a wealth of information.”Dr. David Luckham, Professor Emeritus, Stanford University
© 2011 IBM Corporation2929
WebSphere Business Events
Con
nect
ors
ESB
Code/API
Adapter
WebSphere Business Events – Connectivity Options
� Embedded Connectors– Database– Email– File System– FTP– JMS– Web Services– (and more)
� Enterprise Service Bus
� Custom Code using API
� 3rd Party Application/Adapter
© 2011 IBM Corporation30
Integrating IMS applications / data in Web 2.0 applications
� Think of Web 2.0 as a concrete implementation of SO A philosophy, and more :)– And reuse existing IMS assets in new combinations
� Using IBM enterprise mashup solutions – IBM Mashup Center — a comprehensive mashup platform, supporting line of business
assembly of simple, flexible, and dynamic web applications - with the management, security, and governance capabilities IT requires.
• Create Atom feeds from both IMS transactions and IMS databases• Use tooling support from Rational Developer for System z and IMS Enterprise Suite DLIModel
utility – IBM WebSphere sMash — provides an agile, dynamic scripting environment and an
integrated runtime component for building and running REST-style services on top of IMS Connect API using the 3 languages (Groovy, Java and PHP)
� Offer for IMS Customers – IBM Mashup Center V2 to IMS 10 & IMS 11
customers for free – Use limited to IMS and two SQL data servers
in support of IMS solution
http://www-01.ibm.com/software/data/ims/mashup.html
IMS
DB
© 2011 IBM Corporation31
Agenda
� IMS Applications – Rejuvenate, Leverage and Grow– SOA Integration– WOLA IMS Support– Enhancing application development environment– Using Business Rules Management Services– Accessing Master Data – Integration with Business Event Services
� IMS Database – Build their Future – Smart Data Access– Smart Data Governance– Smart Data Integration– Smart Operational Business Intelligence
© 2011 IBM Corporation32
IMS DB in Perspective
InfoSphere IMS Replication Replication to IMS
IMS 11 Open databaseFast integration in Web 2.0 applications
Decomposed or IntactXML Support
COGNOSOperational Business Intelligence
InfoSphere Classic Data Event PublisherPublication of DB Changes
InfoSphere Classic Replication Server & Classic CDCReplication to Relational
InfoSphere Classic FederationData Federation
Information Integration & Data Synchronization
OPTIM FamilyCreation of Test databases
OPTIM FamilyData Masking
IMS Tools – Guardium Tools (planned)Audit for every access
IMS Tools – Guardium ToolsCompression and Encryption
Enterprise Data Governance
IMS ToolsReorganization for better performance
IMS ToolsBackup and Recovery Advanced Solutions
Pointer validation & repairHealth Check
DFSMS familyAdvanced Space Management Capabilities
Data Management
IMS 11 Open DatabaseOpen Access and Data Integration
IMS JavaJava SQL support (JDBC)
COBOL, PLI, C, … JAVAMulti-language AD support
Application Development
1/2 the MIPS and 1/2 the DASD of relationalPerformance without CPU extra cost
IMS Data SharingHigh Availability
HALDB & DEDBHigh Capacity
Native Quality of Services
© 2011 IBM Corporation33
z/OS Database Manager Positioning
� Hierarchical – Operational Data– Utmost performance– Real time mission critical work – Bill of materials applications– Complex data structures with many levels
� XML – B2B– Document exchange and storage
� Relational – Warehousing– Complex queries– Decision support – Tabular data – accounting data
33
CUSTOMER
BILL
COMMAND
ARTICLEPRODUCT
CUSTOMERCUSTOMER
BILLBILL COMMANDCOMMAND
PRODUCTPRODUCT
ARTICLE
© 2011 IBM Corporation34
Enhancing IMS DB Openness and Integration
� Access to IMS DB with traditional IMS API– Using “DL/1 Calls” from traditional application, support for many languages– In CICS or IMS transactions, in IMS standalone batch or BMP
� Access to IMS DB with relational API– Using JDBC SQL calls for Java programs on z/OS or distributed
• Implemented by IMS Java component of IMS• Distributed access enhanced with IMS 11 Open Database – Full DRDA Support• Based on a relational view provided by IMS Enterprise Suite DLIModel Utility
� Using IMS DB to store XML data– Like IMS DB, XML data is hierarchical
• It is simple to map IMS data into XML documents.• All IMS databases are Virtual XML Databases
© 2011 IBM Corporation35
IMS Open Database Overview
IMS DB
z/OS LPAR
SCI
PC
DRDA RYO Client
CSL RYO Client
SCI
CICS
Stand-alone* Java DL/1
Stand-alone* JDBC
JavaEEJDBC
Application Types
IMS Connect
D
R
D
A
Note: In addition, you can use the CCI programming style in a
JEE environment to access IMS databases using either
simple SQL calls (non-JDBC) or simple DL/1 calls
* In this context, “stand-alone” means “standalone Java SE”
ODBM IMSODBA
TCP/IP
JavaEEJDBC
Stand-alone* JDBC
Stand-alone* Java DL/1
e.g.
WAS
e.g.
IMS TM
SCI
© 2011 IBM Corporation36
Information Governance Creates Order out of Information Chaos
� Information Governance is the exercise of decision rights to optimize, secure and leverage data as an enterprise asset.
– Safeguards information – Ensure highest quality– Manage it throughout lifecycle
� Governing the creation, management and usage of ent erprise data is not an option any longer.
� It is– Expected by your customers– Demanded by the executives– Enforced by regulators/auditors
© 2011 IBM Corporation37
Data Governance
Manage Data Lifecycle
•Data Retention•Data Retirement
Secure•Prevent Access• Restrict Access• Monitor Access
Protect & Privacy•Mask Data•Encrypt Data
Audit•Audit Privileges•Audit Users•Audit Access
DB2/RACF Security
Tivoli zSecure Audit
Audit Mgt. Expert (AME) for IMS
Guardium and AME for DB2
Tivoli zSecure
InfoSphere Guardium Data
Encryption for DB2 and IMS Databases
Optim Test DMOptim Data
Masking Option
Optim Data Growth Solution
IBM is the only solution provider with an end to en d comprehensive solution
Reduce risk fromSecurity breaches
Protect sensitive customer and employee data
Comply with internal and external auditing requirements
Archive inactive dataand reduce amount of dataexposed and requiring protections.
Enterprise Data Governance for System z
© 2011 IBM Corporation38
Current
Production
Historical
Selective Retrieval
Retrieved
Universal Selective Access to Application Data
Managing Data Growth in Production – OPTIM Data Growth
Archives
Reporting
Data
Historical
DataReference
Data
Selective Archive
Optim
� Segregate historical data to secure archive
� Align performance to service level targets
� Reclaim underutilized capacity
� On z/OS: Support for DB2, IMS DB, VSAM– IMS DB and VSAM support provided by Distributed Data growth based on Classic Federation on
z/OS and InfoSphere Federation Server– Native support on z/OS planned
© 2011 IBM Corporation39 39
Managing Test Data in Non-Production – OPTIM Test Data Management
� Create right-sized test environments, providing sup port across multiple applications, databases and operating systems
� Deploy new functionality quicker and with improved quality & customer satisfaction
� Compare results during successive test runs to pinp oint defects and errors
� On z/OS: Support for DB2, IMS DB, VSAM
100 GB
Development
100 GB
Test 100 GB100 GB
Training
100 GB100 GB
QA
Production or
Production Clone Subset
1 TB
http://www-01.ibm.com/software/data/data-management/optim/core/test-data-management-solution-zos
© 2011 IBM Corporation40 40
Data Masking and Protection - OPTIM Data Masking Option
� Reduce risk of exposure during data theft– Fines and lawsuits– Avoid the negative publicity– Customer loss– Loss of intellectual property
Personal identifiable information (PII) is maskedwith realistic but fictional data for testing & development purposes.
http://www-01.ibm.com/software/data/data-management/optim/core/data-privacy-solution-zos/
� De-identify for privacy protection
� Deploy multiple masking algorithms
� Provide consistency across environments and iterations
� No value to hackers
� Enable off-shore testing
� On z/OS: Support for DB2, IMS DB, VSAM–Compare “before” and “after” images of test data for DB2
© 2011 IBM Corporation41
ISPF
Workstation
Repository Services
Data Access Services
Archiving Services
Subsetting Services
Data Privacy Services
Open Data Management
Security
Server
Storage Independent ArchiveStorage Independent Archive
IndexIndexDataData
Metadata
Artifacts
Storage Independent ArchiveExtract & Archive Files
IndexIndexDataData
Metadata
Artifacts
DataData
Metadata
Artifacts
ODBC/JDBC
DB2Optim
Directory
IMS
IMS Native Access
Orders Products
DB2
DB2 Access
Employee Payroll
VSAM / SEQ Files
Native Access
Customers Payments
OPTIM Test Data Management and Data Privacy
© 2011 IBM Corporation42
Secure & Protect High Value Databases - Guardium Real-Time Database Monitoring
� Non-invasive architecture
� Heterogeneous, cross-DBMS solution
� Does not rely on native DBMS logs
� Minimal performance impact (2-3%)
� No DBMS or application changes
� Activity logs cannot be erased by attackers or rogue DBAs
� Automated compliance reporting, sign-offs & escalations (SOX, PCI, NIST, etc.)
� Granular, real-time policies & auditing
� Locate and assess vulnerabilities in db security
DB2 & DB2/z
http://www-01.ibm.com/software/data/guardium/
© 2011 IBM Corporation43
extract, transform, load
BusinessApplication
Message Queue
ETL
Multiple Data Delivery Methods for Enterprise Needs
Bulk Data Delivery
Region 1 Product
Performance
Region 2 Product
Performance
Analytical & Reporting Tools
Web Applications
Product Performance
Real-time Inventory Level
federation
Virtual Data Delivery
Database
Incremental Data Delivery
PrimaryDatabase
BackupDatabase
change data capture
change data capturechange data capture
change data capture
© 2011 IBM Corporation44
Leverage Critical “Classic” z/OS Data Resources in Today’s EnvironmentFederation – Publication - Replication
� Leverage your z/OS data resources
� Optimize bandwidth utilization
� Enable real-time data warehousing
� Reduce dependence on batch window
z/OS
DB2z/OS
IMS
QSAMVSAMPDS
CADatacom
CAIDMS
SAGADABAS
Application or
ETL Tool
ExtractClassic Fed
Load / UpdateData Warehouseor
Other Relational container
Classic EP,Classic Rep
Publish Changes
© 2011 IBM Corporation45
Federation - Access your IMS data as well as many other z/OS data sources
� Read-from & write-to mainframe data sources– Using standard ODBC, JDBC or Call-Level-
Interface SQL– Without database/file unique API skills
� Metadata-driven means– No mainframe programming required – Leverages COBOL & PL/I copybooks, DBD
source, etc.
� Deliver mainframe data to– Self-service portals … e.g. accurate account
details– e-commerce solutions … e.g. up-to-the-
second inventory– Reporting and analytical tools such as
Cognos– Data transformation and cleansing tools such
as DataStage and QualityStage for data warehousing, ODS, MDM, etc.
z/OS
MetadataCatalog
Classic Server
ClassicData Connectors
ClassicDataArchitect
Distributed
platform
Tool Application
Classic Client
COBOL or PL/Icopybooks IMS,
IDMS, Datacom,
and Adabas databasesVSAM & seq. files
JDBC / ODBC / CLI drivers
© 2011 IBM Corporation46
Publication - Capture and Publish IMS DB Changes
� Near real-time changed-data capture & push to:
– ETL tool for incremental updating of a data warehouse
– Application integration to drive downstream processes
– Portals & other Web-based interfaces to stream live data
� Capture data “events”– Monitor source specific logs, journals, etc – Capture changes as they happen– Fully recoverable
� Format data for optimized utilization– XML for broad consumption– Delimited values to reduce message size– “Raw” format to optimize performance with
DataStage
� Deliver data for consumption– WebSphere MQ for global delivery– File-based interface to optimize performance
with DataStage
Changes
z/OS
metadatacatalog
WebSphere MQ
IDMSJournaling
ClassicData Architect
Adabaslogging
IMSlogging
MVSlog
VSAM
CICS Auto-
journal
Change Capture Agents
Classic ServerCorrelation &
Distribution/Publication
"raw"data
© 2011 IBM Corporation47
Replication – From IMS DB to Relational
� High speed unidirectional replication for:– Creating relational copies of nonrelational data – Assisting in DB modernization – Enabling high-availability VSAM environments
MQQueues
Replication Server TARGET
TGT3
TGT1
Q ApplyBrowser
Apply Agent
Apply Agent
Apply Agent
TGT2
METADATA
Changes
z/OS
metadatacatalog
IDMSJournaling
ClassicData
Architect
Adabaslogging
IMSlogging
MVSlog
VSAM
CICS Auto-
journal
Change Capture Agents
Classic ServerCorrelation &
Distribution/Publication
Classic Replication Server SOURCE
© 2011 IBM Corporation4848 January, 2011
InfoSphere Classic CDC – Announced May 2011
� Enable IMS Databases on z/OS as InfoSphere CDC Sourc es – Classic CDC provides the IMS SOURCE capabilities– TARGETing done by CDC on z/OS OR LUW
� Unidirectional movement of IMS data to– Local or remote RDBMS– Message queues– Flat files– Transformation engines, e.g. InfoSphere DataStage
� Classic CDC IMS “Capture” supports – DB/TM, DBCTL, Batch DL/I – Capture x’99’ log records
� Basic replication monitoring in the initial release via the Management Console
� Multiple modes of incremental delivery – Continuous mirroring
• Apply data changes at the target as it is generated at the source– Scheduled end (periodic mirroring)
• Apply net changes on a scheduled basis– Refresh
• Apply a snapshot version of source system
© 2011 IBM Corporation4949 January, 2011
SOURCE
InfoSphere Classic CDC
Target (CDC Apply)• Receives captured changes • Queries database metadata tables• Applies changes with transactional semantics
ManagementConsole
Classic DataArchitect
MetaData
ClassicCaptureEngine
Replication Replication ChangeChange
DetectionDetectionLRSLRS
Source Databases
Source Database
Logs
TARGET
Target Engine
Comm Layer
Admin APIMetaData
Admin Agent
TCP/IP Apply Agent
Refresh
cdcmonito
ring
config
uratio
n
Access Server
© 2011 IBM Corporation5050 January, 2011
InfoSphere IMS Replication – Announced May 2011
� Unidirectional Replication of IMS data– Release 1:
- Conflicts will be detected- Manual resolution will be required- External initial load of target DB- Basic replication monitoring
� Administration via Classic Data Architect & z/OS co nsole commands
� IMS “Capture” supports – DB/TM, DBCTL, Batch DL/I – Capture x’99’ log records– Increase in log volume due to change data capture records
� IMS “Apply” supports– Serialization based on resources updated by unit of recovery – New IMS Replication Restart Database required
© 2011 IBM Corporation5151 January, 2011
SOURCE SERVER
Classic DataArchitect
ReplicationMetadata
CaptureServices
Source IMS Databases
TARGET SERVER
TCP/IP
IMSLogs
IMS
DBRC API
RECON
ACBLIB
IMSApplyServices
Target IMS Databases
ReplicationMetadata
ACBLIB
BookmarkDB
Admin. Services Admin. Services
InfoSphere IMS Replication – Announced May 2011 …
© 2011 IBM Corporation52
IBM Data Warehouse and BI System z Solution
� From traditional data warehousing to dynamic wareho using and operational BI– Getting the best of both worlds: z/OS and zLinux
Information Server
for System z
DB2 for z/OS
Data Warehouse
Cognos 8 BIfor
System z
Serving Up Consolidated Enterprise BI
Complete ETLSolution
The Enterprise Data Warehouse
InfoSphere Warehouse Cubing
Services
InfoSphere Warehouse
SQW
Source Systems :DB2
IMS DBVSAM
IBM Smart AnalyticsOptimizer
OLTPdata
© 2011 IBM Corporation53
Adding IMS database queries to a Business Analytics solution
� Extending your Reporting and BI capabilities to IMS provides
– Real-time access to IMS data for report generating
– Advantages of creating and managing business-related metadata and translating it into visual presentations
– Knowledge to help decision makers know sooner, understand faster, and react quicker than the competition
– Ability to compare performance across dimensions to spot trends and anomalies over time
Windows, Linux, Unix, and zLinux z/OS
Cognos
IMS Univers
al Databa
se Driver
TCPIP
TCPIP
IMS Connect
SCI
ODBM
SCI
ODBA
CTL IMS DB
PC
IMS
TCPIP
© 2011 IBM Corporation54
Agenda
Final Thoughts
� IMS Applications – Rejuvenate, Leverage and Grow– SOA Integration– WOLA IMS Support– Enhancing application development environment– Using Business Rules Management Services– Accessing Master Data – Integration with Business Event Services
� IMS Database – Build their Future – Smart Data Access– Smart Data Governance– Smart Data Integration– Smart Operational Business Intelligence
© 2011 IBM Corporation55
The Message
� IMS continues to be a premier server with architect ed standard interfaces– New products and tools from a variety of vendors provide access to IMS transactions
and data
� Our goal is to leverage IMS as an integral part of the enterprise in the evolving business world through
– Addition of support for complementary standards surrounding IMS connectivity, data representation, and application development
� And to allow you to realize the promise of building a Service Oriented Architecture– Simplify the business environment– Respond to market changes quicker and at less cost
© 2011 IBM Corporation56
� A NEW Team of “IMS Architecture”Specialists in Europe
– Technical Team Lead: Helene Lyon– Operate across Europe and Africa
� Team Mission– Confirm and secure existing IMS workload
and seek opportunities to derive new benefit and workload on existing systems.
� Job role– Develop database and transaction
management solutions that fully integrate and collaborate with existing IT systems in order to perform a business function, with a focus on the “right fit” positioning of the IMS DB and TM capabilities within those systems.
– Establish and maintain strong technical relationships with client architect team with a focus on improving the satisfaction and technical health
– Position the business value of System z & z/OS
Ask for Help from the NEW European IMS Architecture Team (IAT)
© 2011 IBM Corporation57
twitter.com/IBM_IMS
Twitter, Facebook, YouTube, LinkedIn, SlideShare, Tumblr and their respective logos may be trademarks or registered trademarks of Twitter Inc., Facebook Inc., Google Inc., LinkedIn Corp., SlideShare Inc. & Tumblr Inc., respectively.
imsmadesimple.tumblr.com
ibm.com/developerworks/mydeveloperworks/blogs/IMS
ibm.com/developerworks/mydeveloperworks/blogs/imscn/?lang=zh
t.sina.com/imschina
www.youtube.com/user/ReThinkIMS
www.slideshare.net/ibmims
www.ims-ug.org
facebook.com/IMSFans
imslistserv.bmc.com
ibm.com/vrm/newsletter/11069
linkedin.com/groups?mostPopular=&gid=1949922