S502 –Enterprise DevOps: Trends in continuous software
delivery
Gary Mazo
Sr. Software Engineer
Venkat
Balabhadrapatruni
Sr. Technical Staff
Member
IBM Software and
Systems Engineering,
Rational
GSE Nordic
June, 2014
Copenhagen
© Copyright IBM Corporation 2014. All rights reserved.
Information is confidential and must not be shared or redistributed without permission from IBM. Plans are based on best information available and may change in future.
DISCLAIMER
IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion.
Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.
The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.
Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.
© Copyright IBM Corporation 2014. All rights reserved. 3
About the speaker
• Gary Mazo is a software engineer with IBM
Rational Software and Systems Engineering
• 1987 Graduate of Leningrad (now St.
Petersburg) Polytechnic University
• Joined IBM in 1988 in Fortran compiler
development
• Has been with Rational since 2005
• During rare free time enjoys photography and
model rocket building with his 3 children
© Copyright IBM Corporation 2014. All rights reserved.
Topics
4
Brief history of Enterprise software development
Introduction to Continuous Delivery concepts
Enabling DevOps in Enterprise – Drinking our own champagne
Summary and Questions
© Copyright IBM Corporation 2014. All rights reserved.
Topics
5
Brief history of Enterprise software development
Introduction to Continuous Delivery concepts
Enabling DevOps in Enterprise – Drinking our own champagne
Summary and Questions
© Copyright IBM Corporation 2014. All rights reserved. 6
Transaction Systems
1960- 1990- 2010-
Web, e-business and SOA
Analytics, Mobile, Social, & Cloud
Pla
tfo
rms
Dedicated Systems
Single Database
Managed one Solution
Multiple Applications
Some shared data
Post Processing in Warehouses
Batch Processing
Time to Business Action
Interconnected Solutions
Action at real time speeds
Processing occurs NOW !!!
Business impact visualized
Action taken immediately
Strategic and Tactical differentiator
Time
accelerates its reporting process from 20 days to several hours and cuts reporting costs by 50 percent
Customer Insight through Social
Anaytics increased Site
revenue from product
recommendations by 70%
A new wave of business opportunities & IT challenges
© Copyright IBM Corporation 2014. All rights reserved. 7
Social, Local, Mobile
Smart Infrastructure Analytics
ERP DB
CRM HR
Manage workloads
and maintain security
Rapid innovation
in the cloud
User experience and
mobile management
New era systems integrate existing systems of record with new client-facing systems of engagement
© Copyright IBM Corporation 2014. All rights reserved. 8
54%
of companies believe software delivery is critical
25%
leverage software delivery effectively today
But only…
69%
outperform
those who don’t leverage
software delivery
effectively
Source: “The Software Edge: How effective software development drives competitive advantage,” IBM Institute of Business Value, March 2013
Software delivery is critical to success
© Copyright IBM Corporation 2014. All rights reserved.
Topics
9
Brief history of Enterprise software development
Introduction to Continuous Delivery concepts
Enabling DevOps in Enterprise – Drinking our own champagne
Summary and Questions
© Copyright IBM Corporation 2014. All rights reserved. 10
© Copyright IBM Corporation 2014. All rights reserved. 11
Lack of continuous delivery impacts the
entire business
Costly, error prone manual processes and
efforts to deliver software across an enterprise
CHALLENGES
Upgrade risk due to managing multiple application configurations and versions
across servers
Slow deployment to development and test
environments leave teams waiting and unproductive
CHALLENGES
Operations/ Production
Development/ Test Customers
Business Owners
Software glitch costs
major trading firm
$440 million in 45
minutes
A bad software upgrade
at a global bank left
millions unable to access
money for four days
Major telecom provider paid out
$2.7 million to 47,000
customers overcharged after a
software glitch
© Copyright IBM Corporation 2014. All rights reserved. 12
dev·ops noun \'dev-äps\
Enterprise capability for continuous software delivery that enables clients
to seize market opportunities and reduce time to customer feedback
An approach for continuous delivery of software-driven innovation
Reduce time to obtain and
respond to customer feedback
Balance speed, cost,
quality, and risk
DevOps Lifecycle
Continuous Innovation, Feedback and Improvements
Accelerate software
delivery
Operations/ Production Customers Business owners Development/Test
© Copyright IBM Corporation 2014. All rights reserved. 13
IBM DevOps solution
DevOps Foundation
Open Lifecycle and Service Management Integration Platform
DevOps Lifecycle Operations/Production Development/Test Customers Business Owners
Continuous Innovation, Feedback and Improvements
Ec
osy
ste
m
Bes
t Pra
ctic
es
Monitor and Optimize
Plan and Measure Develop and Test Release and Deploy
OSLC
Accelerating the delivery of multiplatform applications
© Copyright IBM Corporation 2014. All rights reserved. 14
DevOps in a multiplatform development environment
DevOps Foundation
Open Lifecycle and Service Management Integration Platform
DevOps Lifecycle Operations/Production Development/Test Customers Business Owners
Continuous Innovation, Feedback and Improvements
Ec
osy
ste
m
Bes
t Pra
ctic
es
Monitor and Optimize
Plan and Measure Develop and Test Release and Deploy
OSLC
GAP GAP GAP
Plan and Measure Develop and Test Release and Deploy
Improve feedback responsiveness
Create Agile and Lean practices to connect
business and IT
Automate functional, regression, load and integration testing
Reduce provision burden on Operations
Rapid solution delivery and test
provisioning
Resolve transaction failures and performance
bottlenecks
Bottlenecks in software delivery can result in
long delays, unnecessary costs, and waste of resources
Break down silos by moving to an Agile team environment
Offload development and testing to reduce
MIPS
Leverage common tools to build multiplatform
apps
© Copyright IBM Corporation 2014. All rights reserved. 15
Create Agile and Lean practices to connect business and IT
Strategic
Drivers
Ideas &
Demand
Portfolios
Reviews
Resources
Finances
Risks,
Issues,
Changes
Collaboration & Communication
Governance Progress
Monitoring
Plan and Measure
Open Lifecycle and Service Management Integration Platform
Continuous Delivery
Improve visibility and transparency
• Better align investment decisions
with value and organizational
strategies and priorities
• Plan releases predictably driven by
the needs of the business
• Gain control of development
initiatives by improving visibility and
transparency
• Provide proactive portfolio
evolution and delivery governance
Enabling you to…
Rational Focal Point
© Copyright IBM Corporation 2014. All rights reserved.
Topics
16
Brief history of Enterprise software development
Introduction to Continuous Delivery concepts
Enabling DevOps in Enterprise – Drinking our own champagne
Summary and Questions
© Copyright IBM Corporation 2014. All rights reserved. 17
Leverage common tools to build multiplatform apps
• Leverage common Eclipse-based
IDEs for all types of development
• Access broad coverage of
runtimes, languages, compilers,
and platforms
• Access via cloud-based
environments like SmartCloud
Enterprise+ (SCE+)
• Create agile services from
existing mainframe assets
Open Lifecycle and Service Management Integration Platform
Continuous Delivery
Boost developer productivity Rational Developer for the Enterprise IBM Worklight for MobileFirst platform
Enabling you to…
Develop and Test
© Copyright IBM Corporation 2014. All rights reserved. 18
Break down silos by moving to an Agile team environment
• Manage all types of source -
JavaScript to COBOL
• Create work items spanning
technologies and solutions
• Accelerate agile adoption on the
mainframe
• Integrate existing SCMs and
deployment tools, e.g. ChangeMan
and Endevor
• Use Lifecycle integration adapters
for third-party tools
Open Lifecycle and Service Management Integration Platform
Continuous Delivery
Project Managers /
SCRUM Masters Quality and Test
Agile Teams
Developers
Administrator
LoB / Business
Analyst
Maximize team productivity Rational Team Concert Rational Requirements Composer Rational Quality Manager
Enabling you to…
Develop and Test
© Copyright IBM Corporation 2014. All rights reserved. 19
Automate functional, regression, load, and integration testing
• Fully embrace automated testing
• Create test automaton of native
and hybrid mobile and mainframe
applications
• Run automated tests to validate
builds
• Take advantage of over 70
technologies and protocols out of
the box
Enabling you to…
System User Acceptance
Operability Unit / Integration
Improve application quality
Open Lifecycle and Service Management Integration Platform
Continuous Delivery
Includes
Green Hat
technology
Virtual
Component
Real
Implementation
Rational Test Workbench - leveraging Green Hat Technology
Develop and Test
© Copyright IBM Corporation 2014. All rights reserved. 20
Offload development and testing to reduce MIPS
Note: This Program is licensed only for development and test of applications that run on IBM z/OS. The Program may not be used to run production workloads of any kind, nor more robust development workloads including without limitation production module builds, pre-production testing, stress testing, or performance testing.
• Rapidly prototype new applications
• Develop and test System z
applications anywhere, anytime
• Free up mainframe development
MIPS for production workload
• Eliminate costly delays by reducing
dependencies on operations staff
• Try latest middleware, including CICS
5.1, IMS 12.1, and WebSphere 8.5
• System z Development and Test
Solution
RDz & ISPF
RDz
Improve development flexibility
Open Lifecycle and Service Management Integration Platform
Continuous Delivery
Rational Development and Test Environment for System z
Enabling you to…
Develop and Test
New
© Copyright IBM Corporation 2014. All rights reserved. 21
Open Lifecycle and Service Management Integration Platform
Continuous Delivery
Reduce provisioning burden on Operations
• Test in isolation with ‘stubbed’ or
‘mock’ services
• Virtualize CICS applications inside
the mainframe and Java applications
in the JVM
• Reduce development dependency
on operations
• Minimize subsystem dependency
during testing
• Reduce infrastructure costs and free
up MIPS for production use
Maintain test LPARs effectively Rational Test Virtualization Server - leveraging Green Hat technology
Includes
Green Hat
technology Enabling you to…
Develop and Test
Databases Mainframe applications
App Under Test
Third-party Services
Packaged apps, messaging services, etc.
Virtual Services
New
© Copyright IBM Corporation 2014. All rights reserved. 22
Rapid solution delivery and test provisioning
• Provision consistent images for test
environments, reduce rework, and
speed redeploy of application changes
• Quickly deploy multiple test instances in
minutes versus hours or days
• Support mainframes using zLinux and
z/OS native agent for Java applications
• Orchestrate and automate the
deployment and management of
applications, middleware configuration,
and databases
Application Blueprint
Deliver test environments in minutes IBM UrbanCode Deploy IBM UrbanCode Release IBM SmartCloud Orchestrator
Release and Deploy
Enabling you to…
New
© Copyright IBM Corporation 2014. All rights reserved. 23
• Collaborate between development
and operations with centralized
incident management and tracking
• Quickly determine the root cause of
critical cross-platform applications
• Easily determine application health
and quickly isolate the source of
any issues
Manage and optimize application and infrastructure performance
Gain actionable insights IBM SmartCloud Application Performance Management IBM SmartCloud Control DesK
Monitor and Optimize
Enabling you to…
© Copyright IBM Corporation 2014. All rights reserved. 24
• Increase visibility into the actual
customer experience
• Quickly diagnose and resolve
issues
• Easily quantify business impacts
• Perform real-time customer
analytics
Improve feedback responsiveness
Analyzing the customer experience challenges IBM Tealeaf IBM Digital Analytics
Monitor and Optimize
Enabling you to…
Analytics
Repository
Worklight
Server
Server Data
Client Logs
Interact
with the data
© Copyright IBM Corporation 2014. All rights reserved. 25
DEVELOPER VALUE
Increase Programmer Productivity
Bolsters overall benefits of CICS, IMS, DB2
Modernize Applications to work with web, cloud and mobile infrastructures
Increase Performance of Business Critical Applications
Enterprise COBOL for z/OS v5.1 The key to supercharging IBM System z Applications
Advanced technology designed to optimize COBOL programs and fully exploit z hardware
– Delivers greater than 10% performance improvement over Enterprise COBOL v4 for well structured, CPU-intensive batch applications on System z1
– Many numerically intensive programs have shown performance increases greater than 20%1
– Maintains compatibility with previous COBOL releases
New programming and application modernization capabilities
– Enables users to deliver enhancements to business critical applications quicker with less cost and lower risk
Allows users, who implement sub-capacity tracking, to reduce administrative overhead
"Our testing of COBOL V5 shows a significant performance improvement for math.
As a financial services company with a continually narrowing batch window, that
improvement is very important to us. It will help us meet our Service Level
Agreements and reduce cost driven by CPU utilization.”
Michael A Todd, Software Architect
where Tradition Meets Innovation…
1 Results are based on an internal compute-intensive test suite. Performance results from other applications may vary.
Supports the ecosystem of COBOL
development tools supplied by IBM
and ISVs
Monitor and Optimize
© Copyright IBM Corporation 2014. All rights reserved. 26
Develop and test capabilities for mobile applications
• Quickly design, code, build, test,
and deploy mobile apps that run on
a wide variety of mobile platforms
• Refactor and extend existing back-
end services to provide an optimal
mobile experience
• Stub out back-ends to simplify test
and development
• Automate testing for native and
hybrid mobile apps
Accelerate mobile application development Rational Test Workbench IBM Worklight for MobileFirst platform Rational Business Developer Rational Application Developer Rational Developer for the Enterprise
Enabling you to…
Deploy
Code
Test
Open Lifecycle and Service Management Integration Platform
Continuous Delivery
Construct, debug, and test mobile
and Web applications
Design
Refactor and extend existing logic as
mobile-consumable services
New
New
Develop and Test
© Copyright IBM Corporation 2014. All rights reserved. 27
Drinking our own champagne – Rational Developer Traveler Experiment
© Copyright IBM Corporation 2014. All rights reserved.
SaaS Software as a Service
Email,
Calendars,
ERP/CRM,
Communications,
End user application
development
tools
PaaS Platform as a Service
Operating System,
App, Web,
HTTP server,
Databases
Monitoring and
system ops
IaaS Infrastructure
Hardware and
HW virtualization:
Virtual machines
Servers,
Network,
RAM,
Disk and other
storage
Cloud clients:
Mobile, Web
Browser, API
Cloud application: concepts overview
28
© Copyright IBM Corporation 2014. All rights reserved.
SaaS Software as a Service
Email,
Calendars,
ERP/CRM,
Communications,
End user application
development
tools
PaaS Platform as a Service
Operating System,
App, Web,
HTTP server,
Databases
Monitoring and
system ops
IaaS Infrastructure
Hardware and
HW virtualization:
Virtual machines
Servers,
Network,
RAM,
Disk and other
storage
Cloud clients:
Mobile, Web
Browser, API
Cloud application: concepts overview
HTTP HTTP HTTP
29
© Copyright IBM Corporation 2014. All rights reserved.
Eclipse Orion
HTML
JavaScript
dojo
AJAX
System components – Rational Developer Traveler Experiment
zOS Resource
Server
Middle Tier –
WAS Liberty Profile
Core
Services
MVS Files
zFS Files
JES
Application
Container
Web
Container
REST API for
the Resource
Server
TCP/IP
REST
30
Persistence
and admin
services
HTTP
© Copyright IBM Corporation 2014. All rights reserved. 31
Drinking our own Champagne – RD Traveler Experiment challenges
Very different environments
Orion, JavaScript, CSS etc.
JavaSE, WAS Liberty/OSGi/JPA etc.
zOS C, HLASM, COBOL, ISPF
Dispersed team with different backgrounds
4 corners of North America (US and Canada)
Informal development process (“Lean Startup”)
Standard internal support for development
Very short release cycles (every ~2.5 months)
© Copyright IBM Corporation 2014. All rights reserved. 32
Drinking our own Champagne – How DevOps help RD Traveler respond to challenges
Very different operating environments
Use RDz to develop/test/debug across all components
Use RD&T to test
Dispersed team with different backgrounds
Use RTC and IBM Connections to communicate, plan,
design, document, track deliverables, bugs, progress
Informal development process (“Lean Startup”)
Use RTC to automate build and packaging
Plan to use UrbanCode uDeploy to deploy
Use IBM developerWorks to connect to clients
© Copyright IBM Corporation 2014. All rights reserved.
Topics
33
Brief history of Enterprise software development
Introduction to Continuous Delivery concepts
Enabling DevOps in Enterprise – Drinking our own champagne
Summary and Questions
© Copyright IBM Corporation 2014. All rights reserved. 34
Summary
• There are challenges to delivering
software-driven innovation
• Disruptive technologies are driving
greater need to innovate
• DevOps is critical to your success
• IBM has first class DevOps solutions
and is continuing to invest and
improve upon these solutions
• DevOps is just as relevant, if not
more so, for System z as it is for
distributed environments
© Copyright IBM Corporation 2014. All rights reserved.
References
35
IBM Institute for Business Value (IBV) report on Continuous Software Delivery
http://www-935.ibm.com/services/us/gbs/thoughtleadership/softwareedge/
Software delivery challenges
http://gizmodo.com/5931284/software-glitch-costs-trading-firm-440-million-in-45-minutes
http://www.theregister.co.uk/2012/06/25/rbs_natwest_what_went_wrong/
http://business.scoop.co.nz/2011/10/19/telecom-makes-2-7m-settlement-for-incorrect-meter-readings/
DevOps and Mainframe – how they relate
https://www.youtube.com/watch?v=9vxzY8ADA6Y
RD Traveler Sandbox https://rdt1.demos.ibm.com/RDT/home/Home.html#
RD Traveler on IBM developerWorks http://ibm.co/rdtraveler
The Lean Startup http://leanstartup.pbworks.com/w/page/65946049/Intro%20to%20Lean%20Startup
© Copyright IBM Corporation 2014. All rights reserved.
www.ibm/software/rational
36
© Copyright IBM Corporation 2014. All rights reserved.
FEEDBACK!
37
Please don’t forget to submit your session and speaker feedback!
Session S502
25/05/2014
© Copyright IBM Corporation 2014. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.
38
www.ibm/software/rational