SOA Trends
Events, Web2.0 and Cloud in the SOA mix
Ramesh LoganathanVP (Products), Progress Software (India), Hyderabad
Agility: Respond faster to changing business needs; create and modify business processes
Integration: Eliminate boundaries between business functions and integrate value chains
Re-use: Make services broadly available, including across the Internet “cloud”
The SOA Promise
And, the SOA “enablers”.. are complex!
Gov
erna
nce
Repository
XM
L ba
sed
UI
Registry
XML DB Standards Interoperability BAM
SOA gets into serious adoption phase, solution models beyond just the integration patterns come into play.
Paradigms are shifting to now use SOA concepts in ground-up solution design- beyond just integration.
More demands from Real-world SOA
RReality intrudes along multiple dimensions:
SOA must be fast, reliable, scalable and secure
Heterogeneity
Distribution
SOA will span systems running on many computers, managed by different IT groups
SOA will incorporate many platforms, applications and data models
Real-world SOA
Quality of Service
The Challenges of the Real World
SOA Management
Complex Event
Processing
Business Process
Management
Mainframe Integration
Services Infra
Registry/Repository
Enterprise Messaging
Data Interoperability
Real-world SOA
Scalable messaging
for Distributed enterprise
Make biz sense of Events •RFID
•Trades
Access to legacy and mainframes
systems•IBM•SAP
Visibility into services,
availability and
accesses
•Configure•Control
Data from multiple
apps and databases
•Oracle•DB2
Model and execute biz
flows•Processes•Workflows
Many, disparate
and distributedservices
•Register•Locate
Service containers
and mediation
EDAEDA
Web2.0Web2.0VirtualizationVirtualization
As the paradigms shift..Three key drivers are emerging
One key element is the Web2.0Web2.0 approach to user interactions and control in what the user sees in the enterprise and howThe second is the evolution of optimized EventEvent handling infrastructure, Third, VirtualizationVirtualization and the resulting CloudCloud
In this session we will discuss some of these trends in Event Infrastructure and Web2.0 space in the SOA context.
In this session we will discuss some of the real-world trends in the SOA space.
The outline: • Events and ESP• Event Driven SOA• Further distribution thru virtualization
• Enter SaaS• PaaS adding a new dimension• Virtualization- abstracting the hardware and operating layer
• Where do they all meet?• The resulting computing cloud
• SOA in the cloud• User into the mix- Web 2.0 style• The synergies, Emerging enterprise architecture models
Outline
Ever increasing needs for speed
The increasing speed of business has led to an associated need to increase the speed of regulation.
Business leaders have begun to issue a tidal wave of mandates and regulations to deal with the increasing speed
of business:
eBay; Dell;
The world is moving to real-time –− Real-time manufacturing
− Real-time retail, and − Real-time operational infrastructure.
Building Innovation and Efficiencies
So real-time business, real-time regulation, and real-time risk
management combine to motivate new real-time
technologies. But what kind of new
technology?
Real TimeBiz
Regulation &Compliance
New technologies
Need to “react” faster
The enabling Technologies SOA forms the base
− SOA is a technical architecture that allows software systems to interoperate dynamically.
But an effective SOA alone does not satisfy the requirement for instant business insight.
Business Activity Monitoring, or BAM, is a one element to business insight. Leveraging SOA for access to information
The Technology
Need: Instant IT Insight
But where’s the event data for BAM?
Event infrastructure is the “link” Event infrastructure will provide necessary frameworks for event detection,
handling and processing Event driven solutions will demand more accurate and fast data sources, event
fabric and processing environments Solutions will need to truly harness the power of an ESB Providing a foundation from which to answer real-time biz questions Say:
− "How many plasma screens do we have in stock, how many have been ordered, what is our rate of consumption, and how are we doing against our forecasted rates - right now?"
− “Is bad weather forecast within 10 minutes of this flight’s path? If so, re-route the plane, determine which passengers will be impacted by delays, rebook the passengers, update kiosks and gate agents at all locations, and update our real-time P&L.”
− “If transactions have occurred in the last 5 seconds against this credit card from different businesses in different physical locations, deny the most recent request and alert fraud detection of the account in question.”
An effective EDA needs a solid new form of computing – Event Stream computing.
Further: Complex Event Processing
Heterogeneity: Adapts to any event source Distribution: Correlates complex events
from across the enterprise – anywhere in the SOA
QoS: Reacts in real-time with ultra-low latency and scales to monitor tens of thousands of conditions
Real-time response to fast-changing business conditions. Detecting the “patterns” to recognize compelx events.
“We increased machine capacity by 7% and our operating production efficiency by 15%.”
- Dave Barna, CFO, Premier Manufacturing (Manuvis Customer)
Events, BAM, CEP- All combined with SOA for …
Define: Event Driven Architecture
EDA provides an architecture that enables the real-time intelligence that
drives real-time trading, real-time supply chains – real-time business
operations of any type.
ED-SOA, a case of EDA
Event-Driven SOAWho Benefits Most?
Event-based Applications / BAM− Manufacturing and logistics− Algorithmic trading− Risk and compliance management− Airline operations− Emergency response
Application Integration Optimized by Events− Agility through extreme loose coupling− Supports real-time processing− Better supports federation
Events in the ESB bus
bus
container
Orch processescontainer
container
Orch processescontainer
container
ESB processescontainer
eventsCBR
Service aService b
Service c
event aevent b
event c
CBREndpoints
•Define events•Define routing TO
Process emits events Events trigger processes
A typical Event-Services flowDefine event type
Subscribers for the event
Define event generator
Structure (schema of event data); Event generic metadata (type, et al)
Much like an ‘inverse service’
Instead of being ‘invoked’, this ‘emits’ an event
Event router (like a CBR)
Define validation, filters et al (a basic ESP)
At end, Will propagate to all subscribed ‘listeners’
Define the event consuming mechanism
Enlist subscribers to the event-router
Most likely a biz-process in the SOA environment
Delta Airlines
Consider this
Need to bring the Event Infrastructure into the services mix
here!
The Delta Nervous System monitors operational events, analyzes them, and makes operational decisions – all in real time.
Tracks weather forecasts and flight positions Need to identify patterns among the events
− Such as changes in the weather that might determine flights that need rerouting.
When flights are rerouted, passengers are to be rebooked in real time
Alert Delta flight operations personnel of the status of flights, and messages to kiosks in terminals and gate agents
Keep the whole operational organization synchronized.
weather
flights passengers
An ESB Provides the BackboneThe ESB provides a bus that enables
a flexible, integrated fabric of services.
− Networking− Communication backbone− Mediation layer− Service container management
Together enable a loosely coupled, service oriented architecture.
ESB offers an integration backbone, and
ESP provides the tools to monitor, analyze, and act on events on the ESB - in real time.
Event Fabric is tightly integrated
SaaS- easy acquisition of new apps
e2o
NewSolution
Simplify ‘acquiring’ new solutions..
Vendor
Server
platformAppinstances
3. ISV to procure hardware. 3. ISV to procure hardware. Setup app.Setup app.
SaaSapp2. Subscribe to the app2. Subscribe to the app
1. Evaluate and decide1. Evaluate and decide
4. Users can access app4. Users can access app
enterprise
Multiple view of SaaS•The enterprise will just need to sign up and the solution is available- in a traditional utility model, ‘off the tap’. •This lets the small enterprise focus on its core business and not have to deal with any aspect of the IT solution operations.
•SaaS provider takes care of hosting and managing the production
operations.
•The Software is either completely hosted or parts of the functionality
hosted.
•In SaaS, typically, a specific application or solution is offered in a managed model .
•With the client just signing up for the solution and accessing it over the web- all
operational aspects taken care by the SaaS provider.
SolutionSolutiondevelopersdevelopers
ProductionProductionteamteam
Manage- ment
end end usersusers
www
•Simply access the app from a browser!
enterpriseisv
Virtualization- abstracting the env
I1
I2 I3 I4
I5
I6
Load Balancer
EC2
S3
New instance provisioned &
added to cluster
www!
System Admin
Virtualization enables Elastic app server
Abstracting out the platforms
Even better: Server virtualization over the web
I1
I2 I3 I4
I5 I6
Load Balancer
EC2
S3
!System Admin
www
www
Product/solution virtualization− Building solutions that do not have any assumptions
on where and how it is run
− On dedicated servers, or if for just a single end-client, or if multi-tenanted.
Platform options available − Server virtualization software that enable creating
dedicated and custom SaaS platforms
− Or platforms such as Amazon EC2 that area ready and available for use in SaaS
Challenge: getting an app ready for virtualization
The computing ‘cloud`’
The cloud- built on Virtualization Cloud: computing env on the www/net SaaS abstracts the application
− Just access the solution as a service− Without having to worry about hardware,
platforms, installation, configuration and administration
Virtualization abstracts the hardware and platform
− The physical computing platform is abstracted out by multiple ‘virtual’ platforms- each giving the end user a virtual dedicated platform.
SaaS solutions could possibly run on virtualized platforms
Virtualization platforms− The platform may be a
virtual OS instance with the equivalent of a specified CPU, memory and network resources.
Transparent Access− How this resource is
made available, from the underlying physical computing platform/machines, is left to the virtualization infrastructure and system software.
Standard abstractions− OS and application
environment
SaaS, further simplified with virtualization
e2o
NewSolution
Simplify ‘acquiring’ new solutions..
Vendor
ServerVirtualization
platform
Appinstances
3. Provision and configures app instance on virtual server platform
SaaSapp2. Subscribe to the app
1. Evaluate and decide
4. Users can access app
Can this be extended to SOA?
cloud
www
enterpriseintranet
The emerging enterprise computing infrastructure
5
12
Usersaccess
on www
!admin
Web based Admin
www4hosted
SaaS
5SaaS
S3s3
5Cloudplatform
AmazonEC2
3InternalSaaS
virtualization5
virtualizationplatform
CordysBPM-on-demand
5PaaSPaaS
Google App engine
5
The Cloud!
Getting SOA onto the cloud SOA brings forth a seamlessly integrated enterprise solution landscape
− Virtualized application components “in” the cloud− All having a services layer (along with web based UI)
Can be extended to the web− Break down the ‘service’ component− As a federated “set” of services in the SaaS cloud!
Orchestrated to serve biz processing needs− Including, on-demand end user driven orchestration− Changing the application paradigm, from complete solutions to a set of
services available for end user to “orchestrate as needed” Every solution in cloud WILL have services layer
− A federated “set” of services in the SaaS cloud!
Shipping
warehouse
Finance
integrated in the cloudServices
Services, in a SaaS mode, in the cloud
Business Processing using services in the “cloud”
SAASSAAS
Bank.comBank.com
.com.com
Internet
Desktop Corp appCorp app
FinancialsFinancials
HRHR
Intranet
In Web 1.0- users were at fringes. Now..
Web 2.0 changed user’s expectations from the web.User is now in the “middle” and actively engaging!User is now in the “middle” and actively engaging!
Get the ‘user’ into the mix..
useraccess
Websites/Apps
addcontent
Wikipedia/Wikis
Usercommunities
Orkut/MySpaces
aggregate
Blogs/RSS
‘tag’/knowledge
tagging (Flickr)
Corp appCorp app
FinancialsFinancials
HRHR
Intranetblogsblogs
Bank.comBank.com
.com.com
Internet
intranetintranet
intranetintranet KnowledgeKnowledgebasebase
Users expect to participate more actively.What does this mean for SOA/SaaS…..
Web2.0: user in the middle
web
With SOA on the cloud, Web2.0 now nearer
Rich UI
AJAX
SAASResources
REST
RSS
http
BPEL processes
SOAPClient
ServicesAdmin
XML
SOAP/http
WS-*
Even better, Web2 can be a front for SOA..
Enablers:• XML based eco-system• Access data as XML (RSS/WS)• Services over web (SOAP/REST)• Easy to access from UIUI
Raw Materials
Mailroom 3Mailroom 3
End user can compose a Business Processing using services in the “cloud”
Customer Care Dept
Mailroom 1Mailroom 1
Order Processing
MailroomMailroom
Shipping
Mailroom 6Mailroom 6
Warehouse
MailroomMailroom
Manu-facturing
Mailroom 4Mailroom 4
Organization’s SaaS cloud
Form
Form/document
start
end
1 2 3
466
Enables, Orchestrate ‘on demand’
------
Users can compose processes ‘on demand’Users can compose processes ‘on demand’
Services available in the “cloud” in a SaaS model
www
The SOA enabled cloud
virtualizationplatform
5
appservicesUI
enterpriseintranet
1
3
2
4
appservicesUI
appservicesUI
Usersaccess
on www
!Web based
Admin
www
AmazonEC2 S3s3
5
appservicesUI
SaaS
5
appservicesUI
hosted
virtualization SaaS
cloud
Google App engine
5
appservicesUI
PaaS
• Transparent app location• On-demand orchestration• Simple Web UI
events
5
Event EngineBAM
…
Progress Software
Headquarters: Bedford, MA
Offices: 90 Worldwide
Employees: 1,600
Revenues: $494 million
NASDAQ: PRGS
Founded: 1981
GLOBAL
INNOVATION Sonic: World’s First Ent. Service Bus Market Leading Event Processing Platform
– ApamaBloor Research
InfoWorld Top 100 IT ProjectsVolvo Cars BelgiumBoekhandels Groep Nederlands
Most Influential Software VendorsIntelligent Enterprise Magazine
Application Infrastructure SoftwareWe provide the software application developers use to build, deploy and integrate their business applications.
OUR BUSINESS
Deployed at 120,000 customer sites in 140 countries
2,000 Partners deliver 5,000 unique business applications
Over 600,000 new users acquire Progress-based technology annually
EXPERIENCE
In India, we have the Product Development center at Hyderabad In India, we have the Product Development center at Hyderabad (the largest outside of the HQ near Boston)(the largest outside of the HQ near Boston)
EnterpriseService Bus
Semantic mediation tools for application and service data management with common information model visualization, impact analysis and testing
SOA management platform providing monitoring, active policy enforcement and service delivery optimization
SemanticIntegration
SOAManagement
Progress SOA Product LineupBest-in-Class Infrastructure for the Business Challenges of SOA
EventProcessing
MainframeConnectivity
DataAccess
ApplicationPlatform
Message-based, distributed, event-driven architecture with Service-based components
Progress Software: Market Recognition for Our Products
ApamaEvent Processing Platform Market Leader
OpenEdge40% Savings vs. Alternative Platforms
Sonic ESBBest Enterprise Service Bus
Actional SOA & Web Services Management Leader
DataXtend SI2007 Excellence Award for Best New Product
Thanks
[email protected]@progress.comhttp://jroller.com/rameshlhttp://jroller.com/rameshl
A bit about me-Middleware evangelist-Head Product dev-Adjunct Faculty at IIIT
b u s
SonicXSLT
Data Access service (SDO)
DataDirect’s XML converter
(any source TO xml)
SonicDB to xml
(as a service)
SonicXQuery
DXSI: Xml to xmlTransformations based on
common modelsxml to xml
Transformations
DataDataaccessaccess
DataDataIntegrationIntegration
XMLXMLTransformationsTransformations
XSDO
From hosting, to a ‘solution service’ Light weight UI
over web App can be
broken into parts
Distributed over the web
Remote web based admin
dev
Build
www
Users access over
web
dev
Managed Instances- One per client
ops
…
Solution provider
…
Client Enterprises
App provider
SaaS Software as a service
− Definitions very elusive Apps now delivered as a
managed service− Web based application− End client just asks and gets it− No h/w or s/w to buy− No installation, setup of
configuration− No administration, monitoring or
tuning
Admin
app
platform
OS
server
Installer
Configurator
Developer
Functionalanalyst
Prod mgr
Access app over web
SaaS provider
client
SOA-Events link
Processes result in biz-operations that could trigger biz-
events(“new order placed”,
“product shipped from warehouse”)
Events can trigger processes
Any biz function that needs to do some
post-processing after this event can
subscribe to this event.
Get notified when it occurs, and process
as needed
Worklists manager
Process EngineBiz processes