2014 cf summit_clustering

© 2014 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.© 2014 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.

The More the Merrier, Clustering in ColdFusionElishia Dvorak | ColdFusion Solution Consultant & Evangelist

Nimit Sharma | Software Engineer, ColdFusion

© 2014 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.

Agenda

Different ways of clustering in ColdFusion Vertical Horizontal Distributed

Load Balancing

Failover & Session Management

2


Why Cluster?

High Availability/Failover

Redundancy

3


Clustering in ColdFusion

JEE Clustering Mechanism in Tomcat Peer to peer at the instance level

Will not provide failover for your web server Will need HWLB or use of built-in failover for web server

ie. IIS failover via Microsoft Network Load Balancing (NLB)

4


Types of Clustering

Vertical Cluster “Scale Up”

Multiple instances on same box Increased efficiency Greatest utilization of hardware resources Manageability Most cost-effective Protection against software failover

(localized redundancy) Implications for hardware failure

5

© 2014 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 6



DemoSetting Up a Vertical Cluster


Types of Clustering

Horizontal Cluster “Scale Out” Clustered across different physical or virtual servers

Protects against hardware failures Not most cost-effective solution Effective management of workloads

May be most effective if you have an application that can run efficiently on limited hardware The most common solution typically involves a hybrid vertical + horizontal solution (scale up

then out)

9

CF1

CF2

CF3

CF4

CF5

Web1

Web2

Web3

Web4

Web5


Instance Manager ->Register Remote Instance

Default 8985/8987 (in jetty.xml)

Must be unique for session affinity

Weighted round robin


DemoSetting Up a Horizontal ColdFusion Cluster


Clustering in ColdFusion

12

A A AB B BC C C


Distributed Architecture

Web server resides on a separate server than ColdFusion Security Scalability Redundant & Independent

Three-Tier Architecture Tier 1: Web Server Tier 2: Application Server (ColdFusion) Tier 3: Data

13


DemoDistributed Architecture


Where is all this stored?

Web Server Configuration Utility: CF_Install_Dir/cfusion/runtime/bin Connector Config: CF_Install_Dir/config/

cluster.xml: Stores info about the cluster, including multicast port Instances.xml: Stores info about the instances and where they are located In /config/wsconfig/n/ - config files for connector, logs

Isapi_redirect.properties workers.properties

\CF_Install_dir\cfusion\jetty\etc\jetty.xml: Admin component ports \instance_name\runtime\conf\server.xml: stores port/connector info for server

instances AJP Port Connector Port for Built-In Web Server Web root for Built-In Web Server, context path

15


Consideration for architecture

Code Maintenance

Maintaining multiple copies of the shared assets

Requires replication mechanism to keep shared assets up to date

Always possibility of something getting out of sync

Using NAS (Network Attached Storage) device

Centrally located

Still need failover mechanism

Possibility of latency

16


Load Balancing & Failover

Load balancer For distribution of load and failover across web server level Allows proxy based distribution of traffic across multiple servers Hardware or Software Based Example: F5 Big-IP

ColdFusion Offers Load balancing via round robin (at instance level) Failover (at instance level) - Requires session replication, or alternative to maintain session at failover

Session Management Options: Server Affinity / Sticky Sessions (J2EE sessions must be enabled) Session Replication (J2EE sessions must be enabled) Distributed Caching Client Variables

17


Troubleshooting

Verbose Connector Logging Isapi_redirect.properties Set log_level= debug

Log files Isapi_redirect.log

Ensure ports are open between machines: Check OS Firewalls, External Firewalls, If AWS need to open TCP ports AJP Port for communicating with cluster members (remote) – by default 801X HTTP port, for testing using internal web server would be port 850X

18


PDFg Clustering and Scalability

Nimit Sharma

19


Agenda

PDFg Service(CFHTMLTOPDF) PDFg Service Clustering

Vertical Horizontal

Troubleshooting tips Performance improvements

20


PDFg Service

21

Fully revamped PDF Engine Produces high quality PDFs Re-architected for high performance Cluster Support for Enterprise Edition


PDFg Service

22

CFHTMLToPDF CFHTMLToPDFItem


PDF generated using CFDocument and CFHtmlToPdf

23

CFDocument CFHtmlToPdf


Components of PDFg Service

24

Service: It is process named HTML2PDFConverter.

Service Manager: It manages the lifecycle of PDF generation.


Request Flow

25

End-Users ColdFusion Server

ColdFusion Add-on

Services

ServiceHTML2PDFConverter

PDF Service Manager


PDFg Service Clustering for Scalability

26

Vertical Scaling

Horizontal Scaling


PDFg Service – Vertical Scaling

27

Html2PdfConverter N

Html2PdfConverter 3

Html2PdfConverter 2

Html2PdfConverter 1

PDF Service Process Pool

PDF Service process can be increased with

load.


PDFg Service – Vertical Scaling

28

Configuration File <cf_install_root>/cfusion/jetty/webapps/PDFgServlet/WEB-INF/web.xml

<context-param><description> Minimum PDFg process running in Process pool </description>

<param-name>minService</param-name>

<param-value>1</param-value></context-param>

<context-param> <description> Maximum PDFg process running in Process pool </description>

<param-name>maxService</param-name>

<param-value>2</param-value> </context-param>


Demo


PDFg Service – Horizontal Scaling

30

Load Balancer

Html2PdfConverter 2

Html2PdfConverter 1


Html2PdfConverter 2

Html2PdfConverter 1



PDFg Service – Horizontal Scaling

31

Login to ColdFusion Administrator, and then navigate to ‘Data & Services’ > PDF Service.


List PDF Service Managers

32

Login to ColdFusion Administrator, and then navigate to ‘Data & Services’ > PDF Service.


Demo


Troubleshooting Tips

34

How to access PDFg service manager remotely

How to enable PDFg service logging


Accessing PDFg service manager remotely

35

Configuration File:

<cf_install_root>/cfusion/jetty/etc/jetty.xml

<Call name="addConnector"><Arg> <New class="org.mortbay.jetty.bio.SocketConnector">

<Set name="Host">127.0.0.1</Set> <Set name="port"> <SystemProperty name="jetty.port" default="8987"/></Set> <Set name="maxIdleTime">50000</Set> <Set name="lowResourceMaxIdleTime">1500</Set>

</New> </Arg> </Call>


Logging

End-Users ColdFusion Server

ColdFusion Add-on

Services

ServiceHTML2PDFConverter

ColdFusion logs

PDF service logsPDF Service

Manager


Enabling PDFg service logging

37

Configuration file:

<cf_install_root>/cfusion/jetty/webapps/PDFgServlet/WEB-INF/web.xml

It creates PDF service log named pdfg_access.log

<context-param> <description>EnableLogging logs complete details about PDFg service and conversion request life cycle.</description>

<param-name>enableLogging</param-name>

<param-value>true</param-value> </context-param>


Performance Improvements

38

10 20 40 50 80 1000

20

40

60

80

100

120

CFDocumentCFHtmlToPdf

Virtual Users

Th

rou

gh

pu

t(R

eq

ue

st/S

ec)

104%


Configuration used for Performance tests

39

Server details:

OS: Windows Server 2012 R2 Processors: Xeon with 16 cores RAM: 32 GB

PDF Service Configuration details:

minService: 8 maxService: 12

CFDocument:

No option available to scale


Nimit [email protected]@nimsharm

Elishia [email protected]@elishdvorak

mailto:[email protected]




Date post:	26-Jun-2015
Category:	Software
Upload:	coldfusionconference
View:	1,314 times
Download:	1 times