WebSphere MQ FTE (File Transfer Edition) - IBM · No WebSphere MQ File Transfer Edition code runs...

EEEEEEddddddoooooouuuuuuaaaaaarrrrrrdddddd OOOOOOrrrrrrcccccceeeeeellllllWebSphere MQ FTE

(File Transfer Edition)

IBM Software Group

222222

©©©©©© 222222000000000000888888 IIIIIIBBBBBBMMMMMM CCCCCCoooooorrrrrrppppppoooooorarararararattttttiiiiiionononononon

• Overview

• MQ Topologies

• How does it work ?

• Advanced Topics

• Demonstration

IBM Software Group

333333


HoHoHoHoHoHowwwwww Do Do Do Do Do Do Y Y Y Y Y Yoooooouuuuuu T T T T T Trrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrr F F F F F Fileileileileileilessssss?????? • Can you finish ever larger batches of file transfers overnight?• Can you transfer updates continuously throughout the day?

• Can you move files reliably across your distributed IT systems?• Can you restart file transfers that haven’t completed properly?• Can you automate & schedule transfers to avoid human-errors?

• Can you prove that files only went where were supposed to?• Can you detect & recover whenever files are partially sent?• Can you prevent unauthorized access to files?

• Can you avoid developing code to improve file transfers?• Can you avoid duplicating file transfer logic across apps?

• Can you use a single infrastructure for all traffic including files?• Can you reduce your administration & maintenance costs?

• Can you apply ESB capabilities to files e.g. transformation? • Can you involve files as part of your business processes?• Can you include file-oriented applications in your SOA?

• Can you enable more IT staff to use a common infrastructure?• Can you enable less skilled staff to use your IT infrastructure?• Can you bring service-oriented & batch/file systems together?

IBM Software Group

444444


SSSSSShhhhhhoooooorrrrrrttttttccccccoooooommmmmmininininininggggggssssss o o o o o offffff b b b b b baaaaaassssssicicicicicic F F F F F FTTTTTTPPPPPP LLLLLLiiiiiimmmmmmiiiiiitttttteeeeeedddddd RRRRRReeeeeelllllliiiiiiaaaaaabbbbbbiiiiiilllllliiiiiittttttyyyyyy

Lacks Checkpoint/Restart

Transfers fail without notification

Partial can cause data integrity problems

Code Page Conversion often trivialized or incomplete

– ASCII ASCII

– ASCII EBCDIC

– EBCDIC EBCDIC

LLLLLLiiiiiimmmmmmiiiiiitttttteeeeeedddddd FFFFFFlllllleeeeeexxxxxxiiiiiibbbbbbiiiiiilllllliiiiiittttttyyyyyy All resources usually have to be

available concurrently

Each transfer requires a dedicated session (one at a time)

NNNNNNoooooo ssssssuuuuuuppppppppppppoooooorrrrrrtttttt ffffffoooooorrrrrr

Priority

Compression

Encryption

LiLiLiLiLiLimmmmmmiteiteiteiteiteited d d d d d sssssseeeeeeccccccururururururiiiiiittttttyyyyyy Lack of user/password protection

(often in the clear)

Lack of support for Non-repudiation

Lack of support for

Authentication

Encryption

LiLiLiLiLiLimmmmmmiteiteiteiteiteited d d d d d vvvvvvisisisisisisiiiiiibilbilbilbilbilbiliiiiiittttttyyyyyy aaaaaand nd nd nd nd nd trtrtrtrtrtraaaaaacecececececeababababababililililililityityityityityity No centralized Management

Logging capabilities are limited and may only record transfers between directly connected systems

Lack of logging from source to target

IBM Software Group

555555


CaCaCaCaCaCannnnnn YYYYYYoooooouuuuuu AAAAAAuuuuuudddddditititititit Y Y Y Y Y Yoooooouuuuuurrrrrr F F F F F Fiiiiiilelelelelele TTTTTTrrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrrssssss?????? PPPPPPaaaaaaiiiiiin n n n n n popopopopopoiiiiiintsntsntsntsntsnts

Risk - non-compliance with regulations e.g. Sarbanes-Oxley, MiFID, HIPAA etc

Unreliable nature of FTPfailures need to be detected (by

writing application code) Failures cause files to be re-sent

(consuming network bandwidth) increasing the batch-window

Inflexible nature of FTPdevelopment and maintenance

costs spiraling due to incremental changes required

NNNNNNeeeeeeeeeeeed d d d d d aaaaaabibibibibibilllllliiiiiitytytytytyty to trto trto trto trto trto traaaaaacccccckkkkkk momomomomomovvvvvveeeeeemmmmmmeeeeeent of nt of nt of nt of nt of nt of ffffffiiiiiilllllleeeeeessssss fr fr fr fr fr fromomomomomom ssssssttttttaaaaaarrrrrrt-to-ft-to-ft-to-ft-to-ft-to-ft-to-fiiiiiininininininissssssh h h h h h aaaaaassssss the the the the the thesssssseeeeee mmmmmmovovovovovoveeeeee aaaaaarrrrrroundoundoundoundoundound ororororororgagagagagaganinininininizzzzzzaaaaaatitititititioooooonnnnnn

You must improveability to meet regulatory compliance Ability to demonstrating the integrity of the

dataYou must eliminate

Application changes to detect transfer failures, corrupted or partial file delivery

You must increasing flexibility of infrastructureChanges to hardware, O/S, applications

and networks do not require re-working of complex distributed transfer code

??????????????????

??????

??????????????????

??????WhWhWhWhWhWherererererereeeeee hhhhhhasasasasasas tttttthhhhhhiiiiiis s s s s s ffffffiiiiiilllllle e e e e e ccccccoooooommmmmme e e e e e ffffffrrrrrroooooommmmmm??????

WhWhWhWhWhWherererererere e e e e e hhhhhhas as as as as as iiiiiitttttt bbbbbbeeneeneeneeneeneen bbbbbbeeeeeeffffffoooooorrrrrre e e e e e iiiiiitttttt ggggggooooootttttt hhhhhherererererere?e?e?e?e?e?HHHHHHas as as as as as iiiiiitttttt bbbbbbeeneeneeneeneeneen cccccchhhhhhananananananggggggedededededed?????? BBBBBByyyyyy WWWWWWhhhhhhoooooo?????? WhWhWhWhWhWhenenenenenen??????

HHHHHHoooooowwwwww ccccccanananananan IIIIII qqqqqquuuuuuiiiiiicccccckkkkkkllllllyyyyyy mmmmmmakakakakakake e e e e e cccccchhhhhhaaaaaannnnnnggggggeeeeees?s?s?s?s?s?IIIIIIs s s s s s tttttthhhhhhe e e e e e ffffffiiiiiilllllle e e e e e ccccccoooooommmmmmpppppplllllletetetetetete?e?e?e?e?e?

??????

??????

IBM Software Group

666666


CCCCCCononononononssssssoooooolllllliiiiiiddddddaaaaaatitititititinnnnnngggggg IIIIIITTTTTT I I I I I Innnnnnffffffrrrrrraaaaaasssssstrutrutrutrutrutructuctuctuctuctucturererererere DDDDDDeeeeeevvvvvveeeeeelllllloooooopipipipipipinnnnnngggggg aaaaaannnnnndddddd mmmmmmaaaaaaiiiiiinnnnnnttttttaaaaaaiiiiiinnnnnniiiiiinnnnnngggggg eeeeeennnnnnttttttiiiiiirrrrrreeeeee ppppppaaaaaarrrrrraaaaaalllllllllllleeeeeellllll

iiiiiinnnnnnffffffrrrrrraaaaaassssssttttttrrrrrruuuuuuccccccttttttuuuuuurrrrrreeeeeessssssMessaging – typically WebSphere MQFiles – typically FTP

PPPPPPaaaaaaiiiiiinnnnnn ppppppooooooiiiiiinnnnnnttttttssssssDuplicate maintenance burdenDuplicate administration of both infrastructures

poor traceability for file transfers

NNNNNNeeeeeeeeeeeedddddd aaaaaabbbbbbiiiiiilllllliiiiiittttttyyyyyy ttttttoooooo ccccccoooooonnnnnnssssssoooooolllllliiiiiiddddddaaaaaatttttteeeeee tttttthhhhhheeeeeesssssseeeeee dddddduuuuuupppppplllllliiiiiiccccccaaaaaatttttteeeeee iiiiiinnnnnnffffffrrrrrraaaaaassssssttttttrrrrrruuuuuuccccccttttttuuuuuurrrrrreeeeeessssss iiiiiinnnnnnttttttoooooo oooooonnnnnneeeeee ssssssiiiiiinnnnnngggggglllllleeeeee uuuuuuninininininivvvvvveeeeeerrrrrrssssssaaaaaallllll ttttttrrrrrraaaaaannnnnnssssssppppppoooooorrrrrrtttttt ffffffoooooorrrrrr bbbbbbooooootttttth h h h h h mmmmmmeeeeeessssssssssssaaaaaaggggggeeeeeessssss aaaaaannnnnndddddd ffffffiiiiiilllllleeeeeessssssOperational savings and simplificationReduced administration effortReduced skills requirements and maintenance Improved reliability, auditability and security of File

TransfersInfrastructure that can be re-used as basis for SOA

as opposed to FTP

======

CCCCCCoooooonnnnnnssssssoooooolllllliiiiiiddddddaaaaaatetetetetetedddddd TTTTTTrrrrrraaaaaannnnnnssssssppppppoooooorrrrrrttttttfofofofofoforrrrrr mmmmmmeeeeeessssssssssssaaaaaaggggggeeeeeessssss &&&&&& fifififififilllllleeeeeessssss

FFFFFFiiiiiilllllleeeeee TTTTTTrrrrrraaaaaannnnnnssssssfefefefefeferrrrrrssssss AAAAAApppppppppppplllllliiiiiiccccccaaaaaatitititititioooooonnnnnn MMMMMMeeeeeessssssssssssaaaaaaggggggiiiiiinnnnnngggggg

++++++

IBM Software Group

777777


Flexible backbone for transfers – not a single-hop solution like FTP

Multi-purpose – use for messages and files

Auditable with logging subsystem that tracks transfer at source and at destination for audit purposes

Massive files – larger than MQ messages

Reliability leveraging the MQ transport

Integration with MQ-enabled apps and ESBs

No need to program – no need to use APIs

Simple graphical tooling enabling remote configuration

Automatic file conversion and compression

Security - of file payload using SSL

Visual transfer status reporting

Support for many supported MQ environments

IIIIIInnnnnnttttttrrrrrroooooodddddduuuuuucccccciiiiiinnnnnngggggg W W W W W WeeeeeebbbbbbSSSSSSpppppphhhhhheeeeeerrrrrreeeeee M M M M M MQQQQQQ F F F F F Fiiiiiilllllleeeeee T T T T T Trrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrr EEEEEEddddddiiiiiittttttiiiiiioooooonnnnnn Adds fifififififilllllleeeeee trtrtrtrtrtraaaaaansnsnsnsnsnsfefefefefeferrrrrr s s s s s seeeeeerrrrrrvvvvvviiiiiicccccceeeeeessssss to WebSphere MQ to enable mmmmmmovovovovovoveeeeeemmmmmmeeeeeent ont ont ont ont ont offffff fifififififilllllleeeeeessssss –

regardless of ssssssiiiiiizzzzzzeeeeee – in a mmmmmmaaaaaananananananagegegegegegedddddd w w w w w waaaaaayyyyyy (r(r(r(r(r(reeeeeelllllliiiiiiaaaaaablblblblblbleeeeee, , , , , , aaaaaaudiudiudiudiudiuditatatatatatabbbbbblllllleeeeee, , , , , , sssssseeeeeeccccccurururururureeeeee))))))

Multi-purpose infrastructure – for both fifififififilllllleeeeeessssss and mmmmmmesesesesesessasasasasasagegegegegegessssss

FFFFFFiiiiiilllllleeeeee TTTTTTrrrrrrananananananssssssfffffferererererer EEEEEEddddddiiiiiittttttiiiiiioooooonnnnnnWWWWWWeeeeeebbbbbbSSSSSSpppppphhhhhheeeeeerrrrrreeeeee MMMMMMQQQQQQ

……

aaaaaaudiudiudiudiudiudittttttcccccconfionfionfionfionfionfiggggggurururururureeeeee trtrtrtrtrtraaaaaacccccckkkkkk

AAAAAA BBBBBB CCCCCC XXXXXX YYYYYY ZZZZZZ

AAAAAAnnnnnnnnnnnnoooooouuuuuunnnnnncccccceeeeeedddddd OOOOOOccccccttttttoooooobbbbbbeeeeeerrrrrr 777777,,,,,, 222222000000000000888888GGGGGGAAAAAA DDDDDDeeeeeecccccceeeeeemmmmmmbbbbbbeeeeeerrrrrr 555555,,,,,, 222222000000000000888888 ((((((DDDDDDiiiiiissssssttttttrrrrrriiiiiibbbbbbuuuuuutttttteeeeeedddddd))))))GGGGGGAAAAAA DDDDDDeeeeeecccccceeeeeemmmmmmbbbbbbeeeeeerrrrrr 111111222222 222222000000000000888888 ((((((zzzzzz//////OOOOOOSSSSSS))))))

IBM Software Group

888888


CeCeCeCeCeCennnnnnttttttrrrrrraaaaaalizelizelizelizelizelizedddddd Co Co Co Co Co Connnnnnffffffigigigigigiguuuuuurrrrrraaaaaattttttiiiiiioooooonnnnnn & A & A & A & A & A & Addddddmmmmmmiiiiiinnnnnnisisisisisisttttttrrrrrraaaaaattttttioioioioioionnnnnn

Visual display at a glance

Eclipse-based environment

Extensible and customizable

Logically centralized configuration of remote, distributed backbone

Remotely view & configure entire backbone – including on z/OS

DDDDDDeeeeeelllllleeeeeetttttteeeeee

CCCCCCrrrrrreeeeeeaaaaaatttttteeeeee

DDDDDDiiiiiissssssppppppllllllaaaaaayyyyyy

MMMMMMooooooddddddiiiiiiffffffyyyyyy

TTTTTTeeeeeesssssstttttt

DDDDDDeeeeeeppppppllllllooooooyyyyyy

Remote connection from Linux x86 and Windows

SSL secured connections

IBM Software Group

999999


CeCeCeCeCeCennnnnnttttttrrrrrraaaaaalizelizelizelizelizelizedddddd Co Co Co Co Co Connnnnnffffffigigigigigiguuuuuurrrrrraaaaaattttttiiiiiioooooonnnnnn v v v v v viaiaiaiaiaia M M M M M MQ EQ EQ EQ EQ EQ Exxxxxxpppppplolololololorrrrrreeeeeerrrrrr

EEEEEEcccccclllllliiiiiippppppsssssseeeeee GGGGGGUUUUUUIIIIII iiiiiinnnnnntttttteeeeeeggggggrrrrrraaaaaatttttteeeeeedddddd iiiiiintntntntntntoooooo WWWWWWMMMMMMQQQQQQ EEEEEExxxxxxpppppplllllloooooorrrrrreeeeeerrrrrr

IBM Software Group

111111000000


CrCrCrCrCrCreeeeeeaaaaaattttttiiiiiinnnnnngggggg F F F F F Filililililileeeeee T T T T T Trrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrrssssss

List of sources and targets is built automatically

Specify directory and file name

Choose mode (Binary or Text with automatic conversion)

Add each individual transfer to a group of transfers Choose priority of transfer

Choose advanced options

Deploy file transfer to network

IBM Software Group

111111111111


SSSSSScccccchhhhhheeeeeedddddduuuuuulinlinlinlinlinlingggggg &&&&&& TTTTTTrrrrrrigigigigigigggggggeeeeeerrrrrriiiiiinnnnnngggggg F F F F F Filililililileeeeee T T T T T Trrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrrssssss

Choose when to start the scheduled transfer

Choose when to repeat the scheduled transfer and how often

Choose the trigger for the transfer

Choose advanced options

Deploy file transfer to network

IBM Software Group

111111222222


AAAAAAuuuuuuddddddiiiiiittttttiiiiiinnnnnngggggg & M & M & M & M & M & Moooooonnnnnnititititititoooooorrrrrrinininininingggggg F F F F F Fileileileileileile T T T T T Trrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrrssssss

View or cancel transfers that will run by schedule and/or are triggered

View audit log of all transfers and groups of transfers

View progress of all transfers currently taking place

IBM Software Group

111111333333

©©©©©© 222222000000000000888888 IIIIIIBBBBBBMMMMMM CCCCCCoooooorrrrrrppppppoooooorarararararattttttiiiiiiononononononPPPPPPaaaaaaggggggeeeeee 111111333333

CoCoCoCoCoConnnnnnffffffiiiiiigggggguuuuuurrrrrriiiiiinnnnnngggggg FFFFFFiiiiiilllllleeeeee T T T T T Trrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrrssssss aaaaaannnnnndddddd A A A A A Aggggggeeeeeennnnnnttttttssssss f f f f f frrrrrroooooommmmmm Co Co Co Co Co Commmmmmmmmmmmaaaaaannnnnndddddd L L L L L Liiiiiinnnnnneeeeee

Command Line Interface is consistent across all supported platforms

Transfer commands can be invoked from the supported Operating Systems shell environment

Commands can be invoked from anywhere across the file transfer e.g. Transfers could be invoked from a remote

Windows machine for transfers taking place between z/OS and Unix machines

Developers can use any native command line language on the OS that can invoke these commands (shell, bat, cmd, etc.)

Application Programs can place a request using a messaging interface in XML

Examples: fffffftttttteeeeeeCCCCCCrrrrrreeeeeeaaaaaatttttteeeeeeTTTTTTrrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrr Starts a new file transfer from the command line fffffftttttteeeeeeSSSSSSttttttaaaaaarrrrrrttttttAAAAAAggggggeeeeeennnnnnttttttStarts a File Transfer agent from the command line fffffftttttteeeeeeSSSSSSttttttooooooppppppAAAAAAggggggeeeeeennnnnntttttt Stops a File Transfer agent in a controlled way fffffftttttteeeeeeSSSSSShhhhhhoooooowwwwwwAAAAAAggggggeeeeeennnnnnttttttDDDDDDeeeeeettttttaaaaaaiiiiiillllllssssss Displays the details of a particular File Transfer agent fffffftttttteeeeeeLLLLLLiiiiiissssssttttttAAAAAAggggggeeeeeennnnnnttttttssssss Displays all known File Transfer agents

IBM Software Group

111111444444


LLLLLLinininininineeeeee------mmmmmmooooooddddddeeeeee e e e e e exxxxxxaaaaaammmmmmpppppplelelelelelessssss fteCreateTransfer – request a file transfer

fteStartAgent – start an FTE Agent

fteCreateAgent – create a new FTE Agent

C:\Junk> fffffftttttteeeeeeCCCCCCrrrrrreeeeeeaaaaaatttttteeeeeeTTTTTTrrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrr ------ssssssmmmmmm QQQQQQMMMMMMCCCCCCFFFFFF ------ssssssaaaaaa ZZZZZZOOOOOOSSSSSSFFFFFFTTTTTTEEEEEECCCCCCAAAAAARRRRRRLLLLLL ------tttttt tttttteeeeeexxxxxxtttttt ------ddddddeeeeee oooooovvvvvveeeeeerrrrrrwwwwwwrrrrrriiiiiitttttteeeeee ------ddddddaaaaaa WWWWWWIIIIIINNNNNNFFFFFFTTTTTTEEEEEE ------ddddddffffff """"""cccccc::::::\\\\\\JJJJJJuuuuuunnnnnnkkkkkk\\\\\\OOOOOOuuuuuutttttt\\\\\\SSSSSSYYYYYYSSSSSS111111......PPPPPPRRRRRROOOOOOCCCCCCLLLLLLIIIIIIBBBBBB......lllllliiiiiinnnnnneeeeee......ttttttxxxxxxtttttt"""""" """"""////////////''''''SSSSSSYYYYYYSSSSSS111111......PPPPPPRRRRRROOOOOOCCCCCCLLLLLLIIIIIIBBBBBB((((((QQQQQQMMMMMMCCCCCCFFFFFFMMMMMMSSSSSSTTTTTTRRRRRR))))))‘‘‘‘‘‘

5655-U80, 5724-R10 Copyright IBM Corp. 2008. ALL RIGHTS RESERVEDBFGCL0035I: Transfer request issued. The request ID is: 414d512057696e514d202020202020205b90924920003e02

ITSO:/u/carlf: > fffffftttttteeeeeeSSSSSSttttttaaaaaarrrrrrttttttAAAAAAggggggeeeeeennnnnntttttt ZZZZZZOOOOOOSSSSSSFFFFFFTTTTTTEEEEEECCCCCCAAAAAARRRRRRLLLLLL 5655-U80, 5724-R10 Copyright IBM Corp. 2008. ALL RIGHTS RESERVED BFGCL0030I: Request to start agent 'ZOSFTE' on this machine has been submitted. BFGCL0031I: Agent log files located at: /u/carlf/MQFTE_MyConfig/WinQM/agents/ZOSFTECARL

ITSO**:/u/carlf: > fffffftttttteeeeeeCCCCCCrrrrrreeeeeeaaaaaatttttteeeeeeAAAAAAggggggeeeeeennnnnntttttt ------aaaaaaggggggeeeeeennnnnnttttttNNNNNNaaaaaammmmmmeeeeee ZZZZZZOOOOOOSSSSSSFFFFFFTTTTTTEEEEEECCCCCCAAAAAARRRRRRLLLLLL ------aaaaaaggggggeeeeeennnnnnttttttQQQQQQMMMMMMggggggrrrrrr QQQQQQMMMMMMCCCCCCFFFFFF 5655-U80, 5724-R10 Copyright IBM Corp. 2008. ALL RIGHTS RESERVED BFGCL0128I: The agent requires a number of WebSphere MQ objects to be defined to queue manager QMCF. Ensure these definitions are present before starting the agent. BFGCL0071I: Direct the following MQSC definitions for agent 'ZOSFTE' to queue manager 'QMCF'. :

IBM Software Group

111111555555


• Overview

• MQ Topologies


• Advanced Topics

• Demonstration

IBM Software Group

111111666666


WWWWWWeeeeeebbbbbbSSSSSSpppppphhhhhheeeeeerrrrrreeeeee M M M M M MQ Q Q Q Q Q FFFFFFileileileileileile T T T T T Trrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrr EEEEEEddddddititititititioioioioioionnnnnn VVVVVVeeeeeerrrrrrssssssioioioioioionnnnnnssssss WebSphere MQ File Transfer Edition Client

Connects to a Queue Manager using MQ Client bindings

Typically a remote machine using the network to connect to the Queue Manager

WebSphere MQ File Transfer Edition ServerAllows MQ/FTE Agents to connect in bindings mode to the

local Queue Manger

Allows MQ/FTE Clients to connect via Client bindings over the Network

WebSphere MQ File Transfer Edition for z/OS®Allows MQ/FTE Agents to connect in bindings mode to

MQv6 or MQv7 z/OS Queue Managers

IBM Software Group

111111777777


AAAAAA S S S S S Simimimimimimpppppplelelelelele T T T T T Tooooooppppppoooooolololololologgggggyyyyyy

AGENTA

AAAAAAGGGGGGEEEEEENNNNNNTTTTTT Queue

Manager

CCCCCCooroorooroorooroordidididididinanananananattttttiiiiiion on on on on on Queue

Manager

AGENTB

OOOOOOppppppeeeeeerrrrrraaaaaattttttiiiiiioooooonnnnnnssssss

(v6 or v7) (v6 or v7)

((((((vvvvvv777777))))))

QueueManager

((((((CCCCCCoooooommmmmmmmmmmmaaaaaannnnnndddddd))))))

AAAAAAGGGGGGEEEEEENNNNNNTTTTTT Queue

Manager

(v6 or v7)

IBM Software Group

111111888888


AAAAAA S S S S S Simimimimimimpppppplelelelelele T T T T T Tooooooppppppoooooolololololologgggggyyyyyy

AGENTA

QueueManager

A

QueueManager

B

QueueManager

AGENTB

MMMMMMoooooonnnnnniiiiiittttttoooooorrrrrriiiiiinnnnnngggggg RRRRRReeeeeeccccccoooooorrrrrrdddddd KKKKKKeeeeeeeeeeeeppppppiiiiiinnnnnnggggggOOOOOOppppppeeeeeerrrrrraaaaaattttttiiiiiioooooonnnnnnssssss

(v6 or v7)(v6 or v7)

((((((vvvvvv777777))))))

(C(C(C(C(C(Coooooooooooorrrrrrddddddiiiiiinnnnnnaaaaaatitititititioooooonnnnnn))))))

1.1.1.1.1.1. OOOOOOppppppeeeeeerrrrrraaaaaattttttiiiiiioooooonnnnnnssssss ttttttoooooooooooolllllliiiiiinnnnnngggggg ccccccoooooommmmmmmmmmmmuuuuuunnnnnniiiiiiccccccaaaaaatttttteeeeeessssss wiwiwiwiwiwitttttthhhhhh aaaaaaggggggeeeeeennnnnntttttt bbbbbbyyyyyy sssssseeeeeennnnnnddddddiiiiiinnnnnngggggg mmmmmmeeeeeessssssssssssaaaaaaggggggeeeeeessssss ttttttoooooo aaaaaa qqqqqquuuuuueeeeeeuuuuuueeeeee tttttthhhhhhaaaaaatttttt tttttthhhhhheeeeee aaaaaaggggggeeeeeennnnnntttttt iiiiiissssss mmmmmmoooooonnnnnniiiiiittttttoooooorrrrrriiiiiinnnnnngggggg

2.2.2.2.2.2. AgAgAgAgAgAgeeeeeennnnnnttttttssssss ttttttrrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrr ffffffiiiiiilllllleeeeee ddddddaaaaaattttttaaaaaa uuuuuussssssiiiiiinnnnnngggggg qqqqqquuuuuueeeeeeuuuuuueeeeeessssss

3.3.3.3.3.3. AgAgAgAgAgAgeeeeeennnnnnttttttssssss sssssseeeeeennnnnndddddd pppppprrrrrrooooooggggggrrrrrreeeeeessssssssssss aaaaaannnnnndddddd llllllooooooggggggggggggiiiiiinnnnnngggggg mmmmmmeeeeeessssssssssssaaaaaaggggggeeeeeessssss ttttttoooooo tttttthhhhhheeeeee ““““““ccccccoooooooooooorrrrrrddddddiiiiiinnnnnnaaaaaattttttiiiiiioooooonnnnnn qqqqqquuuuuueeeeeeuuuuuueeeeee mmmmmmaaaaaannnnnnaaaaaaggggggeeeeeerrrrrr”””””” whwhwhwhwhwhiiiiiicccccchhhhhh ppppppuuuuuubbbbbblllllliiiiiisssssshhhhhheeeeeessssss tttttthhhhhheeeeee mmmmmmeeeeeessssssssssssaaaaaaggggggeeeeeessssss ttttttoooooo ssssssuuuuuubbbbbbssssssccccccrrrrrriiiiiibbbbbbiiiiiinnnnnngggggg aaaaaapppppppppppplllllliiiiiiccccccaaaaaattttttiiiiiioooooonnnnnnssssss

QueueManager

((((((CCCCCCoooooommmmmmmmmmmmaaaaaannnnnndddddd))))))

Store + forward

Subscription

KKKKKKeeeeeeyyyyyy

IBM Software Group

111111999999


PPPPPPuuuuuubbbbbbllllllisisisisisishhhhhheeeeeedddddd I I I I I Innnnnntttttteeeeeerrrrrrffffffaaaaaacccccceeeeeessssss

DDDDDDooooooccccccuuuuuummmmmmeeeeeennnnnntttttteeeeeedddddd MMMMMMeeeeeessssssssssssaaaaaaggggggeeeeee

FFFFFFoooooorrrrrrmmmmmmaaaaaatttttt DDDDDDooooooccccccuuuuuummmmmmeeeeeennnnnntttttteeeeeedddddd MMMMMMeeeeeessssssssssssaaaaaaggggggeeeeee

FFFFFFoooooorrrrrrmmmmmmaaaaaatttttt

FTEAgent

QueueManager

QueueManager

QueueManager

FTEAgent


(v6 or v7) (v6 or v7)

((((((vvvvvv777777))))))


IBM Software Group

222222000000


EEEEEExxxxxxaaaaaammmmmmpppppplllllleeeeee T T T T T Tooooooppppppoooooollllllooooooggggggieieieieieiessssss

A

Coord

A

A

Agents

A

Coord

QQ

A

A

A

A

A

Coord

Q

A

A

A

A

AQQ

A

CoordCoord

QQ

Coord

QQQ

A

QM Admin

IBM Software Group

222222111111


• Overview

• MQ Topologies


• Advanced Topics

• Demonstration

IBM Software Group

222222222222


QuQuQuQuQuQueeeeeeuuuuuueeeeee M M M M M Maaaaaannnnnnaaaaaaggggggeeeeeerrrrrr ddddddeeeeeeffffffininininininiiiiiittttttiiiiiioooooonnnnnnssssss rrrrrreeeeeeqqqqqquuuuuuiiiiiirrrrrreeeeeedddddd

Queue Manager definitions used by WebSphere MQ File Transfer Edition CoCoCoCoCoCooooooorrrrrrddddddiiiiiinnnnnnaaaaaattttttiiiiiioooooonnnnnn Queue Manager

CoCoCoCoCoCommmmmmmmmmmmaaaaaannnnnndddddd Queue Manager

AAAAAAggggggeeeeeennnnnntttttt Queue Manager

Note: The WebSphere MQ File Transfer Edition installation process assumes that the above Queue Managers are already defined and are accessible

IBM Software Group

222222333333


TTTTTThhhhhheeeeee Co Co Co Co Co Cooooooorrrrrrddddddininininininaaaaaattttttiiiiiioooooonnnnnn Qu Qu Qu Qu Qu Queeeeeeuuuuuueeeeee M M M M M Maaaaaannnnnnaaaaaaggggggeeeeeerrrrrr

Collects information about progress of active transfers (active transfer log)Auditable History of past transfers

Holds information about Agents defined in the WebSphere MQ File Transfer Edition network

Has a SYSTEM.FTE queue and topic defined to it as part of the configuration used internally by the product

Must be at MQ V7

All Agents in the network must have access to this Queue Manager in order to publish transfer log processing messages

No WebSphere MQ File Transfer Edition code runs on this queue Manager

IBM Software Group

222222444444


TTTTTThhhhhheeeeee CoCoCoCoCoCommmmmmmmmmmmaaaaaannnnnndddddd Q Q Q Q Q Quuuuuueeeeeeuuuuuueeeeee M M M M M Maaaaaannnnnnaaaaaaggggggeeeeeerrrrrr

Used to get commands into the WebSphere MQ File Transfer Edition network

Can be at MQ V7 or MQ V6

Can have multiple Command Queue Managers defined for multiple command injection points

No WebSphere MQ File Transfer Edition code runs on this queue Manager

(could be the same Queue Manager as the Coordination Queue Manager or different)

IBM Software Group

222222555555


TTTTTThhhhhheeeeee AgAgAgAgAgAgeeeeeennnnnntttttt QuQuQuQuQuQueeeeeeuuuuuueeeeee M M M M M Maaaaaannnnnnaaaaaaggggggeeeeeerrrrrr

The Queue Manager to which an Agent in the WebSphere MQ File Transfer Edition network is attached

Used by an AGENT to send/ receive files across MQ

Can be be at MQ V7 or MQ V6

Can have multiple Agents attached to it

Requires capacity planning dependent on load

IBM Software Group

222222666666


MMMMMMQ QuQ QuQ QuQ QuQ QuQ Queeeeeeuuuuuueeeeeessssss

FFFFFFTTTTTTEEEEEEAAAAAAggggggeeeeeennnnnntttttt

QQQQQQueueueueueueueueueueueueMMMMMMaaaaaananananananagegegegegegerrrrrr

QQQQQQuuuuuueeeeeeueueueueueueMMMMMMaaaaaannnnnnagagagagagageeeeeerrrrrr

FFFFFFTTTTTTEEEEEEAAAAAAggggggeeeeeennnnnntttttt



QQQQQQueueueueueueueueueueueueMMMMMMaaaaaananananananagegegegegegerrrrrr

(C(C(C(C(C(Coooooommmmmmmmmmmmaaaaaannnnnndddddd))))))

COMMAND

DATAREPLY

QQQQQQueueueueueueuuuuuueeeeeeMMMMMMaaaaaananananananagegegegegegerrrrrr

STATE STATE

EVENT

SYSTEM.FTESystem Queues (Topic)

SYSTEM.FTE

Agent QueuesSYSTEM.FTE.COMMAND.<AgentName>SYSTEM.FTE.DATA.<AgentName>SYSTEM.FTE.REPLY.<AgentName>SYSTEM.FTE.EVENT.<AgentName>SYSTEM.FTE.STATE.<AgentName>

Your queues

YOUR.QUEUE

IBM Software Group

222222777777


UsUsUsUsUsUseeeeeerrrrrr e e e e e exxxxxxitititititit r r r r r roooooouuuuuuttttttiiiiiinnnnnneeeeeessssss

User supplied Java code can be invoked Prior to starting a transfer at both the

source and destination. After completing a transfer at both the

source and destination.

Code can: Cancel the transfer. Change which files are transferred. Read and update transfer meta-data.

Any changes are recorded so they can form part of the auditing information that is collected.

SSSSSSooooooururururururcccccceeeeeeAAAAAAgegegegegegennnnnntttttt

DDDDDDesesesesesesttttttiiiiiinnnnnnaaaaaattttttiiiiiiononononononAAAAAAgegegegegegennnnnntttttt

rrrrrreeeeeeqqqqqquuuuuueeeeeesssssstttttt

rrrrrreeeeeessssssppppppoooooonnnnnnsssssseeeeee

pppppprrrrrreeeeee-tr-tr-tr-tr-tr-traaaaaannnnnnssssssfefefefefeferrrrrreeeeeexxxxxxiiiiiit t t t t t iiiiiinnnnnnvvvvvvooooooccccccaaaaaatitititititioooooonnnnnn

pppppprrrrrreeeeee-tr-tr-tr-tr-tr-traaaaaannnnnnssssssfefefefefeferrrrrreeeeeexxxxxxiiiiiit t t t t t iiiiiinnnnnnvvvvvvooooooccccccaaaaaatitititititioooooonnnnnn

ppppppoooooosssssstttttt-tr-tr-tr-tr-tr-traaaaaannnnnnssssssfefefefefeferrrrrreeeeeexxxxxxiiiiiit t t t t t iiiiiinnnnnnvvvvvvooooooccccccaaaaaatitititititioooooonnnnnn

ppppppoooooosssssst-trt-trt-trt-trt-trt-traaaaaannnnnnssssssfefefefefeferrrrrreeeeeexxxxxxiiiiiit t t t t t iiiiiinnnnnnvvvvvvooooooccccccaaaaaatitititititioooooonnnnnn

(n(n(n(n(n(neeeeeeggggggooooootitititititiaaaaaatitititititioooooonnnnnn))))))

(c(c(c(c(c(coooooommmmmmpppppplllllleeeeeetitititititioooooonnnnnn))))))

trtrtrtrtrtraaaaaannnnnnssssssfefefefefeferrrrrr

titititititimmmmmmeeeeee

IBM Software Group

222222888888


AAAAAAggggggeeeeeennnnnntttttt P P P P P Prrrrrrooooooppppppeeeeeerrrrrrttttttiiiiiieeeeeessssss

agentFrameSize The size of a frame in windows

agentWindowSizeThe size of a window in chunks

agentChunkSizeThe size of a chunk in bytes

agentCheckpointInterval Controls how often a check point is taken in units of a transfer frame

Default is 1 transfer frame

IBM Software Group

222222999999


TTTTTTrrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrr FFFFFFrrrrrraaaaaammmmmmeeeeee f f f f f foooooorrrrrrmmmmmmaaaaaatttttt

The frame size determines the maximum amount of data in progress.

Frame split into windows. A frame is moved along the data a window at a time.Normally acknowledgements are only sent back when a window is

full not for every chunk.

A window is comprised of a number of chunks which is the unit in which data is sent to from the source to destination .Can contain data from one or more files

FrameWindow Chunk

IBM Software Group

333333000000


• Overview

• MQ Topologies


• Advanced Topics

• Demonstration

IBM Software Group

333333111111


FFFFFFTTTTTTEEEEEE P P P P P Puuuuuubbbbbbliclicliclicliclic X X X X X XMMMMMMLLLLLL T T T T T Trrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrr Re Re Re Re Re ReqqqqqquuuuuueeeeeessssssttttttXXXXXXMMMMMMLLLLLL

SSSSSScccccchhhhhheeeeeemmmmmmaaaaaa

IIIIIIddddddeeeeeennnnnnttttttiiiiiiffffffyyyyyy ooooooffffff tttttthhhhhheeeeee

rrrrrreeeeeeqqqqqquuuuuueeeeeessssssttttttoooooorrrrrraaaaaannnnnndddddd HHHHHHoooooosssssstttttt

SSSSSScccccchhhhhheeeeeedddddduuuuuulllllliiiiiinnnnnngggggg SSSSSSoooooouuuuuurrrrrrcccccceeeeee &&&&&& DDDDDDeeeeeessssssttttttiiiiiinnnnnnaaaaaattttttiiiiiioooooonnnnnn AAAAAAggggggeeeeeennnnnntttttt IIIIIInnnnnnffffffoooooo

TTTTTTrrrrrraaaaaannnnnnssssssffffffeeeeeer r r r r r GGGGGGrrrrrroooooouuuuuuppppppiiiiiinnnnnngggggg

IIIIIInnnnnnddddddiiiiiivvvvvviiiiiidddddduuuuuuaaaaaallllll ffffffiiiiiilllllle e e e e e iiiiiinnnnnnffffffoooooo

FFFFFFiiiiiilllllleeeeee ttttttrarararararannnnnnssssssffffffeeeeeerrrrrr RRRRRReeeeeeqqqqqquuuuuueeeeeesssssstttttt

NNNNNNooooootttttt SSSSSShhhhhhoooooowwwwwwnnnnnn............• FiFiFiFiFiFilllllleeeeee &&&&&& TTTTTTrrrrrraaaaaannnnnnssssssffffffeeeeeer r r r r r AAAAAAttttttttttttriririririribbbbbbuuuuuutttttteeeeeessssss• FFFFFFiiiiiilllllleeeeee pppppprrrrrroooooocccccceeeeeessssssssssssiiiiiinnnnnngggggg ,,,,,, ffffffaaaaaaiiiiiilllllluuuuuurrrrrreeeeee aaaaaannnnnndddddd rerererererettttttrrrrrryyyyyy hhhhhhaaaaaannnnnnddddddlllllliiiiiinnnnnngggggg aaaaaattttttttttttrrrrrriiiiiibbbbbbuuuuuutttttteeeeeessssss

IBM Software Group

333333222222


AAAAAApppppppppppprrrrrrooooooaaaaaacccccchhhhhheeeeeessssss oooooonnnnnn a a a a a auuuuuuttttttoooooommmmmmaaaaaattttttinininininingggggg MMMMMMFFFFFFTTTTTT p p p p p prrrrrroooooocccccceeeeeesssssssssssseeeeeessssss

Which possibilities / tools exists today ?JCL

REXX

KSH, SH,CMD,BAT Scripts

Vendor Software

A new possibility:Apache ANT

IBM Software Group

333333333333


WWWWWWhhhhhhaaaaaatttttt is is is is is is A A A A A Appppppaaaaaacccccchhhhhheeeeee A A A A A ANTNTNTNTNTNT

Apache ANT is an Java-based Open-Source Build-Tool, similar to Make.

Originally intended for automated build (compile) of Java code

ANT provides Java-Classes (Tasks) for automating different things

Build-Scripts are formulated in XML

Web Page: http://ant.apache.org/

IBM Software Group

333333444444


File operations - Copy, Move, Delete, Rename, Mkdir

Zip/Unzip – compression/expansion of files

SQL – Database queries (requires JDBC Driver)

FTP – File transfer to remote systems

Mail – Sending of e-Mails (including attachments)

Telnet – Remote control of a Telnet-Session

Exec – Executes a local system command or executable

Echo – Issues messages

…

SSSSSSttttttaaaaaannnnnnddddddaaaaaarrrrrrdddddd A A A A A ANNNNNNTTTTTT TTTTTTaaaaaasssssskkkkkkssssss ( ( ( ( ( (CCCCCCoooooorrrrrreeeeee & Op & Op & Op & Op & Op & Opttttttioioioioioionnnnnnaaaaaal l l l l l TTTTTTaaaaaasssssskkkkkkssssss))))))

IBM Software Group

333333555555


fte:copy – Copy one or more files

fte:move – Move one or more files

fte:invoke – Launch any program or command and capture output results and return codes with optional retry capability

fte:ping – Check connectivity

fte:uuid– Assign a unique id

fte:awaitoutcome – Wait for results

fte:cancel – Cancel a previously invoked copy or move request

fte:ignoreoutcome – Continue processing

…

WWWWWWMMMMMMQ/FQ/FQ/FQ/FQ/FQ/FTTTTTTEEEEEE A A A A A Annnnnntttttt T T T T T Taaaaaasssssskkkkkk E E E E E Exxxxxxtttttteeeeeennnnnnssssssioioioioioionnnnnnssssss

IBM Software Group

333333666666


SSSSSSaaaaaammmmmmpppppplelelelelele WWWWWWMMMMMMQ/FQ/FQ/FQ/FQ/FQ/FTTTTTTEEEEEE AAAAAAnnnnnntttttt J J J J J JoooooobbbbbbIIIIIInnnnnniiiiiitttttt SSSSSSttttttepepepepepep::::::

TTTTTTo so so so so so seeeeeet t t t t t vvvvvvaaaaaarrrrrriiiiiiaaaaaablblblblblbleeeeeessssss

SSSSSStetetetetetep1p1p1p1p1p1::::::IIIIIInnnnnnvvvvvvooooookkkkkkeeeeee aaaaaa FFFFFFTTTTTTEEEEEE TTTTTTrrrrrraaaaaannnnnnssssssffffffeeeeeerrrrrr

PPPPPPrrrrrreeeeee RRRRRReeeeeecccccceeeeeeiiiiiivvvvvveeeeeerrrrrr ttttttaaaaaasssssskkkkkk::::::IIIIIInnnnnnvvvvvvooooookkkkkkeeeeee aaaaaarrrrrrcccccchhhhhhiiiiiivvvvvveeeeee ooooooffffff ffffffiiiiiilllllleeeeee

ccccccmmmmmmdddddd......

SSSSSStttttteeeeeepppppp222222((((((DDDDDDeeeeeeppppppeeeeeennnnnnddddddssssss oooooonnnnnn SSSSSStttttteeeeeep1p1p1p1p1p1))))))IIIIIInnnnnnvvvvvvooooookkkkkkeeeeee pppppprrrrrrooooooggggggrarararararammmmmm ttttttoooooo pppppprrrrrroooooocccccceeeeeessssssssssss ffffffiiiiiilllllleeeeee

SSSSSStttttteeeeeepppppp333333((((((CCCCCCononononononddddddiiiiiittttttiiiiiioooooonnnnnnaaaaaallllll oooooon n n n n n SSSSSStttttteeeeeepppppp111111))))))SSSSSSeeeeeennnnnndddddd eeeeeemmmmmmaaaaaaiiiiiillllll iiiiiiffffff SSSSSStttttteeeeeep1p1p1p1p1p1 ffffffaaaaaaiiiiiillllllssssss

OOOOOOuuuuuuttttttlllllliiiiiinnnnnne e e e e e ooooooffffff FFFFFFTTTTTTEEEEEE AnAnAnAnAnAntttttt JoJoJoJoJoJobbbbbb

IBM Software Group

333333777777


• Overview

• MQ Topologies


• Advanced Topics

• Demonstration

IBM Software Group

333333888888


OuOuOuOuOuOurrrrrr A A A A A Arrrrrrcccccchhhhhhititititititeeeeeeccccccttttttuuuuuurrrrrreeeeee

Agents

A

A

A

A

Q

Coord

Q

QM Admin

Windows

Linux

z/OS

AQ

Linux

A

LinuxTTTTTThhhhhhiiiiiinnnnnnkkkkkkPPPPPPaaaaaadddddd

A Q

z/Linux

IBM Software Group

333333999999


Date post:	04-May-2018
Category:	Documents
Upload:	truongdien
View:	223 times
Download:	5 times

WebSphere MQ FTE (File Transfer Edition) - IBM · No WebSphere MQ File Transfer Edition code runs...

Documents