+ All Categories
Home > Documents > A time-dependent decision support system for multi-attribute decision-making

A time-dependent decision support system for multi-attribute decision-making

Date post: 04-Dec-2023
Category:
Upload: independent
View: 0 times
Download: 0 times
Share this document with a friend
13
lqErear e u8rsse III^\ WC eql 'ero¡ereq¡ 'eures eW sl 7 porred erurl qceo roJ los olnqune erfl IBID elunsse e,t\ 'osee rog 'sporred lueregrp eql q poreptsuoc eq plno^l enl€ ¡o suo4decreds.141q eql Surqucsepsles elnqlue lueJe.lJrp 'esec s¡{t uI 'JeJJrp ,{eql ereqm secuslstunc -¡c ,{ueur eur8erut u?c euo }nq rpolJed eurp IIcBeJoJ elues eql eq ,(eru les elnqrrDs eqil 'polred qJse roJ elnqlr1le gceo o] peu8tsseoq uuc lunocslp luero:lJlp B l€qt os 'sporred erurl olq secuenbesuoc qlIA\ suolslcep eqt uoddns ol pesn,(qcrurerq eqt Surprnrp esodord em 'snq¿ 'porred qcee ur pegrceds sr ecueuodun .selnqt.g -p er$ teql ,{em B qcns ur ,(qcrererqerrrlcefqoeq] 8ut -rnlcruls ,(q pereprsuoc eq u?c srql puu lrcqdxe opBru eq lsilu erntnJ eqt pue luese¡d oql ueelrueqsJJo-ep€n 'suorsrcep lerodruelrelq uI 'rncco,(eqt qcqrn ut poued eql ot pe{ull pue tuepuedep-eurrl eq ,(eur se}nqlr¡€ }Bql serunsw ruels,{spedo¡errep eql 'os 'Iepou 8ur,(lrepun eql q pelcogeJeq ol set{srqJ 'e8ueqc uec ecuegodrur s.errrlcefqo uB t?qt Eurnoqs '[¿I] pue l0lZl elull re^o e8uuqc slq8re,n etnql4l€ pus olllcefqo uo secuere¡erd wc t\or{ uo pelcnpuoc ueeq eñq serpnls IsJe es .eulll ¡eno e8ueqc ol pel{olle eJB ruegl Eurpunorms,{}ureuec pe^rrssu $r ¡y '(s)¡qfrle eWpuesserd SOI - V00Z O 00'¿I$/?0/60S2-690I NSSI -un aql pue slqErem 'selnquge esneJoq 'uorlenlrs eql ¡o Surpuetsrepun reileq e qll^{ slueure8pnl¡o suorurdo regl ssardxool sWC d¡eq uec qceordde snlll 'soruoc -lno uesoqc aql uo Surlunocsrp Jo slcoJJe eq] lunocce olur Eur{el 'suorlcun¡ ,$IFn Jo suueru,(q spol¡ed eun¡ JaAoemlcn-qs IBcrqcJBJerq ? w secuere¡erd sleporu lI ''e'r 'secuoJa¡erd esrce¡duu erurl eleudo¡dde Ieporu legl see¡ enrlcafqo qtrm IBep puu emldec ol elqe sr rue1s,(s eqJ 'sporred eurrl 0I pue slelel elrlcelqo 91 'serlrlcef -qo 0SI o1 dn qll^\ erup re o oo4 enrlcelqo uB lcruls -uoo rrec 1eql (SSC) ure1s,(s uoddns uorsrcep e pedo¡e.t -ep eABq em 'suorlunl¡s xeldruoc r{onsq}IA\ IBep oI 'sluoru -u8rsse eql Eururecuoc uorsrcs¡drurw I[eA\ se 'spoued erurl leJe^es Euruuedssezrrlcelqo Surlcrguoc e¡dr11mu Jo ecueseJd eqt e¡q'sure¡qord ¡eer ur esu? leql slcedse crwq eql Jo eluos replsuoc ol eIqBeq plnoqs puH sltü Jo slool er¡L 'sure¡qord osoq] ur pe^lolur senlncgrp Sursee¡cul eq] qll^\ I€ep ot sloot uoddns uolslcep relleq pue reileq;o lueurdolo^ep eql ot pe¡ ,(ltuecer wq stuel -qord 8ur{eur-uorsrcep ¡eer ,(ueur¡o ,$txelduoc oql uollJnporlul 'I '1oo1 goddns uolslcep sFIl Jo ,$¡11q1xeg pw sseulnJesn eql selersn11r su¡els.(soce c¡lunbe poleuttuuluoc Suuolser ro¡ serEelerls lurperueJ Jo uorlunlu^o eql o1uo4ucrlddu ue ',(¡uur¿ 'suorsnlcuoc orll Jo sseqsnqoJ eql {coqc o1 ses,{puu ,,fi1,r¡11sues lueJeJJIp sepnlJul osp ure1s,{s et¡L 'suolsloep e^rleuJellu elqelrs^e eql elsnls e ol uollcuru ,(111r1n ezrrlppu IsrJope^ Jo Jelecs 3 olq peluEerEEe eJ? qcIIIA\ 'selnqlJnB pue serrllcefqo uo sJolc¿J Eu4ecs esrce¡drurpuu suollcurg ,{l{11n pnp4lpq esrce¡dur Eurssesse ro¡ slndut lulueureEpnf uo pesuq secuere¡erd eteudo¡dde sreprsuoc,(qcrererqenrlcelqo s¡q¡ ',{qcreJerq a rtcefqo uu Jo sueetu ,(q pellepour er? qJIq^\ 'spoued erun luereJglp Je o secuenbesuoc eslce¡drurqlrl\ suorsrcep '.ftusseJeuJI'8urpnlcur'surelqord Eut,tlos JoJ InJesn eq uec ure1s,(s eq¿ 'Euqeeuue pel?Inurs e,rrlcelqor1¡ruu e^rlc€Jelul Jo sueeru ,(q ,(Ee1ur1s purldo aq1 Eur,(¡nuepl ls paure 'spoqleu Eutlunocsrp lueJeglp Jo ,fiqrqlssod eql sepnlcul r{Jlqrrr 'lepour ,$ptn e lt}pp¿ elnquilenlruu osrce¡drur ue ,(q pegoddns sr uels,(s eW 'spolJed awq lure es Eupuuds secuenbesuoc qlra\ puu se^rtoefqo Eu4lguoc e1dr11ruu Eurpnlcur u¡els,(s goddns uolslJep s equcsep e¡[ 'lJu4sqv sa'utdn'{6sorrs :IrCIu-g:OfgrcSt I6 rt+ :rui :Lft¿g€€ t6 rt+ :'IaJ ulodg'pUpDW 0g9gz'u¡s opacuoSaluo¡¡y ap snduo3 'tQlstauu7lnrruq)alWWW 'acuang n¡ndwoS {o Tooqcg 'acua?g1a1u¡ Torc{ttty[o ryautlndaq soetehl osuoJIV prlr- zeugrull oruoluv ?nsul-soIU o]xIS Euquru -uols Icep etnq Vne- Itlnur roJ tuelsr(s Uoddns uorslcep tuopuedep-eull v sse¡d sol S t-tg $OW) 1 ¡ SuueeurEug pep¡y-retnduro3 perurSerul
Transcript

lqErear e u8rsse III^\ WC eql 'ero¡ereq¡ 'eures eW sl

7 porred erurl qceo roJ los olnqune erfl IBID elunsse e,t\'osee rog 'sporred lueregrp eql q poreptsuoc eq plno^lenl€ ¡o suo4decred s.141q eql Surqucsep sles elnqlue

lueJe.lJrp 'esec s¡{t uI 'JeJJrp ,{eql ereqm secuslstunc-¡c ,{ueur eur8erut u?c euo }nq rpolJed eurp IIcBe JoJelues eql eq ,(eru les elnqrrDs eqil 'polred qJse roJelnqlr1le gceo o] peu8tsse oq uuc lunocslp luero:lJlp B

l€qt os 'sporred erurl olq secuenbesuoc qlIA\ suolslcepeqt uoddns ol pesn,(qcrurerq eqt Surprnrp esodord em'snq¿ 'porred qcee ur pegrceds sr ecueuodun .selnqt.g-p er$ teql ,{em B qcns ur ,(qcrererq errrlcefqo eq] 8ut-rnlcruls ,(q pereprsuoc eq u?c srql puu lrcqdxe opBrueq lsilu erntnJ eqt pue luese¡d oql ueelrueq sJJo-ep€n'suorsrcep

lerodruelrelq uI 'rncco,(eqt qcqrn ut pouedeql ot pe{ull pue tuepuedep-eurrl eq ,(eur se}nqlr¡€ }Bqlserunsw ruels,{s pedo¡errep eql 'os 'Iepou 8ur,(lrepuneql q pelcogeJ eq ol set{ srqJ 'e8ueqc uec ecuegodrurs.errrlcefqo uB t?qt Eurnoqs '[¿I] pue l0lZl elull re^oe8uuqc slq8re,n etnql4l€ pus olllcefqo uo secuere¡erd

wc t\or{ uo pelcnpuoc ueeq eñq serpnls IsJe es.eulll

¡eno e8ueqc ol pel{olle eJB ruegl Eurpunorms,{}ureuec

pe^rrssu $r ¡y '(s)¡qfrle eW pue sserd SOI - V00Z O 00'¿I$/?0/60S2-690I NSSI

-un aql pue slqErem 'selnquge esneJoq 'uorlenlrs eql

¡o Surpuetsrepun reileq e qll^{ slueure8pnl ¡o suorurdoregl ssardxo ol sWC d¡eq uec qceordde snlll 'soruoc

-lno uesoqc aql uo Surlunocsrp Jo slcoJJe eq] lunocceolur Eur{el 'suorlcun¡ ,$IFn Jo suueru ,(q spol¡ed eun¡JaAo emlcn-qs IBcrqcJBJerq ? w secuere¡erd sleporu lI''e'r 'secuoJa¡erd esrce¡duu erurl eleudo¡dde Ieporu leglsee¡ enrlcafqo qtrm IBep puu emldec ol elqe sr rue1s,(seqJ 'sporred eurrl 0I pue slelel elrlcelqo 91

'serlrlcef

-qo 0SI o1 dn qll^\ erup re o oo4 enrlcelqo uB lcruls-uoo rrec 1eql (SSC) ure1s,(s uoddns uorsrcep e pedo¡e.t-ep eABq em 'suorlunl¡s xeldruoc r{ons q}IA\ IBep oI

'sluoru

-u8rsse eql Eururecuoc uorsrcs¡drur w I[eA\ se 'spoued

erurl leJe^es Euruueds sezrrlcelqo Surlcrguoc e¡dr11mu

Jo ecueseJd eqt e¡q'sure¡qord ¡eer ur esu? leql slcedsecrwq eql Jo eluos replsuoc ol eIqB eq plnoqs puH sltü

Jo slool er¡L 'sure¡qord osoq] ur pe^lolur senlncgrpSursee¡cul eq] qll^\ I€ep ot sloot uoddns uolslcep relleqpue reileq;o lueurdolo^ep eql ot pe¡ ,(ltuecer wq stuel-qord 8ur{eur-uorsrcep ¡eer ,(ueur¡o ,$txelduoc oql

uollJnporlul 'I

'1oo1 goddns uolslcep sFIl Jo ,$¡11q1xegpw sseulnJesn eql selersn11r su¡els.(soce c¡lunbe poleuttuuluoc Suuolser ro¡ serEelerls lurperueJ Jo uorlunlu^o eql o1 uo4ucrlddu

ue ',(¡uur¿ 'suorsnlcuoc orll Jo sseqsnqoJ eql {coqc o1 ses,{puu ,,fi1,r¡11sues lueJeJJIp sepnlJul osp ure1s,{s et¡L 'suolsloep

e^rleuJellu elqelrs^e eql elsnls e ol uollcuru ,(111r1n ezrrlppu IsrJope^ Jo Jelecs 3 olq peluEerEEe eJ? qcIIIA\ 'selnqlJnB pue serrllcefqo

uo sJolc¿J Eu4ecs esrce¡drur puu suollcurg ,{l{11n pnp4lpq esrce¡dur Eurssesse ro¡ slndut lulueureEpnf uo pesuq secuere¡erd

eteudo¡dde sreprsuoc ,(qcrererq enrlcelqo s¡q¡ ',{qcreJerq a rtcefqo uu Jo sueetu ,(q pellepour er? qJIq^\ 'spoued erun luereJglpJe o secuenbesuoc eslce¡drur qlrl\ suorsrcep '.ftusseJeuJI'8urpnlcur'surelqord Eut,tlos JoJ InJesn eq uec ure1s,(s eq¿ 'Euqeeuue

pel?Inurs e,rrlcelqor1¡ruu e^rlc€Jelul Jo sueeru ,(q ,(Ee1ur1s purldo aq1 Eur,(¡nuepl ls paure 'spoqleu Eutlunocsrp lueJeglp Jo,fiqrqlssod eql sepnlcul r{Jlqrrr 'lepour ,$ptn e lt}pp¿ elnquilenlruu osrce¡drur ue ,(q pegoddns sr uels,(s eW 'spolJed awq lure es

Eupuuds secuenbesuoc qlra\ puu se^rtoefqo Eu4lguoc e1dr11ruu Eurpnlcur u¡els,(s goddns uolslJep s equcsep e¡[ 'lJu4sqv

sa'utdn'{6sorrs :IrCIu-g :Of grcSt I6 rt+ :rui :Lft¿g€€ t6 rt+ :'IaJulodg'pUpDW 0g9gz'u¡s opacuoSaluo¡¡y

ap snduo3 'tQlstauu7lnrruq)alWWW 'acuang n¡ndwoS {o Tooqcg 'acua?g1a1u¡

Torc{ttty[o ryautlndaqsoetehl osuoJIV prlr- zeugrull oruoluv ?nsul-soIU o]xIS

Euquru -uols Icep etnq Vne- ItlnurroJ tuelsr(s Uoddns uorslcep tuopuedep-eull v

sse¡d solS t-tg $OW) 1 ¡ SuueeurEug pep¡y-retnduro3 perurSerul

64 S. Ríos-Insua et al. / A time-dependent decision support systemfor multi-attribate decision-making

equal to zero to any fixed or given attribute that is notrelevant in a particular time period, and its contribu-tion is then null. This is implemented in the systemby means of attribute activation/deactivation. Figure 1shows a diagram of such a hierarchy. Intertemporaldecisions could be considered as an explicit trade-offbetween the present and the future by structuring theobjective tree so that the importance of the significantattributes in each period is made explicit.

The DSS is based on an additive multiattribute utilitymodel [16], which allows for imprecision concerningthe inputs Í2Il and[24], andpartial information of theDM's preferences. Thus, the process of assessing theindividual utility functions and the constant scales isnot very demanding, which is less stressful on DMs.

Furthermore, we shall consider the situation wherethe consequences might have some uncertain policy ef-fects, as considered in [18]. So, the system will alsoallow for uncertainty about the consequences or out-comes, where they can be entered as ranges or intervalsinstead of single values as an approach under certaintywould demand. Note that this more general viewpointleads to a more robust approach to decision making,which can account for imprecision and could overcomesome of the criticisms of Decision Analysis.

Thus, the starting point will be to establish a set of nattributes denoted by Xt, ..., X, and the time periodst : 1,...,,7. Then, the consequence of each strategyor alternative decision ̂ 9s e S, where S is the availablestrategies set, is a stream defined by a vector of intervals

(@ii, "Y;1, ..., l"*1, "Iil), ..., (l""rl, "Yil, (1)(1. . ., l" ""tn, "Y,ID, . . ., . *"rf , "Y I 1,, . . ., l*"#,, "Yí l))

where rlj nd r{nt are, respectively, the lower (,0)and upper (t/) endpoints of the imprecise consequencefor attribute X¿ in the time period ú. We assume thatthere is a continuous uniform distribution over eachinterval l"li,rYn'f, and both endpoints being equal,i.e., r!] : rYst, would be equivalent to the case undercertainty, where the policy effects for a strategy ,Sq inattribute X¿ for time periodt ne precisely known. Inany case, we also considerthepossibility of substitutingeach interval by a single value given by the average,f,nt : @l] + "Yn') 12 (P means precision), havingthen a precise consequence, if deemed appropriate bythe DM.

Next, an analysis focused on judgemental inputsmust be conducted to assess imprecise utility functionson atfributes and imprecise scaling factors or weightson objectives and atfributes in the objective ffee, and

for their aggregation into a global utility function thatincludes, where appropriate, discount factors for eachattribute set to evaluate timestreams. as we shall ex-plain below. The methodology has been implementedon a PC-based DSS, where all process-relevant infor-mation can be entered to help DMs arrive at the best ora satisfactory strategy. Finally, a multiparametric sen-sitivity analysis is introduced to check the sensitivityof conclusions on the inputs.

The following deals with the multiattribute utilitymodelling process under imprecision. Section 3 con-siders different discounting methods for providing DMswith assistance concerning how to tradeoffpresent andfuture. Due to the diffrculty in determining the beststrategy for problems with a large number of them,an approximation approach is proposed in section 4,supported by a optimizationmethodology based on in-teractive multiobjective simulated annealing, which isdescribed in section 5. Section 6 outlines multipara-metric sensitivity analysis. In section 7, we show thefinal model formulation illustrated with an example onrestoring aquatic ecosystems and, finall¡ some conclu-sions are provided.

2. L procedure for assessing the imprecisemultiattribute utility function

Expected multiattribute utility theory can be consid-ered as a leading paradigm for normative decision the-ory. However, multiattribute utility theory calls for theDM to provide all the information describing the deci-sion situation to assess component scalar utility func-tions u¿ 16,251, and [28]. This can be far too strictin most practical situations, which could lead to theconsideration of imprecise component utility functions,see [23] and [30].

In this modelling context, what would be called im-precise timestream utility fficient strategy set playsan important role, because it has a similar property tothe well-known efficient or Pareto optimal strategy set:given a strategy in this set there is no other strategy in Sthat dominates it. However, this set can be diffrcult todetermine in this new context, so intelligent approachesare needed to help the DM to arrive at a final solution,as we shall see later.

Now, note that it is necessary to assess a scalar util-ity function u¿ for each attribute X¿, that reflects DMpreferences on the possible atffibute values. The draw-backs associated with utility function assignment arewell known, even though good software is available for

l

wc eql 'sen¡el elnqlJ]ls eruos ro¡ ,$dure eq seSuerqloqJo uoqcesrelq eql plnoqs 'e^oq? peuolluolu sv

'eloqe s€ .11 pue ? qt¡r'\ 'aalnpue ,.]n

suo4cunJ ,{rupn Surpunoq eql ,(q pelueserder prrs seuqpllos uoo1lueq u^\BJp ssslc uo4cunJ ,{tupn eql s^\oqsosl? Z emEr¿ 'uosr¡edruoc JoJ pesn eq ,(¿ru slurod regO'slunoru? erns se poqleul-gJ eql q wc e4 ,{q pepr¡ro¡dsle^relul 1ue1e,ilnbe ̂Qulegec eql Jo spunoq reddn eqlesn e \.slB^rolul ,$g¡qegord ,$neds o] ssrl I IC eql'[9I] pue [g] ees 'poo¡taut sa1quoS autau)ca eql uI

'$ICeqc ̂cuelsrsuoc s€ pepnlc-ur or€ suorlsenb Ieuorlrppu Jo Jegurnu V

'peurelqo

$ sepglqeqord ecuere3¡Ipul Jo IB relq Iru Iltun uedxeeqt seprnE pIIB suollsenb crls¡rqeqord eql s^\oqs qcF{r!\'[g] ees 's¡ulre1ur,$¡lqeqord eseqt lndlno ol eururoJJo

IOeqA\ e Euquerue¡dru¡ eullnoJ B sepnloul urelsr(s eq1'seuq pellop uee^uoq

u¡aerp ss?lc uo4cury ,$¡¡¡1n slql s^\oqs ¿ ernS¡g '(redd

2) ;n,llroT sueeru (d I ereq^\ ' ,"]n puu ,"4n suoll

-cunJ,$UFn Surpunoq eqt,{q pelueserder oq uec gcg,!\'ruerEerp- (tr)tnf tv eqt q e3uu¡ 3 seurlrrelep poqleur

eql 'g¿'0 : td puB 09'0 : zd'97,'0: rd e)Fl e N

'.,{lerrlcedset' ¡d - I pu€ ¿d serl¡rqeqo;d q}ur *?r pve

j r senpn elnqrü1e perre¡erd lseel pue lsoru eql eru stlns-er esoq^\ 'se¡qruu8 luoJeJJIp ol luelu^Inbe sreprsuoc

eqspq tnw lr;"' ú"7 sl'^relu, enp^ elnqr.ul¿ ro sl'^-relul ecue¡elrnbe ,fiure¡ec eprlord o1pe{su sI hlq oW'[9I] pue [g] ees 'poqteru eIpcBU eq] q',{lpcgrcedg

'paurqqo sr eSue¡ luelsrsuoc e ueql\ seqsruU sseco¡der1¡ 'petrcrleer oq ppoqs secuere¡erd rerysq pue luel-srsuocur eq plno^\ WC eql '¡errrelur ue JoJ ,$drue eqsuorlcesreJur qcns ppoqs 'ee¡E¿ spoqleu e^oqe eID,{qpelrJrle secuere¡erd ereql{ eSuu¡ eql sephord sesse¡codu eql uee^\leq uorlcesJalul erf,L 'uo4curg e18urs erreql reqlsr poqleu qreo roJ ssslc uoDcun¡ ,$qpn e 1e3err '11nser B sV '16Z\ pue l77l ees 'slueruetets ecue-re¡erd e1e¡durocur epurord ol pe^\oilB ere ,{eql ecurs'suedxe uo [nJSSoIS ssel sl sllf,l'WC eql ,(q pece¡ uotl-senb .Q¡1¡qeqord qcue roJ pwruep spoqleu e^oqe eqlse 'en¡el esrce¡d e Jo p€otsut sesuodser¡o e8uer e opIA-o¡d ol hlq eql 6urmo¡1u uorsrce¡du¡r selunsse ll 'relo

-eJoIAI ',(lelrlcedse¡ 'seuoEepc (g¿) ecuelelrnbe ,fit-¡qeqord pue (iIJ) ecuelezrtnbe.(lutet¡ec olp ol SuoleqqcFlr!\ 'lglpoqtaut sa\quoS autarpca oq] pu? poqput anl-cn$er4:sernpecord prepuels peglpoul ,(pq8qs om1 8ut-urquoc,(q suorlcefqo eseql eluocJe^o o] s]dureile u¡el-s,(s rng 'sseco¡d lueuru8rsse erp ur pepreue8 eq ,{erusercuelsrsuocur puu s?rq pue'luepuedep poqleu ,(¡ure-ue8 e¡e suollcunJ ,{tl¡rn pellcrle 1erp pe}se88ns eireq'[6I] ¡o ltl'Ztl

'3'e'ees'sroq]ne IBre^eS

'ssecord stql

'spoued eur4 Surpn¡cul ea4 er4cefqo ue¡o urur8elq 'I '8It

s9?un¡aa-uolnlrap anqluto-ulnu nlualsKs uoddns uotsnap Tuapuadap-awg V / 'to P Dnsul-soJü'S

66 S. Ríos-lnsua et al. / A time-dependent decision support systemfor multi-attribute decision-mnking

Class of utility ñrnctions withthe extreme gambles method The intersection

of both classes

Class of utility functions withthe fractile method

would have provided inconsistent responses and he/sheshould reassess his/her preferences. Thus, the intersec-tion will be the range for the DM's utility functions. Thesystem is able to detect possible inconsistencies andsuggests what the DM should change to achieve con-sistency. Thus, given a precise consequenee fi¿ for at-tribute X¿,wehave a utility interval l"! ("u), uY @o)linstead of a single utility u¿ (r).This is shown for in-creasing utility functions in Figs 2 and 3 by the stripedarea.

As we shall see below, the evaluationprocess calls forprecise utility functions in the problem-solving process,so the system assesses fitted utility functions "f emeans precision) by natural cubic splines interpolationthrough the mid-points of the utility intervals in theintersection area for each 'u,¿, see Fig. 3. The result fordecreasing utility functions would be similar.

We also need to assess positive scaling constants orweights k¿ to add the separate contributions of the at-tributes and get the additive multiattribute utility func-tion. The DSS includes two methods for assessingsuch weights for any objective of the hierarchy: usingtradeoffs, see [16], and direct assignment. The firstprocedure is based on trade-offs among the respectiveattributes at the lowest-level objectives stemming fromone and the same objective. The DM is asked to pro-vide probability intervals such that he/she is indifferentbetween lotteries and sure consequences. This proce-dure is best suited for the lowest-level objectives in the

Fig.2. Utility function classes of based on the fractile and extreme gambles methods for attribute -{.

hierarchy because they involve a more specific area ofknowledge. We begin with the objectives at the low-est level ofthe hierarchy and then continue the assess-ment in ascending order through the hierarchy. As inthe case of utility assessment, imprecise assignmentsby means of ranges or intervah fkr¿, k{] arepossible.This means that the DM will be able to perform a globalsensitivity analysis, allowing intervention at any levelof the objective hierarchy.

The second procedure is based on direct assessmentand is, perhaps, more suitable for upper level objec-tives, because they can be more political. Here, theDM is asked to provide weight intervals lk!,k{1, asbefore. Note that when the system is run, the startingpoint is equally weighted objectives. However, any in-terval or precise weight can be changed, and the systemautomatically takes care of how these changes shouldbe propagated through the objective hierarchy and re-calculates the overall vector utility for each strategy.

In both assessment procedures, the system com-putes the normalizedaverage weights and a normalizedweight interval over the directly assigned weights orweights outputby taking expectedutilities in the lotter-ies and sure values in the assignments based on trade-offs. In any case, such normalized average weightstaken from the DM's imprecise responses will be de-noted bV kf . The superscript P in kl means preciseweights, and note that the DM can specify identicalinterval endpoints, which means thatthe DM is consid-ering a precise value, i.e., kf; - ky - kf .

(s)

-ud eql eJer.l^\ '"' '7,'I : +JoJ ,_r((?¿ * I) lt) :

,_ia 'sr leql'ecuonbes crqeruoe8 e ruJoJ slq8rem Sururrl eq1'ppow Suuunocslp-tuDtsuor sFIl uI 'smcco lgeueq rolsoc oql qclql\ Eurrnp 'J'"' 'I : + ruer( er¡1 o1 Eurproc-m lueueq pue lsoc ernlfu qffe roJ elnqr4lB qcBe ol((0, + t) lt) : ?d sqSrem Sururp eql su8rsse poqletn8urlunocsp eW 'snq¡ 'seuo ¡eddn oql ol lueuodruocpuoces eql pu€ secuenbesuoc esrce¡drul oql Jo slurod-pue rel\ol eql ol spuodseuoc lueuoduroc lsrg eql eJer.I^\

eqf lBql ,(es p¡noc eal 'snq¿ 'os op ol elqeuosBorun sTll rBIII Eu¡nEm 'spoo8 le{reru-uou Surlunocsp q }uereg-ur senssr eql lnog? uorssncsrp Surlserelul uu sl oJerll

[Z] ul 'e]er tunocslp 4eql stco¡lJe teq¡a pue erur] relosenrpoururoc snorJul lunocsrp eldoed moq elu8rlselurol lno perrJ?c ueeq wq qcmeseJ 1ecr8o¡oqc,(s¿

'Eur¡re,ro

olasre^? eJ? pu?,(lepnbepe emlnJ eql emlcrd o1¡ru¡ e¡d-sad esnuceq $ srgl leql rurelc serJoeq] en4ru3o3 ',{em

sgl ul erntnJ aqt enl€^ e¡doed ̂\eJ teql s^\oqs qcreesererr4dl¡csep 'lene1|o¡1 'oluJ lunocsrp lrr?lsuoc e prruluepol ueeq suq ,{roeql cttuouoce e^rluuuou ur r(cuepuel8ur-Fezrerd egl eJeq^\ 'lurod 1ue¡odu4 srql uo uorssncsrp,{t¡13ue1e ueeq seq ereqJ 'Su4unocsrp

lur}ueuodxe esnol sr Jerrrsue cr{uouooe IerrssBIJ eq} pue 'uorlsenb 11nc-UJIp B sr ernlnJ eq] pu€ lueserd eqlJJo epe¡l ot,¿!\oH

erup raao Eununocslq '€

'srolcBJ

]unocsrp Jo esn egl uo pewq sr qceordde e¡qlssod ueJeql\'slezrre1ur,{1l1pn Jo sJolcel fqpezuelce.reqc ser8-ele4s eq] 6ur{ueJ roJ po4eru B eprlord o1 sr urelqordmo 'mo¡ '7 porred orurl qcee qlll\ potuloossu IB Jelulqcee '(Surseorcur ore suo4curg ,$llpn eql leqlpoprzrord)

sle relur ,(1114n ¡oJOICOA e ,{q uenrE sl ¿,s ,(3e1u¡1s ro¡,{1gpn eql'qceorddeJno ur secuenbesuoc eql Suru¡ecuoc uorsrceJdurr eql olenp 'lelezlro1¡¡'?X

Jo lunours cgrceds e st ?r eJeqt\'(r)

JnJE'::3: (r) ?¿ rnroJ eql Jo uortcunJ ,$lgrnpqo13 ? eñq eM 'lLZl pw [02] uorJururxo¡dde ue ¡o'[91] uoplpuoc ecuepuedepur e rlrppu eqt Sururnssv

l¡x¡rn

$lx¡;n

I r:1 r:?

lCÁ4 ;nvid;5t33L,tu

,c44;nr_ialu,?ilJ ul

JOICoA erD sI'ecuep-uedepur e^nrpps e oqe eq] ql!v\ peurquoc uoqrpuoc,$ueuopels eql ue,u8'sporred ewq Jprre (,X '"''rX)

selnqlr1le Jo ]es e roJ oS ÁEerens e qlr^\ pelercosse(1) ruee4s eruoc1no ue Jo (oS)n,{Upn petunocsrpeql 'socuonbesuoc esrce¡du¡r qlrl\ lxeluoc Jno uI

'peroldxe eq plnoqs 1eq18ur4eruos sr sqll 'op

seJBJ lunocsrp lu¿lsuoc u€ql eJrunJ uuel-8uo1 ,fterr eqlol ecueilodu¡r e¡oru qcel1e ot sW61,r\olle op'[II] puu

[1] sepr tunocsrp c¡¡oqred,(¡1 'plnoqs tl ,{qm suosuerenrsens¡ed eru ereql pue 6pellqrqxe sluerueSpnf en¡eleql ql1ll\ ee¡8e lou soop sql ler{l rulelc sroqln€ eruos lng'seruoclno eql uee^\leq ecuereJJrp erurl elnlosqs er{l uo,(¡uo puedep plnoqs ecuere¡erd oql 'eroJereql 'pelen

-l?^e ere seruoclno eql ueq^\ erup eql Jo luepuedepursr seruoclno o^u JoJ ecuereJerd eqt leql setels ruorxeeql 'lrrBlsuoc eq plnoqs pue erB sJolcBJ lunocsrp lBrllerunssu ecror{c lerodure¡e1ur Jo seuoeq} e^rlerrrJou 'os

uo^e 'pue seseeJcur eluoclno ew o] eIuB eql se eseoJc-ep leql seler lunocsrp e,req uego e¡doe¿ 'eruoclno eql

Ilun erurl eql uo puedep seleJ lunocsrp leql slse8SnsqcneseJ l€Jorruqeq "(gerrg 'Surruer¡ pus lxeluoc uors-lcep eql uo puedep sel€r lunocsrp luql s^\oqs qcreeser

'ta enqu¡e JoJ uorlcunJ ,{Upn eslce¡d pue sse¡c uorpurg ,{lruln '€ '8Id

H

(ix¡ )n

,X

Tn

?ut>trut-uotsoap aflqugo-u1nut tolutatsds uút rcl4np ruzpuadap-au4t V / 'to ta onsq-so!ü 'S

l

68 S. Ríos-Insua et al. / A time-dependent decision support systenxfor multi-attribute decision-mnking

rameters r¿ &te the social discountrates and the expres-sion 1 *r¿ - pl-' I ptrepresents the trade-offs betweenthe costs and benefits in any two adjacent time periodsú - 1 and ú. The problem of determining the appropriatesocial discount rate has received much attention, see,e.s . l2 l .

For medium to long time spans, i.e. for large T, pr-tbecomes very small as ú tends to T, which means thatconsequences towards the end of the timestream areeffectively discounted to zero. To overcome this objec-tion, we have also implemented an approach proposedin [10] and [11], which suggest a varying discountrate that could devaluate the future at a much slowerrate. This is the p ro p o rti o nal - dí s c o untin g mo d el,wherethe timing weights form a linear fractional sequence,that is, (bol (bo + t))", where b¿ ) 0 is the tempo-ral mid-value for attribute X¿, that is, the point inthe future given half the weight of the present, and-oo ( r¿ 1 x reflects how the ratio of the outcomesis related to the ratio of the time effects. So, if theDM is timing averse, the utility of a future stream ofimprecise multiattributed outcomes is

l T r L T , . .

lD, ni "i {"iil+\L,f #),, k! u! (" o"h,L ¿ : t i : 2 t : L

v x I v

G )T n T h . I

D, nY "Y ("fln, )+f t( r= ),, kY "Y @Yh It : l , i :2 t :L

vL I v I

Note that the values in expression (4) decay to 0 astime tends to infinity slower than (3) and, therefore, thisapproach attaches relatively more importance to long-term outcomes. The model focuses on the ratio betweentwo time periods and not on the absolute difference intheir time. To use model (4), it is necessary to determineb¡ and r¿ for each attribute X¿ for the DM, see [10]and [11].

The next thing to be modelled in the DSS is the casewhere the DM assumes that the assessment of discountfactors is a diffrcult task for certain scenarios, and analternative approach must be provided. In this situation,we consider for each strategy ,Sq e S, the vector ofutility intervals (2) for each time period ú and, as before,the problem involves choosing the best strategy nowbased on that vector.

In short, we have that each strategy ,Sq will be char-acterized in all the above cases by a vector of utilityintervals

o (Sn) : uq: ( l " | t , " f l t l , . . . ,1uf ; ' , "Y\)of dimension 1 or T, depending on the case. Next,we provide a problem-solving approach to solve thiscomplex vector optimization problem.

4. A problem-solving approach based onapproximation

First we note that a preference relation Fo can bedefined on S from the utility vector (2), which leads toa dominance principle, defined as: given two strategiesSs, S* € S, we have that

Sq Fo S* e un ) ar,-,

which means that Sq dominates,Sm if and only If ult 2uff,Vt, with at least one strict inequality. The relationF,, is a strict partial order on S and, hence, we state thevector optimization problem as

max ,, (,9n)s.t. ,9q e S

A natural concept is that ,9q e S is an imprecise utility

fficient vector strategy if there is no ,9- e S such thatS^ l, ,Sq or, equivalently, a* 2 u.q. This strategyset will be called imprecise timestream utilíty fficientvector set and denoted by e t (S, o). This leads to theproblem "Given S and to, find e¡ (S,u)". Clearly,if the set E¡ (S,o) had a single element ga, it wouldbe the most preferred strategy for the decision-makingproblem. However, this is not the case in most realproblems, because e¡ (S, u) could crments. Thus, our problem should O"?:#a single element from the set e¡ (S, u)". One way tosolve this decision-making problem, favored by behav-ioral approaches, will be possible if the DM is able toreveal more information on hislher preferences to pro-vide additional structural assumptions and get a subsetof e¡ (S, u). For this purpose, we provide an interactivemethod, based on multiobjective simulated annealing,to progressively build an approximation set to e7 (S, u)in collaboration with the DM, which is valid for any ofthe above settings and based on vectorial optimizationfor the imprecise utility vectors with different dimen-sions depending on the model used.

5. Interactive simulated annealing-based search

The ideaof themethod we proposeis based onthe in-teraction with set S, which is associated with the respec-tive set of vectors of utility intervals (l-dimensionalfor cases (3) and (4) and ?-dimensional for (2)). Wethen generate an approximation set A (S, o) of the im-precise timestream utility efficient vector set E¡ (S, o),i.e., solutions not dominated by any other consideredsolution.

-na se8ueqc osoq1 ̂doqlo seJ€c se>I€lure1s,(s eq1'1elre1ur lqErert pezqeuuou € Jo punoq e ro lq8rem pezr

FDuaEe¡ane uu oleEuuqcB se{eru ntq eqlJl'ecuel¡gF¡et¡e ¡o Supluer erll uo lcedur Jleql Suruesqo

F qlpn ro s1q6re^\ eql SurEueqc ,(q peruro¡red ,(¡e-nsn $ VS

'SupIBIu uolslcep e,r,r1celqorqnru ur srs,(¡eue,(tytrtrsues roJ {Jol\orrre4 ? secnpoüul qc¡{1vr '[tI] ul

Fl¡Jsap are sts,{1eue ,qr^.r}rsues ¡o sed,fi eIIIos 'suoll

qlmom.l eqt Jo sseulsnqor oql otur {Ersur requrg

rf rc'atue¡ elqeuos?eJ u urtllr,l\ 8ur.fte¡. (secuenb.(lul fil¡¡e¡s puu sertqrln 's1q8re,l) sreleruered pdul

rS Jo uoRJunJ u se SuuTu¿r otll uI se8ueqc Surulurexe

F{mq,(¡¡eUuasse qcFI/(' (VS) srs,(1euu,(1pil¡rsue5

s¡sr{¡eue ̂{¡¡,r¡¡¡sue5'9

'w7 Jo suoqnlos

JO 16 .n uonnlos B qll1I\ peusll€s ,,(1e1eldruoc q l\I(Inp üeqrt spua Eulleeuue pelepruls olrlcerelul oql

w T uI suo4nlos ¡o lndur eq] lIuI olpesn osp aJB sle^el uorlceJsIlss IunIUIuru eql lBql eloN

' {+n" 1 ,3" ' ',S} u

{{r*.4 ) Y'(Y'n's)v} n r-wT}Y : ^tsuo4nlos Jo lSIJ ̂\ou eql

lnóno ol ¡epro u\ w7y.ulsJolcel Surlq8retr eql r¡lr,r. Bur-FauuB pel?lnrms errrlcefqorllnlu IIIJoJJed en '¡noN

'[91] ees'(Euo4s

ool arB sle^el uorlJsJsllss s.I [(I eqt ueqm) 1ndlno 1ousr gq8ram Jo les ,$du¡e uB 1utll os pecnpoüul osls sIJolJe^ Sutlq8telr A\eu e eJeql\ pu€ sle^el uorlceJsllss^\eu aql ol lcedse¡ rDIA\ sselesn eruoceq luql slq8temeql Surnouer peleJeueS sr ¡4¡A\ srolce,L EurlqBIoA\ Jolsrl pelJr.rlseJ A{eu e 'ueq¡ 'lst1 sH} uo secuere¡erdJeWSq o1 Surprocce slelol uoqceJsrles lunrulultu eql

seglpotu oq^\ 'hlq eql ol pelueserd 5¡ 6T-"1411 6euo

snorne¡d eql ul lndlno ls¡ eql'uor1e.re1l qcuo ur'lxeN'eloqe pereplsuoc uo4e¡edo 3uue11g eqt

Jo tlnser B s€ pelereueE st (Y'.'S) VoalYn V : 0?

lsrl Isrlrur uB 'sntf,L 'les sql uI pepnlcul osl€ eJB

1 o1 pnbe uorlrsod ,r[ eW ]nq 0 o1 lunbe slueuod-ruoc IIB qlra rI srolce^ EurqlqSre,r. eql 're,roe.ro141'[9¿] ees 'uoqnqr4slp

ilnqle¡6. eq] ruo4 Suruteruer eqlpuB uorlnqllslp uiloJlun eql ruo4 eluoJ qclq^\ Jo ob09

'{r:'r'13 pu€?Ah'ol > ?y:¿u t Y}

les oql ruo4 ruopueJ l¿ u^\erp er?

o/vt les rotce^ 3u4q3rem IBIllq u? Jo slueluele eql puspezpqrur ere slolel uorlceJsllss lunrulul(u egl'lsrC

's^aoIIoJ seuorlurrrJoJur eW ol esuodse¡ ur secuere¡erdSurprocce sle^el uorlceJsrles oseql rSlpour ¡r,r'sseco¡d e^Ilcerelur ue q8norq¡ ',(¡¡enppr¡pur roll/tuqseUSrlBS slueuodu¡oc lueJe:grp eID Jo seplpn eID Jo euoqcee r{crqln ulqll,r\ spunoq eqt }ueserder qcll{a\ 'se1nqu1

-tB tuere.glp eql roJ I IC eqt Áq pepr,r.ord eq lsnru ?3 sle-^e[ uor]oEJSrlBS runrutulluJo 1es e 'puuq Jeqlo eq] uO

'(Y 't'S) V¡n)vn V

: (n'S) V pq1 ,(em ? qcns q 'V ,{q pelouep eq il1lr\sseco¡d 3urre11g sq¿ 'suonnlos peleulruop-uou eql

lndlno oluosueduroc esll\rr€dr(q (V 'n'S) y,&\fY 0leseql rellg ol peeu em "{1¡uurd 'u ,{q pscnpq uo4ce4p eql

uI suortnlos ,(l¡pn luercule,(1¡epuelod eq] sulsluoJ lerp(y'n'S) V lsll u 'y IIme roJ 1e8 e¡t ',{elt peglsre^Ip,{¡elrsuelxe uu uI pelureueE 'ÁA les Jolce 8upq8¡eme 8urr1e¡ :s^\oIIoJ se sr'(n'S) rf les eqtJo (n'S )Vuouaruxordde pooE e Sururelqo JoJ ernpecord eq¡

'suollnlos

,(1¡¡pn luercgo,(¡er1ue1od eqt,{q peuroJ uor8e¡ JBIncrl-¡ed e spre^\ol sn p€el plnoc rcqt slq8le^{ Jo les ursuece 8ur1celes sueelu qclq^\ 'suorln¡os ̂\eu Jo ,(1¡¡quqord

ecueldeccu eql e$eJcop Jo eseeJcul of elqe eq Ipqs oA\'slqEre,r eqt 8uq¡oruoc ,(q rcqt etoN 'y rolcen 8ur-lq8rern eql Sursn Euqeeuue pelelruurs ,(q pelereue8 lessuo4nlos ,(tIIFn luelclge ,{¡er1ue1od eq} oq (Y'o'S)V

1e¡ 'zno¡ ',$ryqeqord qcns ouuep ol pepeeu sI Y rolco^Su4qErem V

't¿l ees 'e¡ru lcnpord e,ulcefqortpru el{l

sr lxeluoc rno uI pesn ,$qrqugord ecueldecce eq¿'(.'S)

V les eql pllnq

,{lsnoeuu1¡ilrrrs e¡a 'eceds eql q8norq suorlsrell eq} uI

lueurrre^ourrr eql ol Eurprocce ',(ern srql uI '{41gqoqoñ

acuoldaccp w u1(ou{'r$¡gquqordue,rrE 3 qll^\ uopeJell

lxou eql JoJ ,g Suueprsuoc enu4uoc plno,¿l\ em '(n'S) V

uI lueluele ,(ue ,(q pepu¡tuop ere^\ s JI 'puBt{ reqlo

oqt uO 'S Áq peteulruop (.'S) V ur uo4nlos ,(ue 1no^\orql pue (n'S)V tes eqt ot S ppu e^\'essc slt{l uI'les uorlerurxo¡dde eql q ,(llueunc set8ele.us eql ,{qpeleurruop ]ou sI U JI peldecce sr ,S pue 'pereprsuoc

sr uorturelr luerrnc eq] q uoqnlos eg] Jo pooqroqq8teueql Iuoq g ,{3ep4s Jeqloue 'suoqe¡ell Surmo¡o¡ eqtuI 'oS ,(po Surureluoc pezrl€rlrur q (n'S)V tos eqlsnql pu€ 'ruopuel 1B u^\?rp s ) os ,(8ele¡ls leplul ueEurpr,rord uoIlBJeU lsrg e qlrm sur8eq poqloru eql

'e¡durs sr poqlelu eql Jo eepl crseqeql 'uer{,L '(.'S) /f tes eqt Jo (g ur ser8epüs eq} qtl^\pep}?rcosss srolre^ ,$IIpn eql stueserder n) (o's) y ps

uouúu)rxotddo ue elereue8 ueql o [ 'Dn Jo]col ,{tnlne qlF\ pelsrcosse sl ¿,9 lueruele qffie ereq^\ 's les eqluo peseq sr poqletu eqJ 's^\oIIoJ se s '[91] eQs'uor1-anauotddo uo pasDq Sutloauuo papputs autJuJalulpolpc 'pogtetu uollen¡e e slggo eepr Eur,{¡repun eql

Swow-uuwap atnqyuD-ulnu n{waLsKs ltoddns uotsnaP Tuapuadap-aug V /'1CI P Dnsq-so!ü 'S

70 S. Ríos-Insua et al. / A time-dependent decision support systemfor multi-attribute decision-mnking

gated through the objective hierarchy and automaticallyrecalculates the list -Ls of potentially optimal solutionsto run a new interactive problem-solving process. Italso recalculates the overall utility for each strategy andthe resulting ranking based on the precise values for theweights, individual utilities and consequences.

Another way of performing SA involves assessingthe interval in which the weight for a specific objec-tive can vary, maintaining a constant ratio among theother weights, without affecting the overall strategyranking. Suppose that we currently have a ranking ofthe given strategies and the DM chooses a node or leafof the objective tree with an associated weight. Thesystem calculates the weight interval for this node/leaf,taking into account the updated weights for the objec-tives stemming from its predecessor, so that the rankingbased on the precise assignments does not change. Inother words, if the weight is changed and the new valueis within the range, then the ranking will not change.However, if the new value is not within the range, thenew ranking will be different to the previous one.

Finally, the system runs simulation techniques forSA, see [3] and [4]. This kind of sensitivity analysisallows for simultaneous changes in weights and gen-erates results that can be easily statistically analyzedto provide more insights into the multiattribute modelrecommendations. We propose selecting weights atrandom using a computer simulation program so thatthe results of many combinations of weights, includinga complete ranking, can be explored efficiently.

Three general classes of simulation are implemented:random weights, rank order weights and response dis-tribution weights. They are described briefly below.

a) Random weíghts.' As an extreme case, attributeweights are generated completely at random.This approach implies no knowledge whatsoeverof the relative importance of attributes. In manymulticriteria settings, the scores of the strategiessignificantly limit the subset of potential rankings.

b) Rank order weights: Randomly generatingweights while preserving an attribute rank orderplaces substantial restrictions on the domain ofpossible weights that are consistent with the DM'sjudgement of attribute importance. Therefore,the results from the rank order simulation mayprovide more meaningful results. The DM canintroduce the rank order for all or only some ofthe attributes of the problem.

c) Response distribution weighls.' The third type ofsimulation-based sensitivity analysis recognizesthat the weight assessment procedure is subject

to variation. For a single DM, this variation maybe in the form of response effor associated withweight assessment. Thus, whereas in the firstclass of simulation, attribute weights were ran-domly assigned values between 0 and 1 (takinginto account that the sum of the whole is 1). at-tribute weights are now randomly assigned val-ues taking into account the attribute normalizedweight intervals provided by the DM through theweights assignment methods.

Once the simulation has been run, the system com-putes several statistics about the rankings of each strat-egy, like mode, minimum, maximum, mean, standarddeviation and the 25th,50th and 7íthpercentiles. Thisinformation can be useful for discarding some possiblestrategies, aided by a display which presents a multipleboxplot for the strategies.

7. An application to the restoration of an aquaticecosystem

In this section, we describe the application of theDSS to the analysis of a set of remedial strategies forrestoring Lake Kozhanovskoe, located in the Bryanskregion in Russia, which was heavily contaminatedwith1379r after the Chernobyl accident in 1986. This com-plex decision-making problem was studied in a sim-pler context (taking a static approach, precise inputsand certainty over the consequences) using the MOIRAsystem, see [9]. In 1998, Lake Kozhanovskoe wasclassed as a radio-ecological reservation, and fisherywas offrcially forbidden because of the high levels offish contamination with 137Cs. The population aroundthe lake was evacuated, as its area belonged to the pop-ulation evacuation zone as the levels of contaminationwith 137Cs were rather high (137Cs fallout on the lakewas about 600000 Bq/mz). However, many residentscontinued to live at villages near the lake, and fishcaught in lake Kozhanovskoe was a predominant foodof the local residents even 10 years after the Chernobylaccident.

In spite of the ban on fishing proposed by the expertassessment,20-30 families were still engaged in fish-ing. In addition, amateur fishermen often went fishingto the lake from neighbouring districts and caught fishfor the most part with fishing rods. Consumption offish by the fishermen and members of their familiescould be as great as 80 kg a year per person, while.on average, the residents of this area consumed 20 kg

¡e qEnorq uorp¡ndod eql IIe ,(q pe,necar osopolrlce:Fo e ncelloc oql '?X) asoe amlcano7 'V

'Ápoq role^\ peleurureluoc eql ruo+ rele^\ IDr^\pep8p4 pooJ lelr1sorrel pue pooJ cllenbe Surleepue 'relerrr Suplurrp 'eeJB eql ur Sutrr¡¡ dnor8 lecr-lrrc B ol Sur8uo¡eq spnpl^rpq ,(q pellecer esope^rtceJfle oqJ '(sX)

Tonpr,trpul lzrttrrJ ot aso(I 'E'urelsr(soce crlenbe

eq] Jo uorleurlu€luoc elqc€olper eql Jo ecuenbes-uoc e w qsg .(q perrtecoJ osop uorlerp¿J peqJos-qu e{t Jo tuorussesse uV '(6X) qs?t ot aso1 'Z

'qsu pu? soqlueq'uopluu¡dol,(rld SurlceJJB selgelre,l ure1s,(soce luel-rodurl Jo otels eql sesIJBIuIuns lI 'slueluuonl

-ue crlenbe q qlpeq ruels,(soce eg] Jo eJnseeru esr xepul rue1s,(socg eq¡ (tX) rapq uals{socg '1

:eJB SoAII

-cefqo Ielel-tse^\ol eql ol pe]ercosse selnqlr1]s eI{:[

'pesodord sporred erun eeJql eql Jo euo qcee roJ leselnqrrD€ elues eql qll^\ 'urelqord sgl roJ urer8erp eerler{l s¡aoqs y em8rg 'SSC eql q prqsllqutse erol(',(qcru-rerq eqt Jo selrlcefqo ¡elel-tsetrrol eqt qrp\ petelcosseselnqr4l€ etll se ilo,,t\ sB 'senrlcefqo lIrc ele¿ 'uo4senb

ur orJuuecs eql JoJ sel4euJelle uolluJolseJ Ieclleqlod,(qor{l Jo uor1enle^e puu uorlducsep oql roJ spunor8 eqlepr,rord ol popuelq qcH,!\ ' ure¡qord 8ur{eur-uolsrcopslrll roJ lllnq se^a ,{qcrererq errrlcefqo uy 'e I13uJe1-l€ uorsrcep uo4erolser lsoq eql Jo ocloqc sóI ic eqlsuoddns ure1s,(s uorsrcop o oqe erp lxeluoc sql uI

'uor1e¡ndod

eql ,(q porunsuoc qsu Jo Junorus eql ro uollsurlueluocqsg Jerpre Surcnper ]€ pelueuo ,(¡ureur eren serEep4suouuelJelul eq]'eJoJeJerll'serceds,fto¡eperd-uou ul

lqErerrr qse4 '8rybflrl0I-9 se,t\ ]I seereq^\ lq8real qse+'Erybflrl gZ-OT,'eBe¡e,r¿ uo 'sB^\ pue q8tq peuleruereo{snouer{zo) e{e-1 uro{l qsg Jo serceds ,fto1uperd ursJ¿er Jo uorl€Jluecuoc eql '866I uI ',(l1enuue qsu Jo

TL

'ao)ls^orreqzo) e{B'IJo uorlsJoNer eq} JoJ ,(qcmre¡q e,rqcefqo ¡uepuadep-eurll 't 'ald

Suurw-uotsnap anqlutD-ulnu rctua¡sKs ttoddns uotsnap Tuapuadap-au! V / 'Io P Dnsul-soly S

S. Ríos-Insua et al. / A timz-dependent decision sapport systemfor multi-attribute dccision-making

Table 1Attributes used in evaluating the strategies

Attribute RangeWorst z¿* tlest r;

X1 : Ecosystem IndexX2 : Dose to FishX3 : Dose to Critical IndividualX¿ : Collective DoseX5 : Amount AffectedX6 : Duration of Ban IIX7 : Cost to EconomyXs : Cost of Application

LEI @cosystem Index)mGy (MiliGray)mSv (miliSievert)

mSvxpersonTonnesMonthsEurosx 102Eurosx ld

51d500

L 2 x 1 ÚrÉ120108

2 x 1 0 8

10000000

Table2Outcome stream for S€

Attribute

XtXzXsX+XgX6X7Xg

[1.31, 1.40][1700, 1820][10.9, 11.3]

[61000,63000][540,600][60,60]

[342000,367000][o, o]

the exposure pathways due to the contaminatedwater body. It is a measure of the increased riskof serious latent health effects.

5. Amount Affected (Xs). In the case ofresfiictionsto fl sh consumption and food industry processing,the amount of fish affected by restrictions.

6. Duration of Ban II (X6). In the case of restric-tions to fish consumption and food industry pro-cessing, the duration of the restrictions.

7. Cost to Economy (Xz). The direct economicimpact of the resfrictions, either in terms of thecost of the food affected by bans or in terms ofthe production lost (e.g., share of Gross DomesticProduct Lost).

8. Cost of Application (Xa). In the case of re-medial countermeasures (physical or chemical),this represents the direct cost of the application:manpower, consumables, equipment needed forthe application, management of wastes generated,etc.

Thble 1 shows these atffibutes as well as their mea-surement units and the respective ranges provided forthe strategies analyzed later.

Several intervention strategies or alternatives mustbecreated to reflect what could happen once the scenariohas been settled. Expected conditions occur, based onthe available infonnation, but as the multiattribute con-sequences of each possible sfrategy are assumed to be

uncertain and Simulated Annealing generates stochas-tically alternatives, the system can randomly generatealternatives and any considered feasible will be takeninto account for evaluation. As a consequence, we willpossibly have a NP-hard problem that can be solvedby mathemafical algorithms. Generally, the only wayto optimize will be by simulation wittr the aid of theimplemented interactive multiobjective simulated an-nealing. As shown with this approach, DM can changeseveral parameters to interactively reduce the impreciseutility efficient set until a final alternative is obtained.

In this example, we consider six sfrategies whosedescriptions are:

SL : No Action. Natural evolution of the situationwith-out intervention.

52 : PotashTreatunent. Reduction of aquatic organismuptake by potash treatment of aquatic ecosystemscontaminated by radiocesium.

53 : Fertilization. Tonnes of fertilizer addedto the laketo increase biomass (biological dilution).

Sa : Lake Liming. Reduction of radionuclide remobil-isation from sediments.

S5 : Sediment Removat. 6k¡r.t2 of sediments removedfrom the lake down to depth of 5 cm.

56 : Autom.atic Food Bans. Automatic fish consump-tion ban when 1379. content in fish is greater than1000 Bq/kg.

Time period ú

[1 .30,1.42][1660,1800]lro.7,rL.21

[60700,62800][150,165][30,30]

[12000,48300][o, o]

[1 .28,1.43][1590, 1750][10.3, 11.0]

[60400,61300][0,0][0,0]

[11000,54500][0,0]

sa,rpcofqo lue^alo¿ 'ruC eqt ,(q pereprsuoc eq o] sorr?u-aJ6luareglp eql roJ selqeurelle uorsrcep Jo ser8ep¡lsluauaEeueur [Bcr]oq]od,(q Jo uo4enlele pue uo4ducs-ep eW roJ spunor8 eqt epr,lord ot pepuelu sr qcrq^\'a¡nlcn-qs (ae¡ e¡rqcefqo) cruruu,{p u ,{q pe¡oddns pue'sar8ale.gs elqBIIB^e eql Jo secuenbesuoc pue elnqu1leqcse roJ serlllrln pnpplpu¡ 'eer1 enlul eql Jo se¡rrlval-qo eqt IIe roJ slqSre,rr Buru¡ecuoc slndur esrce¡drur uopeseq SuueeuÉue surels.,{s ur sseco¡d srsr(¡eue uorsrceper{l roJ uels,(s uoddns uorsrcep e pedole,rep e^€q ed\

suolsnlruoJ '8

'speJJe neql lunoc3? olul e>l31 ol pesn sI ursruop

lerodurel eql JI elqulcu.B erolu eq illrr\ srue¡qord uorl-ezrunldo oseql leql sel€üsuoruep qc¡Irt\ 'EunIue¡ r(Ee-te4s oql olur lq8rsur Ieuortlppe ure8 o1 ,fi1¡ce¡ srs,(1eue,$r¡r4rsues culerueredlllnu¡ e sepnlcu S SC eql'snq¡

'ser8ele.Ds eqt roJ 1o¡dxoq pednor8,(¡zcr¡el e sluese¡d pq1,ft1dsp e Áq peplu 'ser8e1er1s

elqrssod eruos Surprecsrp JoJ Iryesn eq uec uollelrttoJulsr¡1 'sep]uec¡ed

Wgl pue q]gg 'WgZ eq] puu uorJer^-ep pJepuels 'uueru 'ruruulxeru 'urnurlulur 'epour e>lII'r{8e}e¡ls qcee Jo s8unlue¡ eql lnoqe scllsllels IBJeAesselnduroc ruelsr(s eq1 'suorlelnurs sunJ tr IC eql JI

'senls^ esrceJouo pes€q SunTue¡ 8ur1¡nser eq] puu ,(EepRs qcue JoJ Jol-cerr,fiq4n eql sol?InclsceJ,{¡¡ec4eurolnB pu?,{qcrureqerrrlcefqo luepuedep-oulp eql q pep8udord eq p¡noqsse8ueqc osoql A\oqJo emo se>pl ruels,(s eql'ueq¡ 'uorl

-cunJ ,$IIpn e ro lq8rel\ pezqeuuou e lq8rear lurod-pue uB o1 e8ueqc B e>leru ol ¡¡C eq] s^\olle rIcFIr!\'srs,{1eue,filnrlrsues selu¡od¡ocur ruelsr{s eqt',{¡eurg

'eS Sf ñuI[seuIIBpo1elruurs elrlceJelur 8ur,,(¡dde rege 1eB e,r.,(Ee1u4s eq1

lnq 's : {g,s

' ss

'vs 'ts ' zs ",s} : (o's) /3 ereH

't elqe.L ur ua\oqs erB seplpn rol3e^ eql 'selnqrüp eql

IIe roJ T : "t, pue g'0 : g senIBA eql Surpnord'leporuSurtunocsrpJeuoruodord eqt sosoogc ruC eqUI moN

'uounlos peue¡erd tsotu eW sl uSIorer{/r\ '{.S} : (y'n'S)V fe8 errr ',(¡e,u1c€relur sle^el

lse¿'o'zrv'o)[go¿'o'uog'o]lgeg'o'gvz'o][zeg'o'vzz'o][roo'o'6rg'o]lrrg'o'z6t'o]JolJeA,finpn,ffiep¡S

I - r pIIB 9'0 : q I{lI1Ir lepoultuounocstp-puoqrodord eql JoJ 'g("' (I : ?'?ir sepqpn Jo13e¡

' EIWJ

uorlJqsrps (unurruru oql pue sJoJeruBJBd eqt Sur8uuqc,(q 'zno¡1 '

{nS ' "S

' ,,S } : (y '. 'S)

V tes uorlerurxord-du eql la8 ert 'senlel ¡eleu¡e¡edllneJep qlr,t. ernpecord8ur,r1os-ruelqord eq1 ,(¡dde e^\ JI

'snq¿ 'esn slr e1e4-snlil ol elduruxe Jno ol uorlecllddu reprsuoc eA\ 'srue¡

-qord xe¡duoc ellos ol pedo¡enep ueeq seq qcrq,r.'8ur-leeuue pelulnturs enqcefqorllilu elrlceJeJur uo peseqqcuordde uorJerurxordde eql 8ur,{¡dde ro¡ ser8ele4s Joles llerus ,{¡e¡r u sl sFlt qEnoqt¡g '{rS 'n,S 'vS '

zS 'tS)

: (.'S) ¡t sI les rolce^ luercwe ,{lllpn esrce¡d-uII eql 'snql 'pue

8s¡ setsultllop z^g t3q1 ees e I'g elqeJ ur ue¡rrE e.ru,(Eelu¡]s

rlcee qlr^\ pelelcoss? serlllln Jolce^ eql 'ueql 'Ále p-cedse¡'gt8¿'0 puu I¿06'0 ere t pue T,sporred erurt roJseterlunocsrp eqt ereq^\ 'VZg6'0 = (gO'O + t) ll: drolceJ lunocslp € ol spBel qclq,t\ 'selnql!]? eq] fiB roJo69 : r efwlunocsrp erues eql su8rss¿ WCI oql oreql\'pIIe^ ee ol Iepou Surlunocslp-1u?lsuoc e Sururnssy

' ([grq'o'06r'0] ' [ogg'o'o'86r'0] ' [og¿'o'096'0])

(1) rolcen Ie relul,(1¡11n eqlfqpezun¡c€Juqc sl r,S ,{8epüs 'eldurexe ro¡ 'snq¡

'ses?eJc

-ep ,$upgecun eql JI Jel\oJruu le8 ¡o 'ecuenbesuoc eql

lnoq? r$uregecun ur esseJcur u€ sr oJorDJI'erur1¡o eSes-sed eql qll^\ ropl^\ 1eB ppoc sle^retur ,{lllrJn eq} teq}eloN 'sonlel ecuenbesuoc pue slq8rem ose4q4n esrc-erd neql o1Eurprocc€ pe{uer ere ser8elers eq} oreql\'S 'EId ur uA\orIS su 'poued eu4l rlc?e ur r{Ee1e4s qcue JoJp^Jelq ,$UFn e,illcedser eql setrnduroc ure1s,(s eq¡

's¡uer( eAU sr sporred e rlncesuoc o1Kl qcseuee^\leq I?^JeluI elull oql leql olunsw eA\ eJer.l^r 'ru?eDs

eruoc1no ue s? ue¡.r8 'nS ,(8elers ¡o lcedurr eql sl\oqs

Zalqe¡-'eldurexe uB sV 'sporred erun oolll roJ sruseüseurrroclnoesrce¡du¡reqf ,{qpezlJelc€Jetlc (g (" (I : {'cSser8ele.us xrs e^oqe oql Jeprsuoc ,(1uo em 'pu1ep ut ssec-ord uorlezFulldo eqryo s€epr Bur,(pepun eql ̂{oqs oI

'luepuedep

orur] eJB (¡e sduqred) qcq,r. Jo euros ',{qcrurerq eq}

Jo solrlcolqo lele¡-tset\ol eql qll^\ pelercossu selnqrrn€oql ol lcedse¡ qlrm pezr(I?u€ eq lsnIII so 4eluouv

lI

eS9,9vSg,S

zS1S

9,99,9vSgS

7S1,S

[osg'o's6u 'o]

lrzq'o'tzz'o)lsgro'oslo][rero'sgro]lgrs'o'ownll¿vg'o'tzz'olrolce^ ̂rlpnÁ3arerr5

obg - Jwva

Iepoutrr Su4unocsrp-lrrulsuoc eIil JoJ ¡g("' (I : ?'h sepllpn Jolce¡

€ EIWI

TLSuntrw-uotsnap anqluto-ulnu ntuals(s uoddns uorsrrap Tuapuadap-aup V / 'p p onsul-sol¿ 'S

74 S. Ríos-Insua et al. / A time-dependent decision support systemfor multi-attribute decision-mnking

É,*€id.,Ulilíti¿ü

#lteriiütii¡B,i u . l x

f'^ln ¿\ctionsAut'lrnatic F¡od EancLahe LimingFertiliz¡tionSediment Femor¡al

Alt*rnative* ,0,É$

.4utom¡tic Food Bani,l{u,s,ctinnuSndinrent HemrvalLake LirningFertiliz':ii,rtr

Htri$üfiirrÉ-$.l ü.ü ,, 0.:?5,,; , , ,,ü'f;

Aut,trnali,l F,:,rd B,:naSediment Hemnvall.ln,{ctiunsLahe LimingFertiliEati¡n

as well as the attributes associated with the lowest-levelobjectives of the hierarchy are created in the DSS. Sce-narios need to contain enough technical informationfor them to be realistic, while they should not be sotechnical as not to be understandable. The alternativesmust be analyzed with respect to the attributes associ-ated with the lowest-level objectives of the hierarchy,some of which (maybe all) are time dependent. Next,the DM will have to assess the imprecise utility func-tions, scaling constants and discount factors, if deemedappropriate, which will be used to provide the inputsfor the coffesponding model, associating each strategywith a vector of utility intervals, whose dimension willbe equal to the number of time periods considered, sowe will have only one utility interval for the static case.The application of interactive multiobjective simulatedannealing leads to the determination of the best or, atleast, a small enough set of satisfactory strategies, fromwhich the DM could choose the final strategy more

Time period 1

++i -l t

,Ej,¡S

ü.j.,Í.S

:r,;;:liifiii,r:,:!,;:.i::.$¡iig:.i..,i.:,tdáftr,,,r,,,

'i'ffi

f#

ffi

n::Éü":tt f ¡¡i*r¡i:i:i:ii¡i;i:¡:üt¡ü:Avg: :i

tl"f,ü, ; ,,,,,,, ,,,..,1'.,P.,., :., ,'Hi"i :¡$igtiii .¡.ldgrl.¡.i.¡.i.iii¡.f ll:l.ii ñ,üHki¡

Time period 3

Fig. 5. The utility intervals and the ranked strategies based on their precise utilities for each time period.

easily by changing satisfaction levels or using a mul-tiparamefric sensitivity analysis. This means that theuser can gain additional insight into the ranking of thealternatives. This demonstrates that this kind of opti-mization problems may be more tractable by using thetemporal domain to take into account their effects.

9. List of symbols

S: Set of available strategiesP: Precisionp¿ : Timing weightr¿: Social discount rateb¿: Temporal mid-value for attribute X¿Fo: Preference relation based on the vectorial utility

uer (S, u): Imprecise timestream utility effrcient vec-

tor set

*bL"¡lr:

F.at#i

ü.55Íü..55:tr.51tü.5'1¡

Time period 2

'Lg-W 'OtOt) g;ZquDasay Tououotadglo Trutno¡ uoadotng'uopsuuoJul ep¡durocul qlrat 3u¡1u¡41 uoISIraC :eqe \,

'IN' 0qI-6VI'(ggOt) gI qilDasaü suo4ntadg

lo s1ruuy 'empecor¿ e^ucaJelul uy :relndruoc-oJcrl4l B uo

luerussessv uolpund ,{lupn 'Jeqedrl I prrB qcszIN uo^ 'u

'¿t6 I'sseJd r(1¡sreirru¡ uolecuud' Jol\sqa g Jnuouo Jfl

plm sawog to fuoaq¡'urelsue?ro¡¡1 'O prre rrrrerunaN uol 'f'609-10€'(g6aD

g srs(louy uorsnae oyaty)-lpq p Touno¡ 'I

ICJI I uIpoqFw uoqcund enIBA e ¡llppvJo sseuNnqou 'uea\els 'f'ql

'Eg-W '(OgOt) LquDasa[ suorptadg

puo sta¡nduo3 'eced5 uouell¡ prre uorsrceq ur Suua¡¡.9pue uopuJauáC }tqod las-e.Dul 'srrrul¡ '

A.d ptre renels.'g'U't96I

Tro,\me¡ 1(e¡¡¡¡ uqof (,rtfsitolg

to suo4opunot aqJ'e?erru5 '¡'1'06tiLt'(ZOAD

9 Ktutot-tarun pw 4s!ü {o Ttutno¡

'qcuorddy peseg ecuereJerd V:8u¡¡epotr4i uo$rceq pue,(4n31qury te1¡ut¡¡'U pue urrus'U

'VgE-Iit'(OOOZ) S6 qrtoasaü suouotadg {o sIDuuV

1nollud e trceolpeu Áq pe¡eunueruo3 suelsr$ocg c4enby uoSqqu¡¡ uorsrca( ro¡ rue¡s,(g uoddng uorsrceq V :y¿¡OW'BnsuI-soJU 'S pue soelel4l 'y 'o8e¡1eg 'g 'ensu¡ soIU 'C

' ZVZ-EEZ' dd' i66l'uolsofl

'relrn¡¡¡o'pe 'soIU 'g'sa8ua1¡rq3 plm spuatJ :srs{1ouy uolsnae ptmfuoaq¿ uorsnae :u¡ '3ur¡u14¡ uorsrce( lsnqo¿ m slueu¡ued-xg 'u.oqce¿'C'f pue Bnsul soJU'C 'ensul-solu'S 'soRI 'S' ZEZ- 6lZ' dd' t 66I ASA'spe'Irnd''I'W puu euuldu¡.¡' d' f

' lt!-flqoqot¿ puD sJltsrlzts ur saJtmlpv uaJay ut 'Ktoaq¿ uotstc-ae :ur,$lutrsues pue uorsrcerdrul .,(1¡n3¡qury ?nsul soJll'C

'286I 'ssul tr

'e8puqure3'sser¿ Ál¡srerr-run pJe JBH 'uoyo$o&a¡¡

fo acuang puo uV aqJ 'aIJW¿.'H'Ig-95 '(ggOt)

ZE aruaps luauaBnuo¡4¡'luerussessv ,(tlpn ü ruelqoJd peJJg Á1u¡exeJ eql Jo uon-cnpe¿ :sluelenrnbe ,{re¡1o1 'eIIIAJneN ep 'U prru pJo}I I

'W'ZyI'(1002)

Z9 &atcos lptoasaü

Tououotadg aqt to Touno¡ 'sure1sÁsocg cpunby pel"ulurel

-uo3 Suuolse¿ JoJ lepontr uorsrceq elnqu¡1v-np¡41e ur srs,{-IBuV leurpdopo¿

'o8e¡¡e9 'A prru unsul-soJf, '5 'soep¡¡¡ 'y'60€-10€ '(ZOAD

l sts(Touy uotsnae DuailtJ-ulnryto 1nu-tno¡'íur¿vlN uorsrce(I uue¡r¡crlp¡4¡ crureu,{q'qlnlquJo)'f

'€66I'sserd,fi¡sreir¡u¡ eSpuqure3'sa4tca{qg a1d1x1n¡tt¡ t¡4n uolsoa(I'u,IJIuU 'H puu ,(euee;¡ '1'¿

'LE-EZ'(2002)

ZZprV uorstra(I Duuu)gryW puD srsK1ouy uaudo1arugoxoquo anssl Totcadg'puorcered6 esmbse¿ '¡s1¿ repun suelqoJdelnqulprllnll1¡ e}eJOSr¡1 esrcerdru¡ Suur¡og ro¡ Suneeuuy pe¡e1-ruurs e^rlceJelul 'soelutr

I 'V pus ensq-soJ¿ 'S 'zeu.eturf 'V

'2002' Isre rull

IBcIuqceI pIJpuW 'uopeuessl(I 'q q¿ 'sesrcerdurl seuorceu-3rsy uoc uqsrceq q e upn(y ep Bruelsls un 'zeu-eurrÍ 'V

'90€-I0€'(OgOt) gE qrrDasay Touo4otadg{o Truno¡ uoadotng 'suor¡ucr¡drul

4eqr puu {sIU repun 3ur-{eI I uorsroe( uo s8urpurg lelueuruedxg eulos .,(urgel a'¡

'Eg6jE6 '(Z8Ol) gZ aruans ruauta8n-ltow'suo[t.,ung r$r1p¡ roJ sempecoJd slueussessv uI sBIgJo

seomos'ra{sueoqcs'fa puB reqnerunx'3'g,(eqsre¡¡'3'¡ Ízll'668

-Igg 'G66I) g7 tluoasa¿ suorqondg to scqauaqtvry 'stso)

pue slgeuag emlnd¡o Su4rmocsrq l€uoüJodo.r¿ ',{e,rru¡¡'3

tttl' 09- LV' (Z1SD g7 saco{t a7u7'uop

-?^JesuoJ ,(8reug JoJ lapol/{ Sutlrmocs¡q ¡üoIS V ',(e,rre¡¡ '3

tOtl'0gI-I

I I 'dd '1002 ?ruo¿'VIINA 'g6lI007,l¡¡ttl¡y.l1¿.uode¿

'spe ''[s le e]uory '1'ualsKg WrcW aqt qqlvr sa8anug Torp

-awa¿lo ssauamtca$g aqt{o uo4onlu^g alp o1 sa8o1opoqta¡¡¡slst1ruy ?fiqutpuflW lo uouotrlddy 'pre€repurrq¡ 'tr

1 puu

ensuJ-soDr'g "ugÁzeg f 'soelsl

I'y'zeugurl'y'o8e¡ug'g t0l'986I :elseqclqJ'pooa\roH sIIIg'&l1ouottoy fo sruutu

-atltory atlt ol uortJnpouul uV :fuoaq¿ uotslrae'qcuer¿ 'g tgl

'v661'IBBnuod 'eJqruloJ'I

ICJI^I uo ecueJeJuoJ ¡uuorleruelq qllI'3u1oauuy p4qnury lq uogoznutldg 1o1to¡oulquo) ampaf- qop1n¡4¡ to{ s rus una H'n3un¡¡' g puu ureqs:1.

J :t.$Ti:q lü

0¿6I 'ryoÁ ̂{eN

',(epr1¡ uqol '3ut>¡o¡¡¡ uotncaq rct fuoaql &ntl4¡-'urnqqsrd 'Ja [ql'00€I-€8ZI '(tg0t) 0E arua

-tcg uawaSolmry'spolqpolqlueússessv tbr.tr.n reqnbrug'g¿ tSlz9L-6iL '(900t)

(g)9¡ rluoasa¿ suouondg'unruolnld epurg-suodee¡¡ sn¡d-mS Jo uoqrsodsrq erp JoJ seArFrue{V ¡o srs,(puy ,{tlpnslnqug"Blnl I V'BIf

'f prre rellng'J'f 'spunrupg ¡ .reÁq 'g'1 lVl'gVg-lES'(rcOD €0I quoasay Tououondg to Toutno¡

una dotng'sIepoIN uorsrceq BIJaIIJJ-pInW¡o srs,(1euy,{lprp¡s-ues eql JoJ senbruqca¿ uoqelilms 're,(q '¡ puu ur1 't 'Jelrng 't

[gl'9SI-9€I 'dd'L66I '8e¡re¡-re8u¡rd5 'spe 'snmellu¡[ 'f pIIB

4uordg'f (rrBA\JB) '1¡¡'8ugt¡o¡t¡ uotsnae m s,{tzssg :ur 'aoroq3

I¿¡odrueuelul Sunroddng q senssl'qruerd'S puu uouaq1v'g tZl'899-9€S'(SOOI) 91¡ {rytut1¡4

t{ {.ur1cs71a7'ecloq3 le¡odu¡euelul Jo seuoaql errrld¡rcser¿ur slepol I lunocslq cgoqred,(1¡ teqe¡il'I { puu tqcerqgv'¡r11 ttl

srJueJeJeu

' I g¿€- I 00 Z l¿q,tcefo¡d,(8o¡ouqce¡ pue

ecuercs ¡o ,ft1srur¡¡1 eqt,(q pegoddns se1| reded srq¡

¡ueureBpel¡aoullty

sle el uorlceJsrl€s urnurrur¡41 :?auorterell A+ - I oqt q suoltnlos ¡o 1sr1 :17

uorlurell A+ - t eql q srolce^ Sutlq8rem Jo lsIT : r4Aroleredo 8urre1¡rg :!

Y JOI-ce,r Su4qEre¡r Eursn les uorlerulxorddy : (y 'n 'S)

Vtes uoqerurxorddy :(n'S) V

rotce^ EurlqEre¡¡ :y

tosl

loz)

tszl

ftzl

Ívzl

Itzl

lzzl

Ígzl

fszl

ltzl

lozl

torl

terl

Lul

tqrl

tsrl

lnl

tsrl

SLSunttut-uotsnap anqutto-ulnu nlwa¡sKs itoddns uorslrap Tuapuadap-au! V / 'f) p Dnsul-solü 'S


Recommended