+ All Categories
Home > Documents > i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic...

i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic...

Date post: 06-Oct-2020
Category:
Upload: others
View: 0 times
Download: 0 times
Share this document with a friend
79
AD-Ri45 688 A MATHEMATICAL THEORY OF COMMAND AND CNNTROL STRUCTURES i/l (U) MASSACHUSETTS NNST OF TECH CAMBRIDGE LAB FOR INFORMATION AND D. A H LEVIS 3e AUG 34 LIDS-FR-i393 U CSIFIED FOSR-TR-84- 8 8AFOS R-80-229 F/G 2/ NL ||||| NONElfllf...lfl ll E|hEE|h|h|hEEE EhE|hhEEE|hEEE IIIEEEEEEEEEEE IIIIIIIIo
Transcript
Page 1: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

AD-Ri45 688 A MATHEMATICAL THEORY OF COMMAND AND CNNTROL STRUCTURES i/l(U) MASSACHUSETTS NNST OF TECH CAMBRIDGE LAB FORINFORMATION AND D. A H LEVIS 3e AUG 34 LIDS-FR-i393

U CSIFIED FOSR-TR-84- 8 8AFOS R-80-229 F/G 2/ NL

||||| NONElfllf...lfl llE|hEE|h|h|hEEEEhE|hhEEE|hEEEIIIEEEEEEEEEEEIIIIIIIIo

Page 2: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

Elm~.. - 4

1I61I 10.

l p a .- 1

Page 3: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

:EPORT DOCUMENTAT&ON PAGE

A D-A 145 608 lo RESTR1C',j %qAPK;QA ~3 DSTR!BjTiO% AWA .AB-TY OP REPOR'

- ' DECLASSIFICATON. OWNGRADING SCHEDULE -

i PERFORMING ORGANIZATION REPORT NUMBER(S) S. MONrTORiNG ORGAN.ZATiOl REPORT NUMBER(S)itIDS-."R-1393 AFOFCP r*P. 3 - ,

-a 4tAME OF PERFORMIN4G ORGANIZATION 6b OFFICE SYMBOL 7a. NAME Of MON:TORjNG ORGANIZATION.. assachusetts Institute (ifapplicable)o 3~i~ ~ReeacofTechnolopzy A_______ ________Force__________0___

.DDRESS (City, State, and ZIP Code) 7b. ADDRESS (City. State, and ZIP Code)SLaboratory for Information± and Decisi-oa Directorate of Va-hematical 2 frnto

S-stems, Cambridge ,L '02139 Sziences, AFOSR, Boling AFB Dr' 20332

.AME OF FUN4DING ISPONSOR11NG Bb. OFFICE SYMBOL 9. PROCUREMENT INSTRUIAENT IDENTIFICATION N4UMBER)RGAN"ZTION oIf applicableS-OSR I N11 AP'OSR-80--02'29ADDRESS (City. State, and ZIP Code) 10. SOURCE OF FUNDING NUMBERS3ollng AFB DC 20332 PROGRAM PROJECT ITASKC WORK UNIT

ELEMENT NO. NO. NO. ACCESSION NO.

TITLE (Include ScryClassfication) 6:0F34IA MATHEIMATICAL THEORY 0.' O:1.\DAND COm' ROL STUC'2UR7S

2.p PRSONAL AUTHOR(S)Alekander Hi. Levis

3a. TYPE OF REPORT 13b. TIME COVERED 14. DATE Of REPORT (Year, Ponbh. Day) S, PAGE COUNTFinal FO O /'18

6. SUPPLEMENTARY NOTATION

*COSATI CODES 18 SUBJECT TERMS (Continue an reverse of necessary and identify by block number)FiELD GROUP SUB-.GROUP Conmaiid and control; to-ial conmand a~id control;

communications; distributed estimation; information

ABSTRACT (Continue an reverse if necessaty and identify by block number)Research on C 3system structure and organizational forms, as they relate to tacticalUSAF command and control systems, is described.

II .14SEp 1 9 198 j

DISTRIBUTION i AVAILABILITY OF AS'RACT 21. ABSTRACT SECURITY CL.ASSIFICATION3UNCLASSIFIED,'UNL'MITED 03 SAME AS ROT. 0 OTIC USERS l"LA1-

*NAME OF RESPONS&CL INDIVIDUAL 22b TELED 0I'4E (include Area Code) d2c OFFICE SvMBOLCP- -ra .Woodruff 1, - *'7('7 -17 1~ 7

-ORM 1473.04 MAR 63 APR edition may be used .fltil Cxflawsted SECUR!y CLASS~cCA' O0N Or ?IS PAGEAll ot~er editons aft otmoiete 7

0 o8 9

Page 4: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

/OSR-TR- S iQ839

Report AFOSR-80-0229 LIDS-FR-1393

A MATHEMATICAL THEORY OF COMMAND AND CONTROL STRUCTURES

Alexander H. Levis

Laboratory for Information and Decision SystemsMassachusetts Institute of Technology77 Massachusetts AvenueCambridge, Massachusetts 02139

August 1984

APProved for, " ..

distrbution M

Prepared for •

AIR FORCE OFFICE OF SCIENTIFIC RESEARCHBolling Air Force BaseWashington, D.C. 20332

84 09 7' 39

Page 5: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

A MATHBMATICAL THEORY OF COMMAND AND CONTROL STRUCTURES

SUMMtARY (-C3)- c~rL

The elements of a mathematical theory for the analysis and desi of

organizations are presented. The focus of the research ha been N on

Information processing and decisionmaking organizations supported bysystem. The mathematical framework used In modeling the Individual

decisiodmkers, as well as the organization, Is that of n-dimensional

Information theory. Petri Net representation of the organizational

structure Is used to model the Interactions between organization members as

well as their Interactions with the C~a system. Comparison and evaluation of

alternative organizational forms Is accomplished by considering

organizational performance, Individual workload and the sets of satisficing

decision strategies.

A brief description of research on distributed estimation and on

Information storage and flow In C3 systems Is also Included.

Accession "or

NTIfS -GRA&If jDTIC TAB A ATR F,,7 -Uwinnounced Qju ,tificatioi

ByDi1,tributi on/

Avallabilit/ Codesjkvii axid/or

Dist Special

'I OrleCop

NEWERKKI.K

Page 6: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

TABLE OF CONTENTS

Page

List at Illustrations ..........O...... vii... .........

2.0o C SYSTEM STRUCTURE AND ORGANIZATIONAL FORMS .............. o

2.1 Sumary .... 0............0............ 2

2.2 The Design Problem ... .......................***e*e*e 4

2.3 Infornation.Theoretic Fraevork ................ 6

2.4 Task Model ....................... 8

2.5 Model of the Organization Member .. ............ . ...... o. 12

2.6 Organizational Form ..................... ....... o.... ..... 16

2.7 Analysis of Organizations .............. o#6966080400*..... 23

2.8 Conclusion ........................ 29

3.0 OTHER TASKS .......................... 29

3.1 Decentralized Estimation ...... Se...... ....... 29

3.2 Information Storage and Flow in C3 System ............... 30

3.3 Distributed Decision Problem in Dynamic MissileReassignment Strategies ...... ... ... ..... .. 30

4oO RFERENES 3

Page 7: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

APPENDIX A: PUBLICATIONS ... .......... e......... 33

APPEDIXH B: gDeoentralized Estimation of Linear Gaussian Systemwby David A. Castaffon

APPENDIX C: PTRCCNET: A Software Teatbed for Use in C3 SystemResearob' by Elizabeth R.* Duoot

vi

Page 8: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

VK ~ ~ -Pi VjR -. -17717 T-777 -31 Y'

LIST OF ILLUSTRATIONS

Page

Figure 1. Information structures for organizations ................... 11

Figure 2. The interacting decisionmaker with memory .................. 12

Figure 3. Detailed model of the interacting decisionaker ............ 13

Figure 4. Block diagram representation of three person

figure S. Data-flow representation of three person organization

Figure 6. Model of SAsubsystem with data base access ................ 21

Figure 7. Performance evaluation of an organization .................. 23

Figure 8. Consistency measure Q versus j and v ....................... 28

Vii

Page 9: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

, ..- -o .- - a F ' - - - - J yu1

a I

1. INTRODUCTION

The analysis of generic aspects of Cs systems represents an area of

research that requires the integration of diverse concepts and theories, if

progress is to be made toward the development of a theoretical basis of

their analysis and design.

The technical effort of this project was directed toward generic, long

range. basic, unclassified research. The emphasis was on general

methodological and technical issues, but from the perspective of the unique

needs and requirements of the Air Force. The main research area was 6C

System Structure and Organizational Form's. The goal of this effort was the

development of a mathematical theory for the analysis and desiga of tactical

military organizations supported by C2 systems. The results of this work

are presented at length in this report.

During the period of performance of this project several other tasks

were undertaken in parallel with the first one, each one lasting from one to

two years. Each of these tasks addressed specific aspects of the basic

theoretical problems posed by the presence of Cs systems in a distributed

decisionmaking environment. They include (a) Decentralized Estimation

(D.A. Castafon): (b) Information Storage and Flow in Cs System (E.R.

Duoot): (c) Distributed Decision Problems in Dynamic Missile Reass3gnment

Strategies (M. Athans). Technical papers that present the significant

developments in task (a) and (b) are included in appendices B and C,

respectively.

A list of documents resulting from research carried under this project

is included in Appendix A.

|I

Page 10: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

2.0 Ca SYSTfE 3TIUCTURE AND ORGANIZATIONAL FORMS

2.1 Sumary

Research in this area has been focused on the development of a

mathematical theory for the modeling and analysis of information-processing

and decisionmaking organizations. The specific organizational structures

considered were motivated by tactical Air Force Cs systems, perceived as

support systems for the deoisionmakers.

The first problem addressed was the development of a model of the

deoisioasking process applicable to human docisionmaking in tactical

situations. A model was developed using the analytical framework of n-

dimensional information theory. The interactions with other deoisionmakers

were modeled In terms of sharing situation assessment information and

Issuing or receiving coands that restrict the selection of outputs or

responses.

The theory developed for the single interacting decisionaker was then

extended to teems of docisionmakers forming an organization. There are

three parts to the formultion of the design problem: (a) Analytic

oharacterization of the task the organization is to perform; (b)

Specification of the interactions between organization members and the

environment, i.e., who receives what external inputs and who produces the

organization's outputs: and (c) Specification of the interactions between

organization embers. These inolude the sharing of situation assessment

Information and the issuing and receiving of o eands.

The theory in its current form is applicable to organizations with

aoyolioal information structures, i.e., organizations whose digraphs

depioting information flow do not contain loops. The conventional

workload-perforuanoe plane for the single deocisionuaker has been extended to

n+1 dimensions with the n dimensions corresponding to the workload of each

2

Page 11: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

one of the n members of the organization and the (n+l)st dimension to the

performance measure for the organization. The theoretical development has

been illustrated by designing and evaluating two three-person organizations

assigned to carry an abstracted air defense task.

In the early work, the internal structure of the decisionmaking

systems had been modeled as memoryless. In order to develop more realistic

models in the context of the comand and control process, it became

necessary to introduce memory in the information theoretic framework so that

inputs that are statistically dependent could be considered.

Three types of storage have been modeled: buffer storage, temporary

memory and permanent memory. Since this analysis addressed the processing

of sequential inputs that are dependent on each other, information rates and

the Partition Law for Information Rates were used. Consequently, inputs

were modeled by discrete stationary ergodic sources. The model of permanent

memory was then used to analyze a typical situation for a declsionmaker: the

processing of two distinct tasks in parallel - the dual task problem.

The model of the decisionmaking process contains a set of algorithms in

the situation assessment stage and another set in the response selection

stage. For the early version of the model, the simplifying assumption was

made that the algorithms were deterministic. The theory has since been

extended to include stochastic algorithms. As expected, it was shown that

the presence of non-deterministic algorithms increases the total activity by

increasing the component that corresponds to internally generated

information or noise.

The modeling of preprocessors of various types was also considered. The

objective was to develop an analytical formulation of the problem of

introducing decision aids in an organization. Both deterministic and

stochastic preprocessors have been studied and their effect on workload and

performance has been investigated.

3

1- i 1 Sib'.ii *iiib 11

Page 12: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

b

Finally, an additional task was introduced, namely, the modeling of the

organizations using the Petri Not formalism so that the organizational delay

could be evaluated. A system matrix for synchronous protocols was defined

and an algorithm for calculating delays was implemented and tested on the

two three-person organizations.

A comprehensive review of the approach and the results is presented in

the following sections.

2.2 The Design Problem

In considering organizational structures for teams of decisionmakers, a

designer must address the questions of who receives what information and who

is assigned to make which decisions. The resolution of these questions

specifies the organizational form. The designer's problem is the selection

of a form so that the resulting organization meets its performance

specifications and the individual members are not overloaded, i.e., the task

requirements do not exceed their individual processing limitations.

While the role of the human decisionmakers is central to the design

problem, the latter cannot be decoupled from the consideration of the

information system that supports the organization. Consider, for example, a

tactical military organization supported by a comand, control, and

communications (C') system. Information is collected from many sources,

distributed to appropriate units in the organization for processing, and

used by the commanders and their staff to make decisions. These decisions

are then passed to the units responsible for carrying them out. Thus, a

given organization design implies the existence of a Cs system that supports

it. Conversely, the presence of a Cs system in support of an organization

modifies the latter's operations: it may create operational modes not

foreseen during the organizational design phase. Therefore, if a

quantitative description of the organization design problem is to be

developed, it must take into account not only the organization members, but

4

..... .... * - ~

Page 13: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

also the collection of equipment and procedures that constitute the

organization's Cs system.

In order to develop a quantitative methodology for the analysis and

evaluation of information processing and decisionmaking organizations, it is

necessary that a set of ompatible models be obtained that describe the

organization and its environment. This modeling effort has been divided in

three steps. The first one is the modeling of the tasks the organization is

to execute and the definition of the boundary between the organization and

its environment. The second step is the selection of mathematical models

that describe the members of the organization. The third step is the

modeling of organizational form, i.e., the specification of the information

and decision structures that characterize the organization. This step

includes the specification of the protocols for information exchange and the

modeling of the omunication systems, the data bases, and the decision aids

that the organization uses to perform its tasks.

The methodology itself consists of two main parts. In the first one,

the analysis of the organization, the models are used to describe the

organization in terms of a locus defined on a generalized performance -

workload space. This locus is obtained by computing an index of performance

for the organization and measures of the workload for each individual member

of the organization as functions of the admissible decision strategies used

by the decisionmakers. The second part of the methodology addresses the

question of evaluating organizational designs and comparing alternative

structures.

The analytical framework used for modeling the tasks, the individual

organization members, the C* system, and the organization as a whole is that

of n-dimensional information theory (1]. A brief description of the key

quantities and of the partition law of information E2] is presented in the

next section.

Page 14: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

2.3 Information Theoretic Framework

Information theory was first developed as an application in

oommunication theory [3]. But, as [hinchin [4] showed, it is also a valid

mathematical theory in its own right, and it is useful for applications in

many disciplines, including the modeling of simple human decisionmaking

processes [51 and the analysis of information-processing systems.

There are two quantities of primary interest in information theory. The

first of these is entropy: given a variable x, which is an element of the

alphabet X, and occurs with probability p(x), the entropy of x, HCx), is

defined to be

H) p) log pWx) (2.1)

x

and is measured in bits when the base of the algorithm is two. The other

quantity of interest is average mutual information or transmission: given

two variables x and y, elements of the alphabets X and Y, and given p(x),

p(y). and p(xly) (the conditional probability of x, given the value of y),

the transmission between x and y, T(x:y) is defined to be

T~x:y) * Hlx) - H yx) (2.2)

where

Hylx) ,,- p(y) 2 p(xly) log p(xly) (2.3)

y x

is the conditional uncertainty in the variable x , given full knowledge of

the value of the variable y.

6

Page 15: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

McGill [II generalized this basic two-variable input-output theory to N

dimensions by extending Eq. (2.2):

N

T(x,:x2:...:x 1) N H(x> - H(x1 .,X...,xN) (2.4)

i-I

For the modeling of memory and of sequential inputs which are dependent

on each other, the use of the entropy rate, Hx), which describes the

average entropy of x per unit time, is appropriate:

1

i(x) 0 li HMx(t), x(t+1),...,x(t+m-1)] (2.5)I--

Transmission rates, T(x:y), are defined exactly like transmission, but usingentropy rates in the definition rather than entropies.

The Partition Law of Information [2] is defined for a system with N-1

internal variables, w. through wN_, and an output variable, y, also called

WN. The law states

Ni H(wi) - Tlx:y) + Ty(x:w,w,... wN_ ) + T(w,:w ...:wN_l:y)

+ Hx(ww ,...,Wl,y) (2.6)

and Is easily derived using information theoretic identities. The left-hand

side of (2.6) refers to the total activity of the system, also designated by

0. Each of the quantities on the right-hand side has its own

interpretation. The first term, T(x:y), is called throughput and is

designated Ot. It measures the amount by which the output of the system is

related to the input. The second quantity,

?7

Page 16: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

.. . . .... - X 1 7- -j r. - . .L .... V I 7-Y'. Wil I - " i - . .'

Ty(X:w 1 w,,...w N_1 =T(x:w,w,, ...,w n-,y) - T(x:y) (2.7)

is called blockage and is designated Gb- Blockage may be thought of as the

amount of information in the input to the system that is not included in the

output. The third term, T(wl:ws:...:wNl:y) is called coordination and

designated 0. It is the N-dimensional transmission of the system, i.e.,

the amount by which all of the internal variables in the system constrain

each other. The last term, HL(wawa,... ,wN_,,y), designated by Gn

represents the uncertainty that remains in the system variables when the

input is completely known. This noise should not be construed to be

necessarily undesirable, as it is in communication theory: it may also be

thought of as internally-generated information supplied by the system to

supplement the input and facilitate the decisionmaking process. The

partition law may be abbreviated:

O = Ot + Gb + G0 + 0 n (2.8)

A statement completely analogous to (2.8) can be made about information

rates by substituting entropy rate and transmission rates in (2.6).

2.4 Task Model [6,7]

The organization, perceived as an open system [8], interacts with its

environment: it receives signals or messages in various forms that contain

information relevant to the organization's tasks. These messages must be

identified, analyzed, and transmitted to their appropriate destinations

within the organization. From this perspective, the organization acts as an

information user.

Let the organization receive data from one or more sources external to

it. Every vn units of time on the average, each source n generates symbols,

8

Page 17: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

signals, or messages xni from its associated alphabet X. , with probabilityPnA" i~e.&

pna M p(X nimi) ; x ni. X n i 12,o...i n (2.9)

¥n

Pni" 1 ! n -1,2 .... *NO (2.10)

where y. is the dimension of x n . Therefore, 1/v n is the mean frequency of

symbol generation from source n.

The organization's task is defined as the processing of the input

symbols xn to produce output symbols. This definition implies that the

organization designer knows a priori the set of desired responses Y and,

furthermore, has a function or table L(x n ) that associates a desired

response or a set of desired responses, elements of Y, to each input x n 8

In.

It is assumed that a specific complex task that must be performed can

be modeled by N' sources of data. Rather than considering these sources

separately, one supersource composed of these N' sources is created. The

input symbol x' may be represented by an N'-dimensional vector with each of

the sources represented by a component of this vector, i.e.,

"X 0 (x1 ,xS,...,x) Xa X (2.11)

To determine the probability that symbol x1 is generated, the&J

independence between components must be considered. If all components are

mutually independent, then pj is the product of the probabilities that each

component of Aj takes on its respective value from its associated alphabet:

9

Page 18: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

P n- Pnj (2.12)

If two or more components are probabilistically dependent on each other, but

as a group are mutually independent from all other components of the input

vector, then these dependent components can be treated as one

supercomponent, with a new alphabet. Then a new input vector, x, is

defined, composed of the mutually independent components and these super-

components.

This model of the sources implies synchronization between the

generation of the individual source elements so that they may, in fact, be

treated as one input symbol. Specifically, it is assumed that the mean

interarrival time for each component cn is equal to v. It is also assumed

that the generation of a particular input vector, xjj is independent of the

symbols generated prior to or after it.

The last assumption can be weakened, if the source is a discrete

stationary ergodic one with constant interarrival time v that could be

approximated by a Markov source. Then the information theoretic framework

can be retained (6].

The vector output of the source is partitioned into groups of

components that are assigned to different organization members. The J-th

partition is denoted by xJ and is derived from the corresponding partition

matrix d which has dimension njx N and rank n j i.e.,

xi = -j x. (2.13)

Each column of df has at most one non-zero element. The resulting vectors

xl may have some, all, or no components in comon.

The set of partitioning matrices (X£5 .,**,Xn) shown in Figure 1

10

.... . .. . . . . . t . .. . ..

Page 19: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

specify the components of the input vector received by each member of the

subset of decisionmaker3 that interact directly with the organization's

environment. These assigrments can be time invariant or time varying. In

the latter case, the partition matrix can be expressed as

xi for t a TAW 0 (2.14)

0 for t 4 T

The times at which a decisnionmaker receives inputs for processing can be

obtained either through a deterministic (e.g., periodic) or a stochastic

rule. The question of how to select the set of partition matrices, i.e.,

design the information structure between the environment and the

organization, has been addressed by Stabile [7,9].

ORGANIZATION

a X0

XX

Tr 11 ew 0 *DM 1

...........

• o°7y

Page 20: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

Vw 7*. 79: 1. W.T2. .% % ...

2.5 Model of the Organization Member [10.11.121

The complete realization of the model of the decisionmaker (DM) who is

interacting with other organization members and with the environment is

shown schematically in Figure 2. I lZZ VI

BO.T " - SA IF CIRS so Y

_R d MEMORY-

Figure 2. The Interacting Dectstonmaker with Memory

The DM receives stngais x a X from the environment with interarrival

time c. A string of signals my be stored fitrst in a buffer so that they

can be processed together in the situation assessment (SA) stage. The SA

stage contains algorthms that process the inoming signals to obtain the

assessed situation z. The SA stage may access the memory or internal data

base to obtain a set of. values do * The assessed situation z may be shared

with other organization membersl concurrently, the DM may receive the

supplementary situation assessment z' from other parts of the organization;

the two sets z and z' are ombined in the information fusion (IF) processing

stage to obtain 2. Some of. the data (d I ) from the IF proess way be stored

in memory.

The possibility of. receiving oamands from other organization members

in modeled by the variable v' and a command interpretation (CI) stage of

processing is necessary to ombine the situation assessment I and v1 to

12

Page 21: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

arrive at the choice T of the appropriate strategy to use in the response

selection (RS) stage. The RS stage oontains algorithm that produce outputs

y in response to the situation assessment Z and the command inputs. The RS

stage may access data from or store data in memory [6,13J.

I more detailed description of the decisionmaker model without buffer

or memory is shown in Figure 3. This figure shows the internal structure of

the four processing stages: SA, IF, CI, and RS. The situation assessment

stage consists of a set of U algorithms (deterministic or not) that are

capable of producing some situation assessment z. The choice of algorithms

is achieved through specification of the internal variable u in accordance

with the situation assessment strategy p(u) or p(ulx), if a decision aid

(e.g., a preprocessor) is present. A second internal decision is the

selection of the algorithm in the RS stage according to the response

selection strategy p(TI,v*). The two strategies, when taken together,

constitute the internal decision strategy of the docisionmaker.

z z V

q fh' ,

4 X X IFlz,z,') h---

Figure 3. Detailed Model of the Interacting Decisionmaker

The analytical framework presented in Section 2.3, when applied to the

single interacting deoisionmaker with deterministic algorithms in the SA and

RS staes, yields the four aggregate quantities that characterize the

13

Page 22: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

- - - - --. - - - -- 77,177. .

information processing and deoisionmaking activity within the DH [10,121:

Gt - T(xozl.v':z,y) (2.15)

Gb n H(xz'°v') - Gt (2.16)

Intt l generated information:

Gn =H(u) -111 (v) (2.18)

U

00 1 (P(x)) + a H(p )+ H1(z) + g IF(p(z.z9)) + g C (p(I,vl)

V+ 1 PI'(p(IIv J)) + a R(pj) + H(y)

,1

+ H(z) + H(I) + H() + Tz (x':z) + T(x.zl:v) (2.18)

The expression for Gn shows that it depends on the two internal

strategies p(u) and p(vIZ) even though a command input may exist. This

implies that the command input v' modifies the DNs' internal decision after

p(vII) has been determined.

In the expressions defining the system coordination, pi is the

probability that algorithm f1 has been selected for processing the input x

14

-, .. * q ' ~ - * ' **%~*~

Page 23: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

. . . . . . . . . . . . • . . . . . . . oo

and PJ is the probability that algorithm hj has been selected, i.e., u = i

and V - J. The quantities g. represent the internal coordinations of the

corresponding algorithms and depend on the distribution of their respective

inputs2 the quantities si , aj are the number of internal variables of the

algorithms fi and hj, respectively. Finally, the quantity H is the entropy

of a binary random variable: V

R(p) - - plog2 p - (1 - p)log2 (1-p) (2.19)

Equations (2.15) to (2.18) determine the total activity G of the

decisionmaker according to the partition law of information (2.6). The

activity G can be evaluated alternatively as the sum of the marginal

uncertainties of each system variable. For any given internal decision

strateg;, G and its component parts can be computed.

Since the quantity 0 may be interpreted as the total information

processing activity of the system, it can serve as a measure of the workload

of the organization member in carrying out his decisionmaking task.

The qualitative notion that the rationality of a human decisionmaker is

not perfect, but is bounded (141, has been modeled as a constraint on the

total activity 0:

G - Gt + ab + Gn + 0 - F 0 (2.20)

where vo is the symbol interarrival time and F is the maximum rate of

information processing that characterizes a decisionmaker. This constraint

implies that the deoisionmaker must process his input at a rate that is

least equal to the rate with which they arrive. For a detailed discussion

*of this particular model of bounded rationality, see Boettcher and Levis

[10.

eakening the assumption that the algorithms are deterministic, changes

15

Page 24: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

the numerical values of G. and of the coordination term 0o [151. If memory

is present in the model, then additional terms appear in the expressions for

the coordination rate and for the internally generated information rate

[6,131.

2.6 Organizational Form V

In order to define an organizational structure, the Interactions

between the human decisionmakers that constitute the organization must be

specified. The interactions between D4s and the environment have already

been described in Section 2.4. The internal interactions between DMs

consist of receiving inputs from other D s. sharing situation assessments,

receiving command inputs, and produoing outputs that are either inputs or

omands to other DM's. The detailed specification of the interactions

requires the determination of what information is to be passed among

individual organization members and the precise sequence of processing

events, i.e., the standard operating procedure or communication and

execution protocol of the organization.

Information structures that can be modeled within this analytical

framework are those that represent synchronized, acyclioal information

flows. Since inputs are assumed to arrive at a fixed average rate, the

organization is constrained to produce outputs at the same average rate.

The overall response is made up, in general, of the responses of several

members; therefore, each member is assumed to complete the processing

corresponding to a particular input at the same average rate.

Within this overal rate synchronization, however, processing of a

specific input symbol or vector takes place in an asynchronous manner. If

the requisite inputs for a particular stage of processing are present, then

processing can begin without regard to any other stage, which implies that

concurrent processing is present. For example, as soon as the organization

input arrives and is partitioned through x, processing of x begins to obtain

z. The IF stage must wait, however, until both the z and z' values are

16

Page 25: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

present. Each stage of processing is thus event-driven; a well-defined

sequence of events is therefore an essential element of the model

specification.

Acyclical information structures are those whose directed graphs

representing the flows of information do not contain any cycles or loops.

This restriction is made to avoid deadlock and circulation of messages

within the organization. Deadlock occurs when one DM is waiting for a

message from another in order to proceed with his task, while the second one

is in turn waiting for an input from the first.

The system theoretic representation of the organizational form is

useful for showing the various processing stages or subsystems. For

example, in Figure 4, a three person organization is shown in block diagram

form in which the first and third members send information to the second,

who in turn can issue commands to the other two DMs.

Evaluation of the various information theoretic quantities, including

total activity, can be accomplished readily, using the decomposition

property of the information theoretic framework [2]. However, the

internal information structure of the organization is often ambiguous when

represented in block diagram terms. For example, the requirement that bothZIS and z's be present before the second DH can fuse the information is not

apparent from Figure 4. An alternate representation is needed which shows

explicitly the information structure without compromising the usefulness of

the information theoretic decomposition property.

Petri Nete 161 and the data flow-schema [17,181 have been developed as

models of information flow for systems with asynchronous, concurrent

procesing activities. Three basic elements are used in their structure:

places, transitions, and directed arcs which connect the two. Places andtranstion represent conditions and events, respectively. No event occurs

unles the rquisite conditions are met, but the occurrence of an event

given rise to now conditions. Tokens are used to mark which conditions are

17

Page 26: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

DM' hl

1

DMh

Figure 4. Block diLagram representation of three person organization

in effect, when all input places to (conditions for) a transiLtion contain a

token (ar. satiLsfied), then the event can ocur. which in turn results in

the generation at tokens for output places. Since tokens are carriers of

data, each transition is a processor which generates a result from the input

data and deposits it on an output token whicoh then along a directed arc to

the next stage of processin.

To represent the information theoretic decisionmaking model using the

Petri Net formalim , a simple translation in structure is made: distinct

inputs and outputs of each subsystem are assigned places and the processing

wiLthin a subsystem iLs represented by a transition [19]. Associated with

ech transiti~on is the set of internal variables of the subsystem, exclusive

of the input variables, which are accounted for separately by the input

places. By assming a probabli ty distribution on the organization's

is

' . -a-a " . - , -. 1 " DM ?. "S 2' * " 1,-

Page 27: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

inputs, distributions are also included on the places in the structure.

Therefore, distributions are also present on subsystem variables, and all

information theoretic quantities are well-defined and can be computed as

before.

The organization structure shown in Figure 4, represented as a Petri

Net is shown in Figure 5. In addition to places, transitions, and directed

arcs, the structure contains a new element, the switch. This is a logical

element which direct the flow of tokens. The switch may take values

independently, or the value is determined as a result of the processing by

algorithm B contained in the command input block. Since the structure shown

in Figure 5 is equivalent to the system theoretic structure in Figure 4, the

internal variable definition and all information theoretic quantities remain

unchanged. However, the information structure of the organization is made

explicit in Figure 5.

Once an input X is partitioned, the processing by each DM in his

respective SA stage (algorithms f) begins concurrently and asynchronously.

This is evident from the representation. Note that because of the assumed

synchronization with respect to organization inputs, there can be at most

one data token in any single place. The structure is obviously acyclical

and deadlock in the organization is prevented.

The Petri Net representation leads directly to the representation of

delays in each stage of processing in terms of an array [19]. Each

decisionmaker is represented in the array be a sequence of delays where each

delay represents the time it takes for a message or task to be processed by

a given subsystem of the DH. Each such subsystem appears as a transition in

the Petri Net representation of the DM. The array entry also indicates the

origin of the messages to be processed as well as their destination. The

presence of switches (decisions) is also shown. An algorithm has been

designed for the calculation of delays for any origin-destination pair.

This algorithm is suitable for implementation on microprocessor based

computers.

19%

Page 28: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

Wr' - -1 MT ' - - w I. . . A

DM I h,

DM 2

iT

44IDM3 / a

Figure S. Data-flow representation of three person organization structure.

The Petri Net or data flow framework provides a natural way for

describing in a precise manner the interactions between the DM's and the

data bases and decision aids present in the organization. The presence of

20

Page 29: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

data bases, an integral part of a C' system, requires the introduction of

two additional modeling elements. The first is the query-response process.

The second is the modeling of the data storage devices themselves.

Consider, for example, the situation assessment subsystem shown in Figure 6.

In accordance with the internal strategy u, an algorithm is chosen to

process the input x. However, this algorithm may require parameters (e.g.,

terrain information, meteorological data) or past situation assessments in

order to do the processing. The data base is accessed and queried for this

information through the signal DI. The data from the data base are provided

to the SA subsystem of the DM through Do . The same link, DI, can be used to

update the information in the data base. Clearly, the block diagram

representation is ambiguous; the data flow formalism allows for the

precise modeling of the fact that data are requested only when certain

conditions are met.

900

f, W D

I

I Ux I .. flx) _.._ z.__

i, .._._fu Wx

LSIT_AI QN_ _A$E S...MFTT_$_UB TEM

Figure 6. Model of SA subsystem with data base access

Consider next the effect of a data base containing data that do not

change dur S£ the execution of a task, i.e., the data are fixed. At first

21

Page 30: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

glance, it might seem that the addition of the data base with fixed values

would have no effect on the total information theoretic rate of activity of

the system, i.e.,

H(d 0 -m 1,2,...,M (2.21)

However, the problemn is more complex. For example, if each algorithm fi

accesses Pi parameter values from the data base (in contrast to having these

values fixed within the algorithm itself) then the rates of throughput,

blockage, and noise of the combined system will not be affected, but the

coordination term will have additional activity rate:

U

AGO Ai iHp(ui)) (2.22)

i-i

Since a data base increases the overall activity of the system without

creating any change in its input-output characteristic, one would question

its presence. There are several advantages: (a) reduction in the

information that needs to exist within the algorithms or within the

decisionmaker model, (b) increased flexibility in the use of algorithms and

hence possible reduction in the number of algorithms, and (c) access to

comon data by several organization members. Even though there is increased

coordination activity due to the interaction between the DM! and the data

base, the total activity of the DH may be reduced - the task may be

redesigned to fall within the bounded rationality constraints.

Similar arguments apply to the modeling and design of decision aids.

Preprocessors, a class of decision aids, are assumed to be located between a

source (whether within the organization or external to it) and a

decisiomaker. The basic preprocessor model that has been analyzed [15]

employs a matching algorithm to partition the input alphabet so that the

appropriate decision strategy can be used in the situation assessment stage.

The preprocessor allows the use of internal strategies of the icr. p(ulx) in

place of p(u) in the SA stage. The ability of the preprocessor in reducing

22

< '+ ' ¢ % ;- . .'" . . 'p ,

,.,. - .'.,•. -,>.-... '...-.'..v,,.'%. ,.\-

Page 31: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

the workload of a decisionmaker was found to depend on the input

uncertainty, the decision strategies and the algorithms within the

preprocessor. A preprocessor that can do filtering of input data was shown

to upgrade the performance of a DM with bounded rationality by withholding

irrelevant inputs and, therefore, reducing the input rate to the DM. As a

result. more time became available to the decisionmaker to perform the

relevant tasks.

An approach to modeling the organizational form - the specification of

the structure and of protocols for interaction between DM's and the

supporting ooand, control, and communication system - has been

presented. It is based on an integration of Petri Nets with the information

theoretic framework used in the quantitative modeling of the decisionmaking

process. This framework allows for the explicit representation of a wide

variety of organizational structures.

2.7 Analysis of Organizations

As stated in Section 2.4, it is assumed that the designer knows a

priori the set of desired responses Y to the input set X. Then the

performance of the organization in accomplishing its tasks can be evaluated

using the approach shown in Figure 7.

X ORGANIZATION Y.(Aor B)

Figure 7. Performance evaluation of an organization

23

a..

a-

Page 32: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

-7 4 - - - * -I-.. -

The organization's actual response y can be compared to the desired set Yd

and a cost assigned using a cost function d(y,Y). The expected value of the

cost, obtained by averaging over all possible inputs, can serve as a

performance index, J, for the organization. For example, if the function

d(yY) takes the value of zero when the actual response is one of the

desired ones and unity otherwise, then

J - 9 (d(y,Y)) - p(y 0 Y ) (2.23)

In this case, J represents the probability : the organization making the

wrong decision, i.e., the probability of error. Once the organizational

form is specified, the total processing activity 0 and the value of

organizational performanoe J can be expressed as functions of the internal

decision strategies selected by each decisionmaker. Let an internal

strategy for a given decisionmaker be defined as pure, if both the situation

assessment strategy p(u) and the response selection strategy p(vII) are

pure. i.e.. an algorithm fi is selected with probability one and an

algorithm h is selected also with probability one when the situation

assessed as being 9:

Dk - (p(u-i) - 1 ; p(v-JII-) - 1) (2.24)

for some i, some J, and for each 2 element of the alphabet Z. There are n

possible pure internal strategies,

n - *V (2.25)

where U is the number of f algorithms in the SA stage, V the number of h

algorithm in the RS stage and M the dimension of the set Z. All other

internal strategies are mixed [20] and are obtained as convex combinations

of pure strategies:

24

Page 33: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

D(pk) p PkDk (2.26)

k-1

where the weighting coefficients are probabilities.

Corresponding to each D(pk) is a point in the simplex

n

SPk = . Pk 2 0 Yk (2.27)

k-1

The possible strategies for an individual DM are elements of a closed convex

hyperpolyhodron of dimension n-1 whose vertices are the unit vectors

corresponding to pure strategies.

Because of the possible interactions among organization members, the

value of 0 depends not only on D(p k ) but also on the internal decisions of

the other decisionmakers. A pure organizational strategy is defined as a M-

tuplet of pure strategies, one from each DM:

A, . (Dk , D k, ° '' Dk ) (2.28)

Independent internal decision strategies for each DM, whether pure or mixed,

induce a behavioral strategy [20] for the organization, which can be

expressed as

A- (A 1 5 * 1 [ pk (2.29)s, a,.. *.14 i-i

where Pk is the probability of using pure strategy, Dk. Because each DM is

assumed to select his strategy independently of other DM's° the strategy

25

Page 34: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

space of the organization, So, is determined as the direct sum of the

individual DIK strategy spaces:

so - s"® S... (2.30)

where Si denotes the individual DM strategy space. The dimension of S is

given by

M

s = dim S= (n1-1)

i-I

Thus, the organizational strategies are elements of an s-dimensional closed

convex hyperpolyhedron.

As A ranges over So, the corresponding values of the performance index

J and the activity or workload of each individual organization member can be

computed. In this manner, the set S is mapped into a locus on the 14+1

dimensional performance-workload space, namely the space (J,G,G . .... GM) .

Note that only the internal processing activity of the deoisionmakers is

presented in the locus and not the total activity of the system which

includes the activity of the decision aids, data bases, and other components

of the supporting C2 system. Consequently, the bounded rationality

constraints become hyperplanes in the performance-workload space. Since the

bounded rationality constraint for all DI's depends on v, the admissible

internal decision strategies of each DM will also depend on the tempo of

operations. The unconstrained case can be thought of as the limiting case

when ' C .

The methodology for the analysis of organizational structures allows

for the formulation and solution of two problems: (a) the determination of

the orgaozational strategies that minimize J and (b) the determination of

the set of strategies for which J _ J. The first problem is one of

26

Page 35: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

VEM

optimization while the latter is formulated so as to obtain satisficing

strategies with respect to a performance threshold J. The satisficing

condition also defines a plane in the performance-workload space that is

normal to the J axis and intersects it at J. All points on the locus on or

below this plane which also satisfy the bounded rationality constraint for

each decisionmaker in the organization define the set of satisficing

A decision strategies. Analytical properties of this locus as well as a

computational approach to its efficient construction have been discussed in

[10,11,12].

A qualitative evaluation of an organizational structure can be made by

comparing the performance-workload locus to the space defined by the

satisficing and bounded rationality constraints. In the same manner,

alternative organizational strutures can be compared by considering their

respective loci.

Since individual decisionmaker3s select their own decision strategies

independently of all other organization members, a particular organizational

form can yield a broad range of performance as illustrated by the locus in

the performance-workload space. The designer must assess, therefore, the

likelihood that strategies which lead to satisficing performance will be

selected. A possible measure of this consistency between individually

selected strategies can be obtained by comparing the locus of the

satisficing strategies to the locus of the organization's strategy space So.

Let Ri be the subspaces of organization strategies which are feasible with

respect to the bounded rationality constraint of each DM, i.e.,

R . (A 1'(A) S F' v) (2.31)

and let R contain the strategies that satisfy the performance threshold J:

R - (A i(A) _1) (2.32)

27

Page 36: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

The subspace of satisficing strategies R0 is given by:

9 0 m3f~l, - Ir 3 Nn...0 ) (2.33)

The volume of 10, denoted by V(R0 ) is compared with that of So. V(S0 ), to

determine the measure of consistency. Q. i.e.,

Q - V(R 0 )/V(S 0 (2.34)

The ratio Q in a monotonic function or 3 and v with minimum zero and

maximum one. A null value for Q implies that no combination of strategies

of the individual decisiomkers will satisfy the design specifications,

while unity implies that all organizational strategies are feasible, i±e.

satisfy the bounded rationality constraints and the performance

specifications.

Since Q can be expressed as a function of J and v only, it can be

plotted in the three-dimensional space (QJ.,). A typical plot from a three

DR exaple [12J is shown in Figure 8.

Figure S. Consistency measure Q versus Jand -c

28

Page 37: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

2.8 Conclusion

The goal of this task was the development of the elements of a

mathematical theory for the representation, analysis and evaluation of

organizations. The class of organizations considered were those

characterized by distributed information processing and decisionmaking;

furthermore, the organizations are supported by command, control, and

omomunications systems.

The integration of n-dimensional information theory with the formalism

of Petri lets and the consideration of cognitive limitations in the

decisionmaker s ability to perform his tasks have provided a novel,

integrated approach to the problem. A significant contribution of this work

is that it has led to the analytical formulation of many organizational

design problems that have been considered previously only in an empirical,

dscriptive context.

3.0 OTMER TASKS

3.1 Decentralized Estimation(Dr. D. A. Castalfon)

Estimation problems with fixed estimator structures, namely distributed

estimation problems, were studied by imbedding the estimation in a class of

decentralized decisions problems. These decision problems have special

structures which can be exploited for some linear Gaussian systems to obtain

closed-form solutions for the estimators. In particular, the decision

variables do not affect the evolution of the state variables and, in certain

cases, they do not affect the observations received by other decisionmakers.

Using results from team theory, necessary conditions for optimality of the

estimates are derived. For fully decentralized structures, these conditions

provide a complete closed-form solution of the estimation problem. These

results have been extended to illustrate how the complexity of the local

estimation algorithm depends on the importance of correlation between the

29

Page 38: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

-*-

errors of the various local estimators.

This task was completed In 1981. A technical paper that presents the

significant results of this research effort is included in Appendix B ofthis report.

3.2 Information Storage and Flow in C3 Systems(Ms. 3. R. Duoot)

The research objective of this task was twofold: (a) the development

of adaptive techniques for modifying and reducing the flow of mission-and

engagement-dependent information in a C3 system operating under stress, and

(b) the development of a small expandable software system to support C3

system research. The task was completed in 1982 with the design and

implementation of TZCCBET (Testbed for Evaluating Command and Control

NTorks). The software has been used for studying the interactions between

data and network management strategies and the behavior of the network as

seen by the information user.

The design and implementation of TECCNET are described in a technical

paper included in Appendix C.

3.3 Distributed Decision Problems in Dymanic Missile Reassignemt Strategies(Prof. Michael Athans)

In this task, a class of generic air defense problems involving the

dynamic stochastic assignment of N defense interceptors against H incoming

enemy targets was considered. Key constraints are generated by the

assumption that an illuminating radar must reflect energy from each target

for a specific amount of time so that the interceptor guidance law can look

on the target.

The modeling phase of this research was completed. Equations were

derived that relate one-on-one kill probabilities and other system variables

to the overall probability of destroying all inooming targets. Two

30

Page 39: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

stochastic strategies were developed: the shoot-look-launch strategy and

the shoot-look-reassign strategy (these include the flexibility of lauching

a salvo of interceptors against a target possibly followed by another salvo

after kill assessment). Numerical results for optimal stochastic dynamic

strategies for simple scenarios were obtained.

The analytical results demonstrated, however, that to solve

suocessfully this class of dynamic optimization problems one needs

significant modifications of the available stochastic dynamic programming

theory and algorithm.

4. REFERENCES

[1] W. J. McGill, OMultivariable Information Transmission,' Psychometrika19(2) (1954) 97-116.

[21 R. C. Conant, 'Laws of Information Which Govern Systems', IEEETransactions on Systems, Man, and Cybernetics, SKC-6 (1976) 240-255.

[31 C. E. Shannon and W. Weaver, The Mathematical Theory of ComunicationUniversity of Illinois, Urbana, IL, 1949.

[41 A. I. [hinchin, Mathematical Foundations of Information Theory, Dover,New York, 1957.

[$] T. B. Sheridan and W. R. Ferrel, Man-Machine Systems, MIT Press,Cambridge, MA, 1974.

[61 S. A. Hall and A. H. Levis, 'Information Theoretic Models of Memory inHuman Decisionmaking Models,* in: Proceedings of 6th MIT/ONR Workshopon C$ Systems, LIDS-P-1300, MIT, 1983 and in Proo. of IXth Congress ofthe International Federation of Automatic Control, Pergamon Press,Oxford, England, July 1984.

[7) D. A. Stabile and A. H. Levis, *The Design of Information Structures:Basic Allocation Strategies for Organizations, in: Proc. of 6th MIT/ONRWorkshop on C' Systems, LIDS-P-1313, MIT, 1983; also in Large ScaleSystems, No. 6 (1984).

[8] E. E. Lawler, III and J. G. Rhode, "Information and Control inOrganizations," Goodyear Publishing Co., Pacific Palisades, Ca, 1976.

[91 D. A. Stabile, OThe Design of Information Structures: Basic AllocationStrategies for Organizations,' MIT Laboratory for Information andDecision Systems, SM Thesis LIDS-TH-1098, 1981.

31

Page 40: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

.6- 1 '- Z%

[101 K.L. Boettcher and A. H. Levis, 'Modeling the Interacting Decisionmakerwith Bounded Rationality. IEEE Trans. on Systems, Man, and CyberneticsSMC-12. No. 3, 1982.

[111 K. L. Boettcher and A. H. Levis, fodeling and Analysis of Teams ofInteracting Decisionmakers with Bounded Rationality,0 Automatica,Vol. 19, No. 6, 1983.

[121 A. H. Levis, and K. L. Boettcher, "Decisionmaking Organizations withAcyclical Information Structures,* IEEE Trans. on Systems, Man, andCybernetics, S1C-13, No. 3, 1983.

[131 S. A. Hal, 'lnformation Theoretic Models of Memory and Storage,"MIT, Laboratory for Information and Decision Systems, SM Thesis,LIDS-TH-1232, 1982.

[141 J. G. March, *Bounded Rationality, Ambiguity, and the Engineering ofChoice, Bell Journal of Economics, No. 9, 1978.

[151 G. Chyen, 'Information Theoretic Models of Preprocessors and DecisionAids. MIT Laboratory for Information and Decision Systems, SM Thesis,LIDS-Tl-1377, June 1984.

[171 J. B. Dennis, J. B. Fosseen. and J. P. Linderman, OData Flow Schemas,*in: G. Goos and J. Hartmanis (Eds.), Lecture Notes in Computer Science,Volume 5, International Symposium on Theoretical Programming, Springer-Verlag, Berlin, 1974.

[181 Arvind, V.Kathail, and K. Pingali, 'A Dataflow Architecture with TaggedTokens," MIT Laboratory for Computer Science, Paper No. MIT/LCS-TM-1741982.

[201 0. Owen, Games Theory, Saunders, Philadelphia, 1968.

2

Page 41: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

APPENDIX A

PUBLICATIONS

A.1 Journal Articles

1. K. L. Boettoher and A. H. Levis, HModeling the InteractingDecisionmaker with Bounded Rationality,3 IEEE Trans. on Systems, Man,and Cybernetics, SMC-12, No. 3, May/June 1982.

2. A. H. Levis and K. L. Boettcher, 'Decisionmaking Organizations withAcyolioal Information Structures,' IEEE Trans. on Systems, Man andCybernetics, SMC-13, No. 3. May/June 1983.

3. K. L. Boettoher and A. H. Levis, OModeling and Analysis of Teams ofInteracting Decisionmakers with Bounded Rationality,w Automatica, Vol.19, No. 6, November 1983.

4. D. A. Castanon, wDecentralized Estimation of Linear Gaussian Systems,3

to appear in Large Scale Systems, North-Holland Publishing Co.

S. M. Athans, 'The Expert Team of Experts Approach to Command and Control(C2) Organizations, IEE Control Systems Magazine, Vol. 2, No. 3, Sept.1982, pp. 30-38.

A.2 Refereed Conference Proceedings

(a) K. L. Boettoher and A. H. Levis, 'Modeling the InteractingDecsionmaker with Bounded Rationality,' in

" Proc. 4th MIT/ONR Workshop on Cs Systems, LIDS-R-1159, Vol. IV,MIT, Cambridge, MA, October 1981.

" Control Systems Theory and its Application, Proc. BilateralSeminar on Control Systems, Science Press, Beijing, PRC, April1982.

(b) A. H. Levis and K. L. Boettcher, ODecisionmaking Organizations withAcyclical Information Structures, in

* Proo. Sth MIT/ONR Workshop on Cs Systems, LIDS-R-1267, MIT,Cambridge, HA, December 1982.

* Proc. 21st IEEE Conference on Decision and Control, Orlando, FL,December 1982.

33

Page 42: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

(c) A. H. Levis and K. L. Boettcher, 6On the Design of Information(c)Processing and Decisionmaking Organizations,8 in Optimization of

Systems, J. Lions and A. Bensoussan, Eds., Springer Verlag, Berlin,FRG, December 1982.

(d) S. A. Hall and A. H. Levis, 'Information Theoretic Models of Memory inHuman Decisionmaking Models,' in

0 Proc. 6th MIT/ONR Workshop on C3 Systems, LIDS-R-1354, MIT,Cambridge, MA, December 1983.

0 Proc. IXth Congress of the International Federation of Automatic

Control, Pergamon Press, Oxford, England, July 1984.

(e) D. Tabak and A. H. Levis, 'Petri Net Representation of DecisionModels,' Paper LIDS-P-1386, MIT, Cambridge, MA to appear in

0 Proo. 7th MIT/ONR Workshop on C3 Systems (December 1984).

A.3 Graduate Theses

(a) K. L. Boettcber, OAn Information Theoretic Model of the DecisionMaker,' S.M. Thesis, LIDS-TH-1096, MIT, Cambridge, MA, June 1981.

(b) D. A. Stabile, &The Design of Information Structures: Basic AllocationStrategies for Organizations,* S.M. Thesis, LIDS-TH-1098, MIT,Cambridge, MA, June 1981.

(c) S. A. Hall, 'Information Theoretic Models of Storage and Memory,' S.M.Thesis, LIDS-TH-1232, MIT, Cambridge, MA, August 1982.

(d) G. Chyen, Information Theoretic Models of Preprocessors and DecisionAids,' S.M. Thesis, LIDS-TH-1377, MIT, Cambridge, HA, June 1984.

(e) Y. L. Chow, *Dynamic Missile Reassignment Strategies,' S.M. Thesis,Dept. of EECS, MIT (draft available; final draft in preparation).

34

Page 43: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

...- , ." . . ,ENVI X 2DECENTRALIZED ESTIMATION OF LINEAR GAUSSIAN SYSTEMS*

by

David A. Castanont

ABSTRACT

In this paper, we propose a framework for the design of lineardecentralized estimation schemes based on a team-theoretic approach.We view local estimates as "decisions" which affect the informationreceived by other decision makers. Using results from team theory,we provide necessary conditions for optimality of the estimates. Forfully decentralized structures, these conditions provide a completeclosed-form solution bf the estimation problem. The complexity ofof the resulting estimation algorithms is studied as a function ofthe performance measure, and in the co'btext of some simple examples.

*This work was supported by the Air Force Office of Scientific Research

under Grant No. AFOSR-80-0229.

fThi author is with the Laboratory for Information and Decision Systems,Massachusetts Institute of Technology, Cambridge, MA 02139,

'low - ~ ~ *~* .. . .

Page 44: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

1. INTRODUCTION

A standard problem in estimation theory consists of using a set of

available information about a random variable to obtain an estimate of

its value. When the criterion used in evaluating the estimate is the

conditional variance of the estimate, the best estimator is given

by the conditional mean. However, this formulation assumes that all

of the available information is concentrated at a central location.

In many areas of application, such as Command and Control systems and

meteorology, the acquisition of data is characterized by sensors

which are spatially and temporally distributed. Thus, there are

nontrivial costs associated with the transfer of data to a central

location for the purpose of estimation.

An approach to designing estimation algorithms for these areas

of application is to preprocess some of the data at various local

processing nodes, thereby reduzing the conmunication load on the

system. The result is an estimation scheme with a fixed structure

(often hierarchical), and constraints on the available information

at any one node. Figure 1 depicts a typical estimator structure.

tCOORDINATOR

LOCAL 0 0 0 0 LOCALESTIMATOR 1 "ESTIMATOR N

Figure 1

2

Page 45: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

The structure of Figure 1 has similarities with a decentralized

decision problem. In this paper, we propose to study estimation pro-

blems with fixed estimator structures, hereafter referred to as dis-

tributed estimation problems, by imbedding the estimation in a class

of decentralized decision problems. These decision problems have

special structures which can be exploited for some linear Gaussian

systems to obtain closed-form solutions for the estimators. In part-

icular, the decisions variables do not affect the evolution of the

state variables and, in certain cases, they do not affect the observa-

tions received by other decision makers. This latter case results

in a partially nested decision problem, as defined in Ho and Chu 11].

There has been a significant amount of recent work on the subject

of distributed estimation. The various approaches can be divided into

two classes: The first class consists of methods which use the distri-

buted structure of the problem in such a way as to achieve an overall

estimator whose error corresponds to that of a fully centralized esti-

mator, and thus optimality is achieved. Elegant solutions to some of

these problems are presented in [2], (3], and [4]. The second class of

approaches consists of utilizing a fixed structure, which is simple,

to achieve the best performance possible with this restricted structure.

This approach can seldom achieve the performance of a centralized scheme.

Typical of the results in this case are the papers of Tacker, Sanders and

their colleagues (5], [6J.

In this paper, we follow the spirit of the second approach. Specifi-

cally, we take as given a specific architecture of processing stations,

with prespecified flows of information among them. Given this structure,

and the apriori statistics of the random variables present in the system,

we restrict the data processing to consist of linear strategies of the

available data. It is our purpose to characterize the "best" processing

schemes in terms of an overall performance measure; our estimation problem

will thus become a stochastic team problem, where a number of decision

agents with different information seek to minimize a common goal.

3

Page 46: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

Fixed structure decentralized decision problems have been considered

by a number of authors (7], [8], and [9]. Our approach in this paper

follows very closely the formulation of Barta 19] for linear control of

decentralized stochastic systems. Indeed, most of the results of Section

4 of this paper appear in Barta and Sandell 110].

The paper is organized as follows. Section 2 contains the mathe-

matical formulation of fixed structure linear estimation problems using

a decision theoretic viewpoint. Section 3 presents general necessary

conditions which optimal estimators must statisfy. These conditions are

not very useful due to their complexity. In Section 4, we specialize

the results of Section 3 to a specific structure which corresponds to a

fully decentralized estimation algorithm. This case permits significant

analysis, as was previously done in Barta and Sandell []0). We extend

their results to illustrate how the complexity of the local estimation

algorithm depends on the importance of correlation between the errors of

the various local estimators. Section 5 contains some simple examples

which illustrate the results of Section 4. Section 6 discusses the results

and areas of future research.

2. MATHEMATICAL FORMULATION

Assume that there are N local substations and one coordinator station

in the decentralized estimation systems. Denote the state of the environ-

ment by x(t), an en-valued random process on (O,T] whose evolution is

governed by the stochastic differential equation

dx(t) = A(t)x(t)dt + B(t)dw(t), (2.1)

where w(t) is an Rm - valued standard Wiener process. Each local substation

receives data from local measurements, described by the observation equations

dyi(t) - Ci(t)x(t)dt + Di(t)dvi(t) (2.2)

4

Page 47: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

where vi (t), w(t) are standard, mutually independent Wiener processes, and

yi(t) is an Rmi - valued random process. The matrices A(t), B(t), Ci(t), Di(t)

are assumed continuous an [O,T] for i = 0 .... N. In addition, the matrices

D.(t) are assumed invertible for all i,t.

To each local substation corresponds a decision agent, whose decisionsare denoted by ui (t) in Rpi. The decisions made at each substation depend

only on real-time observations of local data,Oas in equation (2.2), plus

the apriori knowledge about the statistics of the systems. The apriori

knowledge, common to all local substations and the coordinator station, con-

sists of knowledge of the matrices A(t), B(t), Ci(t), Di(t), for i = 0,...N,

t C [O,T], together with the initial distribution of the initial condition

x(O). For the sake of simplicity, we assume that x(O) is a zero-mean, normal

random variable with covariance E(O).

The coordinator station receives the decision outputs of all the local

subsystems, ui (t), i = 1,.. N, in addition to an independent set of measure-

ments y0 (t). The output of the coordinator station is denoted by uo(t), and

it is based on real-time observation of measurements and the prior decisions

of the local substations.

Associated with the estimation structure is a performance index, of the

form

J - E (u(t) - S(t)x(t)T Q(t) (u(t) - S(t)x(t))dt, (2.3)

where u(t) consists of the vector of decisions,

u T t)'- (u T(t),.., t) (2.4)0N

and the superscript T denotes transposition. The matrix Q(t) is assumed

positive semidefinite and continuous for t in 10,T]. With this performance

criterion, the design of a distributed estimation scheme can be reduced to

determining the admissible decision strategies which minimize the quadratic

function J.

5

Page 48: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

The admissible strategies are restricted to be linear maps of the

available information which yield mean-square integrable decision variables.

Specifically, since equation (2.2) implies that the local observations are

corrupted by additive white noise, we assume that, for i =,...n,

tui (t) H(t ' s)d y i (s) (2.5)

where

H. (ts) 0 if s > t, (2.6)

and

Trace Hilt,s)H (t,s)dtds < a. (2.7)"0 0

For the coordinator, we assume that

U 0(t) sof H(t,s)dyo(s) + . K. (t's)u.i (s)dsi =1 01

n+1 Li (t) ui t) (2.8)

i-I.

where Ho Ki satisfy (2.6) and (2.7), while the matrices Lit) are

continuous on (0,T].

The parametrization of the control laws in equations (2.5) to (2.8)

results in admissible strategy spaces which are Hilbert spaces. Specifically,

the admissible strategies for ui , i = 1,...N, are elements of the Hilbert space

of linear operators from L2 U0,T], Rni) to L2 1[0,T], Rpi) with finite trace, iand inner product

1 2 T T T 2*<H , H2> - Trace f H (t,s)H (t,s)dtds = Trace (H1H2). (2.9)

For additional information about Hilbert spaces of operators, thereader should consult Balakrishnan [11]. We will use the symbol H. with-

out its arguments to refer to the linear operator, while Hi (t,s) will be

used to refer to the kernel of the operator.

6

Page 49: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

Z4

The assumption of linear strategies for all decision agents in the

* problem represents a restriction on the class of admissible strategies.

However, the system and observations described by equations (2.1) and (2.2)

result in zero-mean, jointly Gaussian random processes x,y Since" " " YN* ic

the decisions u(t) do not affect the evolution of the state x(t) (this is

a property of estimation problems) for any control law u(t) such that

! E EJT'u(t)J12dt <, (2.10)0V

we can use a version of Fubini's theorem to show

J -f (u(t)-Sl(t) x(t)l)T Qt) (U(t)-S(tlxlt)) dr. (2.11)

Notice that the optimal estimator will minimize the integrand

J1 E{(u(t)S(t)x(t))TQ(t)(u(t)-S(t)x(t))} (2.12)

almost everywhere. In many cases, this will enable us to show that the

true optimal solution belongs to the admissible class of linear strategies.

To conclude this section, we will discuss some relevant examples, and indicate

how they fit in this framework.

Example 1: Centralized estimation

Assume that N - 0, so that the only station present is the coordinator

station. In this case, J corresponds to

1TJa E {(U o(t)-S(t)x(t))TQ(t)( (ot)-S(tx(t))}"

Its minimum among all mean-square integrable uo(t) is achieved at

U0 (t) - S tMR[M (2.13)

where x(t) is the minimum variance estimate of xt , given the prior

observations, which is obtained from a Kalman filter. Hence, the optimal

estimator is linear.

7

Page 50: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

Example 2. Hierarchical Estimation

Let N - 2. Furthermore, let p0 = P1 = P2 = n and

1 0 1S(t) -I Q(t) = 0 .

Assume C(t) U 0.

Then, equation (2.12) yields

Jl = E I (ui(t)-x(t)) T(ui(t)-x(t)

We consider the minimization of J over all mean-square integrable decision.

The last two terms in the sum are minimized by using local Kalman filters at

each local substation. Furthermore, it was established in W..llsky, Castanon et

al [2], that the first term can be minimized absolutely, when the local strate-

gies are Kalman filters, by a strategy of the form (2.8). Hence, the optimal

hierarchical estimator for this problem is in the class of linear estimators.

Example 3. Fully Decentralized Estimation

Assume that there is no coordinator station, so that u (t) a 0 for all t.

In this case,

Jl ME J(U(t) -s M x (t) )T Q (t) (2_(t)-s(t) x(t))l.

For each t, this is a static team problem with jointly Gaussian statistics;.

hence, Radner's theorem [12] implies that the optimal decision strategies are'

linear maps of the available observations, and hence they belong to the linear

class in equations (2.5) to (2.8).

Example 4. Let N - 1, p1 -1, - n, and

8

Page 51: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

Then,

J= { (u(t)-x(t)) T(u(t)-x(t) 4

It is clear that, if n > 1, some form of nonlinear encoding of the infor-

mation y1 will provide a lower value of J than the best linear encoder,

because V is a scalar signal and x is a vector process. In this case, the

optimal decision rules are nonlinear.

In many cases, the optimal estimation strategies will be nonlinear.

Nevertheless, there will be a person-by-person-optimal linear strategy

which will be of interest because of ease of implementation. In the next

Section, we provide necessary conditions which characterize these linear

person-by-person optimal strategies.

3. NECESSARY CONDITIONS

The formulation of Section 2 imbedded the distributed estimation pro-

blem into a team decision problem with a quadratic criterion, where decision

rules are elements of a Hilbert space of linear operators. In this section,

we provide necessary conditions which characterize the estimators resulting

from this approach. The mathematical development of this section follows

closely the development in Barta (9].

In operator notation, equations (2.5) and (2.8) can be written as

u. H(dy), i 1 ,...N (3.1)

Nu 0 Ho dy + (Kiui + Liu') (3.2)0 00 1-1

where L is the linear operator with kernel

Li(ts) - L i(ta(t-s) (3.3)

rurthermore, the quadratic functional (2.4) can be written as

9

Page 52: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

Jif EJ(u(t)-S(t)x(t))TQ(t) (u(t)-S(t)x(t))dt~

=Trace I S*QS~x + QIU - 2QI l * 34

where 1XI7x and 7u are the cVariance operators (11] corresponding to the

random processes x(t) and u(t). Note that the decision operators are

implicit in defining E~t) as a random process.

4 Let's partition u as

U(t) (u t)1 u (t) ... u (t)]T [u (t),U(t)]T (3.5)

Then, can be partitioned

0 0 (3.6)

Furthermore, ;(t) is related to y(t) by

u~t) * HJy~t)(3.7)

=diagfH1 I y(t)

so that

=(diag H i) Idydy (diag H ) (3.8)

Similarly,

- HOdd H -. Hodd H*] +

10

Page 53: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

N

+ i t(K"+L )H H ... (K+L)H iH* (3.9)1 1 1 Idy idy1 1 i ii IdyidyN N

and

H I H*+I {H= Hod H Vlu0 0 0dt0 0 0 i=1 0 d0dy 1 3

+(K +L)H I*dy i H*)

-i %dy "0

N N+ II (K.+L.)H. dH! (K.+Lj) (3.10)i=3.j1i,2 1

A similar partition yields

ux (3.11)

where

NTo x "o H dyox +, (K i+L) iH dyx (3.12)

0 0 1

lax - tiH, dyx'". HN dy Nx (3.12)

Using equations (3.6) - (3.13) in equation (3.4), we can express the functional

J as a deterministic quadratic function of the operators Hi, L., Ki' which are

elements of a linear Hilbert space. We will denote this dependence by

J- J (H, L, K) (3.14)

11

Page 54: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

Since J is a quadratic functional, and the linear operators H, L, K are

elements of Hilbert spaces, we can compute the Frechet differential of J

[131 with respect to variations in the operators. In particular, we will

denote the Frechet differential of J in the direction of each of the com-

ponents of H, K and L. Partition the operators Q, S, according to equations(3.6), as

Q = (Ql(3.14)

S = (3.15)

s1

Then, we can use equations (3.6) - (3.15) to obtain the Frechetdifferentials:

NJ(iirLoJHK 0 2 Trace [ o dydy . QoolKi+Li)Hidyodyi2 Tace oo o d o 1 0°

+ Qo1 H1 -dydy1 Q0 S o0 Io x

~N I*y dIyoNN-

-Q1 S1 yx~~ (3.16)

6 ( I; A 2 Trace Q H dyy HKiLi 1 00 01d 0d

+Q . (K.+L.) H ~ Hd d. + QdydH H 1=1 i 0 do i "? .

H* W

QO SO ~. H? - 0 l~yx HtJK+L) (3.17)dyx1 1o lIy3

12

Page 55: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

6 JHKL ~. =2 Trace (K + V*)QH~~2 00 I OH dyody.

N+" =I (K i+Li) Qoo(K+L) H. 3dyjdy .

ji H 1Id i

1

" Qlo Ho + +Li1 Q0 H0 Idy 0dy i + (K.+i * il~YdiQ0 dy dyNN

oN N+ Q01 ( iK+LJ ). Idy dy + I Q, dYHjo=1 i j= 1 ,djd .

- (Ki+L i ) (QooSo+Qol S) 7dyiX

i ii Si

where Qlo QII' S are theT blocks partition in the corresponding partition

of i(t) - (u,(t),...uN(t))

Using expressions (3.16) - (3.18), we can provide necessary conditics for

optimality of a set of linear maps (HK,L), as follows:

Proposition 3.1 If HiK,L minimize the functional J over the space of

all linear maps,then

(a) 6J (HKL l 0)n 00

6JKi+Li (HK'L K i +Li) =0

.61H (H,K,L, )= 0

13

Page 56: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

for all i=l,...N, and for all admissible K.,L.,H and ii

Proof The proof follows directly from Theorem 1 in Chapter 7 in Luenberger (13],

since the existence of Frechet differentials provides an expression for the

Gateaux differential, which must be zero at a minimum.

Proposition 3.1 can be used, together with the fact that admissible operators

H,K,L are Volterra integral operators, to obtain sets of coupled inteqral

conditions which characterize the optimal solution, in a manner similar to

Wiener-Hopf factorization [14]. We will not do so here, focusing instead

on obtaining the expressions which characterize the optimum in the specific

case of equations (2.2) - (2.3) for the fully decentralized case in the next

section.

4. FULLY DECENTRALIZED ESTIMATION

In the fully decentralized case, the coordinator station is absent.

In terms ox the formulation of section 3, the operators K.,L. and H are

identically zero, as are the weighting matrices So, Qoo' QoC and Q,0 , for all

time t in (0,T]. This causes an extensive simplification in the equations

of Proposition 3.1. Specifically equation (3.18) now becomesN. iij

.iJ(H;i) = Trace H - (QIS I ) iX (4.1)

1 z IL Id 11 1 dy ixJ 1

The equivalent set of integral equations corresponding to equation (4.1)

are

Q HiJ . (ts d (SSds l (Q Sl (t) (t, S) (

4A similar equation can be found in Barta-Sandell [103, where a solution is

found using an innovations approach. We will present a different derivation

of their results in this section.

14

!% ..

Page 57: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

Assume that QII > 0 and is constant in time. This implies that the

cost functional J is strictly convex, so that there is a unique minimum,

which is characterized by the integral equation (4.2). Furthermore, as-

sume, without loss of generality, that all decisions u. are scalar-valued,

that is pi - 1 for all i. A vector-valued decision can be decomposed into

Pi stations with the same information. Hence, the assumption in equation

(2.3) that the v. are mutually independent Wiener processes will be re-

moved at this stage, to allow for this development.

We begin by noting that equation (4.2) is a linear equation driven

by a sum of terms in the right hand side. Hence, by superposition, the

optimal solution R. (t,s) can be written as3

N n (tk s)t 1k=1

#here G k(t,s) minimizes J when S -'kp that is, it has a one in the tk tliti

entry and zero elsewhere. Hence, G. (t,s) solves3M St UydiS' i xdit

jll1il Gtk (ts s) dsI Q (t s) (4.4)L1 1~ f l)1dy dy.(5f)~ 1 x~y

Notice that the form of Q determines the form of the linear system on theticleft side. It is possible to solve for all G. simultaneously, because of

the consistency of the problems (4.4). Let j.k denote the cost function J

when s - 6k• Then,

tk t tk -tc(GI, .. G ) =argmin J (G ) (4.5)

TDefine a global cost J , given by

T(-1,1 . , LG )(4.6)

-lk-l

The cost J is separable in its arguments. Hence, minimization of JT corres-

ponds to solving equation (4.5) for each t,k.

15

Page 58: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

• .

Let's examine closely the nature of the costs J . From equationtk(2.4), J corresponds to

1 k . E I1 T - 6(u M(t)) T Q (u (t) - 6i_ (t))dt (4.7)

where i-t is a vector with all zeroes except a one in the Z'th entry.

Furthermore, minimization of J is accomplished by minimizing

tk TJ, =E (u(t) - x (t))Q(u(t)-_ xk(t)) (4.8)1 - i-Lk - ik

for each t. Let d (t) correspond to the n x N matrixi

ik -I.

representing the decision variables associat.ad with problems J1 k=1.. nin (4.6). Let D(t) be

1i MD MSd N (t)J

Let

(t) - [x (t)

Xc~) (t)]

be an n N x N matrix. Then, a simple calculation establishes that

T T)J= Trace E Q(D(t)-X(t)) T (4.10)

where the i-th column of D(t) is a linear function of the local observation

process yi(t) only.

16

16%

Page 59: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

- |] Z ~ 1U h ~ g '.1 ~ .

This is the same formulation used in Barta-Sandell [10]. We will

state theirmain result without proof, as it applies to systems of the form

(2.2) - (2.4). Before we can do so, we must introduce some notation.

The state process of equation (2.2) is given by

dx(t) - At) x(t)dt + B(t)dw(t) (4.11)

with local observations

dyi(t) = C.(t) x(t)dt + Di(t)dv.(t) (4.12)

where v. (t), w(t) are standard Brownian motions with w(t) independent of1

all vi(s).

Let

AMt) - diag A(t),...A(t)

B(t)dw(t) diag {B(t)dw(t),...B(t)dw(t)}

C(t) diag {C1 (t), .... CnM} (4.13)

then, we have

dX(t) - A(t)X(t)dt +B(t)dw(t) (4.14)

Define also

Jwwlt) . diag [B(t)B TTt,...BlM BT(t) 14.15)

QN 1 ... QNNI

as the enlarged system relevant driving noise intensity.

Similarly, define

17

-

Page 60: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

Jw(t) = (4.16)

QN E DN(t)dvN(t) dv (t)DT(t) QD() T()1l I ...Q N)N tN

as the enlarged system relevant observation noise intensity. With this

notation, the main result of [10) is:

Proposition 4.2 The Decentralized Kalman Filter

The optimal team decision rule for equation (4.10), X(t), satisfies

dXi (t) = A(t) xi (t)dt + K(t) [Iidyi (t) - C(t)Xi (t)] (4.17)

where

1i OT,* .T .T]T is a .. x i dimensioned matrix withj=l ) 2

the identity in its ith'block, and E(t) solves the Ricatti equation

AM 1At +XATF(t) Y, (t) 11 7(t) + 1(4.16)

1(o) .di,,g [o0... 10o.=

l I ... Q .NN]

The estimator of Proposition 4.2 is depicted in Figure 2. The striking

feature of this estimator is that each local agent uses identical esti-

mation systems, of dimension NnxN, differing only in the input used to

drive the systems. However, in many applications, these estimators are

much larger than are necessary. In particular, it is important to note

that it is the presence of Q which creates nontrivial couplings in the

team problem, leading to large-dimension estimators.

ii 18

i 'r.v- %%~

Page 61: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

- ~ J()dr K0

AMt

Gm~t) NJKC + +M foIt) t to

Ni 4:,o X~act)dr+ fE

Figuram

19

Page 62: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

When Q is diagonal, the expresions for Iww(t) and Jw(t) are block-diagonal.

In this case, it can be established that 1(t), as given by equation (4.16)

will also be block-diagonal, and the optimal estimator will decompose into

blocks of much smaller dimension. We formalize this in the following

proposition.

Proposition 4.3 Assume Q is diagonal. Then, the optimal decision rule which

minimizes (4.10) can be synthesized using n-dimensional estimators at each

local station.

The proof follows directly from equations (4.15) and (4.16). In the

next section, we will study some specific examples to illustrate the com-

lexity of the algorithm of Proposition 4.2, and the relation of the off-

diagonal elements of the matrix Q with this complexity.

5. EXAMPLES

In this section, we discuss some examples of fully decentralized esti-

mation problems, indicating their relation with the results of section 4. To

facilitate the understanding of the examples, we will discuss only non-

dynamic Gaussian systems.

Example 1. Let x1,x2 be independent, zero-mean Gaussian random variables

with unit variance. Define the two observation equations

Yl = Xl + v 1 (5.1)

Y2 -x 2 +v 2 (5.2)

where v , v2, xl, x2 are mutually independent, normal, zero-mean random vari-

ables with unit variance.

Assume that there are two local substations. Each substation i has

access to its own measurement yi The performance of the elements is to

be evaluated as

20

Page 63: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

(): T 1/2) Ez C(2 1/2 1 u2 0 1 )x 2 )

" E)(ulxlx)2 + (u2-x) 2 + (ul-xl-x2)(u2-x2) (5.3)

Conditioning on yl inside the expectation of equation (5.3), and differentiating

with respect to uI yields

2u- 2 Z {x l lyl} - 0

Similarly, conditioning on y2 and differentiating with respect to u2 yields

2u 2 - 2E (x21y21 - E {x21Y2 )= 0

Hence,

u M E {xlly l ] (5.4)

3u 2 =1E {x21y2)

in this example, S -[',lJ Ifs S ,O0 it is clear that

U1 -E fxzly 1 (5.5)

u2 -E {x 2 1Y2 1

is the optimal decentralized estimator. Now, let S -(0 0)

Then,

2 22J =E {(ul-x22 + u 2 + (U l-x2)u 2 }

conditioning with respect to yl and differentiating with respect to uI yields

21

Page 64: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

2u1 w 0

Repeating for Y2 and u2 yields

2u2 - E {x21y2) 0

Hence, for S ( Q), the optimal strategy is

U -O1

U2 - 1/2 E {x21y21.

As indicated in Section 4, the solution for S =( is the superpositionof the solutions for S = (1 )and S =(0 1).

I1 1/2]The presence of the off diagonal elements of Q =[ 1/2 1 ] is important increating the nature of the solution. Notice that, in spite of the inde-pendence x,Y 1 and x2 ,y2 , that the optimal estimator for S 0 1 is

not

U 2 0 {x 21Y21J

Example 2

Assume, in example 1, that x1 = x2. Repeating the same logic for obtainingthe optimal solution for S (10 ), we obtain the sufficient conditions

2u1 -5 E {x lll } + E{u 21yl} - 0

(5.5)

2u 2 - 4 E {x2 1y2} + E{ullY 2) - 0

the coupled equations (5.5) can be solved by noting that u1 = ayl, U2 = by2,for some constant a, b. Equation (5.5) becomes

22

Page 65: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

W7 -W pri - 2,-_;W W 1 YA TLT - WIM-W... . . . .

21 - Efx 11y1) + bEfy 2Iyl} - 0(5.6)

2u 2 - 4 E{x 21y2 ) + aE{y 11y2) w 0

Now#

Efy 2jyl -E~x 11yl)

E~yl 1y2) Efx 2Iy2)

so,

a y1 .j - ) E{x 11y1 )

(5.7)b y 2 = 2 -a/2 E{x 21y2 1

Rewriting in terms of contants,

a +- b/4 - 5/4

b + a/4 - 1

so a -16/15 (5.8)

b - 11/15

Equation (5.8) was obtained by solving the simultaneous euqations obtained

from the variational arguments. For differential systems, these equations

will be coupled integral equations which are hard to solve.

Let's establish the solution (5.8) using the decomposition approach of

Section 4. Let S - ) . Then, the performance measure is

J - E{(u -x1)2 + (u -x )u +u 2j

Variational arguments yield

23

Page 66: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

TR -2 E

2u - E{x 1y1]I + Efu 21yl} =

2u 2 - fx 21y2) + E{u11y21 0 (5.9)

which imply a - 7/15 *b = 2/15

By symmetry, the solution for S =( ID ) is

a=-2/15 b=7/15

For S 0 1~ ), the performance measure is

J -Efu x 2+ (u -x )u +2}

- E~u-x 2+ (u -x )u + u 2

which has already been solved, yielding

a=-7/15 b=-2/15]

Summnary all three yields the result for S = as

0 1

a7/15 + 2/15 + 7/15 =16/15I

b 4/15 +?/15 - 1/15

*We will now use proposition 4.2 directly to solve example 2. since x, x 20.* the effective state dimension is 1. Hence, the matrix D in Section 4 has

dimension 2 x 2, with the first column a function of yi, while the second

column is a fucntion of y 2. The overall team cost is given as in (4.10), by

J-Trace [(D - 0~ x) 1/2 1/2 (D-0 (x T

The optimal solution X is characterized by

24

..............

Page 67: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

. o o - .- .o . '

0(x(x T (5.10)

for any D whose first column is a function of y1. and its second column a

function of y2 " Let

X l y l bY2(5.11)

a2y1 b2Y2

Equations (5.10) and (5.11) imply

E alyl-x b 1y2 ) C o)10(.2a 2 y1 a2y2-XK Y

which reduces to

(E Q (y1 E (x 0 Q ( 0 (5.13)a2 b2 0 Y2 0 Y2 0 x 0 Y2

Let's compute the terms in equations (5.13).

{~iy)i21/2) (i 21 (2 1/2)

~ : D (:' 2)-(,$)0)(2112 1 0 1/2/l 2 /

Hence#

'a I b1212-1 '7/15 2/15\

a( 1 )= C1/2 1)(' 1/2) - ( 2/15 7/15/

25

Page 68: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

The solution for S = [2] is thus

U1 W (2 . 7/15 + 2/15) y, = 16/15

u2 - (2 . 2/15 + 7/15) Y2 = 11/15 Y2F

as was established before.

Notice that a diagonal Q would have decoupled the problem by permitting

a trivial inversion of a diagonal matrix, as predicted in proposition 4.3.

6. CONCLUSION

We have presented a framework for the design of distributed estimation

schemes with specific architectures, based cn a decision theoretic approach.

For a fully decentralized architecture, explicit solutions to the estima-

tion problem were described and illustrated with several examples. The

examples illustrate that the complexity of the decentralized estimation

scheme is critically dependent on the importance of the cross-correlation

of errors in the local estimators, which are represented by the off-diagonal

elements of the positive definite matrix Q. Most practical systems will want

to weigh heavily the correlation of local errors. For example, in a dis-

tributed surveillance network, it is important that errors in location or

detection at one local substation be corrected by other substations. In

other words, it is very costly for all substations to err in the same way.

This is reflected in the performance measure by the off-diagonal elements of

Q.

The examples in Section 5 illustrate the high dimensionality required

by the local estimators in order to compensate for correlations in their

errors. It is our conjecture that the dimensionality of the local estimators

is directly related to the number of off-diagonal elemets of Q.

26

Page 69: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

V - - . . S, , . . . i . . . - - - -- -' * - - .- .b . -- ... '- ".. ..

4 IWhen there is a coordinator station present, the results presented in

Section 3 provide necessary conditions for the optimality of the estimation

operators. Unfortunately, the coupling between decisions at the local sub-

stations and the information available to the coordinator makes the analysis

a difficult problem. We expect that, under some simplifying assumptions,

the necessary conditions of Section 3 can lead to a solution, as in Section 4.

Such results have been reported in Willsky, Castanon et al (2] for a simple

class of performance measures.

The formulation of Section 2 can be extended to incorporate communi-

cation restrictions, as well as delays in the transmission of local decisions.

These are areas which will be studied in the future.

I2

Page 70: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

REFERENCES

[1] Y. C. Ho, K. C. Chu, " Equivalence of Information Structure in Staticand Dynamic Team Problems," IEEE Trans. on Auto. Control, Vol., AC-18,1973.

[2] A. S. Willsky, M. Bello, D. Castanon, B. C. Levy, G. Verghese,"Combining and Updating of Local Estimates and Regional Maps AlongSets of One-Dimensional Tracks," to appear in IEEE Trans. on Auto.Control.

[3] J. L. Speyer, "Computation and Transmission Requirements for aDecentralized L Q G Control Problem," IEEE Trans. Auto.Control,Vol. AC-24, No. 2, April 1979..

[4] B. C. Levy, D. A. Castanon, G. C. Verghese, A. S. Willsky, "AScaterring Framework for Decentralized Estimation Problems,"MIT/LIDS paper 1075, March 1981, Submitted to Automatica.

[5] E. C. Tacker and C. W. Sanders, "Decentralized Structures for StateEstimation in Large Scale Systems," Large Scale Systems, Vol. 1,No. 1, February 1980.

[6] C. W. Sanders, E. C. Tacker, T. D. Litton, R. Y. S. Ling, "SpecificStructures for Large Scale Eatimation Algorithms Having InformationExchange," IEEE Trans. Auto Control, AC-23, No. 2, 1978.

[7] C. Y. Chong and M. Athans, "On the Periodic 'oordination of LinearStochastic Systems," Automatica, Vol. 12, July 1976.

[8] D. P. Looze and N.R. Sandell, "Decomposition of Linear DecentralizedStochastic Control Problems," ESL-P-288 Proc. 1977 JACC, San Francisco,California June 1977.

[9] S. M. Barta, On Linear Control of Decentralized Stochastic Systems,Ph.D. Thesis, MIT, July 1978.

(10] S. M. Barta and N. R. Sandell, "Certainty Equivalent Solutions ofQuadratic Team Problems by a Decentralized innovations Approach,"ESL P-799, MIT, Cambridge, MA, February 1978, Submitted to IEEETrans. Auto Control.

[11] A. V. Balakrishnan, Applied Functional Analysis, Springer-Verlag,New York 1976.

(121 R. Radner, "Team Decision Problems," Annals of Mathematical Statistics,Vol. 33, 1962.

[13] D. G. Luenberger, Optimization by Vector Spare Methods, John Wiley,New York, 1968.

28

Page 71: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

1141 H. Van Trees, Detection, Estimation and Modulation Theory, John Wiley,1968.

29

Page 72: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

.. .,APPENDIX C

TECCNET: A Software Teatbed for Use in C3 System Research1

Elizabeth R. Ducot

Laboratory for Information and Decision Systems, Massachusetts Institute ofTechnology, Cambridge, Hassachusetts

Abstract. TECCNET (Testbed for Evaluating Command and Control NETworks)is a small, expandable software system created to support C3 systemresearch. It has been designed to facilitate the modeling and analysis ofthe complex interactions between the distributed command and controlnetwork elements, the algorithms and procedures that characterize theinformation flow networks of which these elements are a part, and theenvironment within which they must function. The TECCNET system provides asoftware laboratory, with a flexible interactive structure, in which basicsystem research functions are performed. These functions include: the on-line description Of the problem of interest and the definition of a model tobe studied, the generation of an appropriate scenario, and theexecution of the desired experiment. A progression of experiments usingTECCNET has been planned to serve a dual purpose. For the near term, thefocus will be on the areas of distributed information network management anddecentralized estimation. This will allow necessary building blocks to becreated, contributing toward the development of an InformationIntermediary that is intended to resolve conflicts between the needs of C3system users and the capabilities of the C3 networks.

INTRODUCTION (at least conceptually) in terms of Itsabi.ity to deliver, at designated points,

The need to provide dynamic limitations on the desired Information so that uponthe flow of information in a Command, arrival, it is timely, accurate, complete,Control, and Communications (C3) system has and easy to use.become increasingly apparent. Indeed, thisneed, coupled with the requirement that the The underlying C3 system problem thatC3 systems operate effectively under a motivated the design of TECCNET isvariety of adverse conditions, has provided extremely complex. The system elementsthe motivation for much of the recent C3 comprising the information flow network aresystem research. TECCNET (Testbed for highly distributed, have diverse physicalEvaluating Command and Control NETworks) characteristics, and are often governed byIs an experimental software laboratory, Ill-defined operational Constraints anddesigned in response to this need In a way procedures. The technologies that affect thethat will support a number of complimentary elements of this system are changingresearch activities. Before describing the rapidly; advances In electronic weaponry,structure and characteristics of TECCNET, it sensors, and computers, for example, combineIs appropriate to summarize the point of with changes in the way information is usedview taken in creating this research support by the commander to increase both the flow-system, of Information In the network and the time

pressures associated with its delivery.In this work, the C3 system is visualized asan Information flow network. This Even under somewhat benign conditions, thedescription encompasses not only the task of supporting this flow of informationCommunications systems that transmit data is a formidable one. However, when theand messages, but also the processing and tactical situation Intensifies, the load onstorage systems that acquire, translate, the system increases substantially, Justmanipulate, and disseminate Information. The when the external stress on the networkPerformance of this network may be described induced by a hostile atmosphere is at its

-I peak. Competition for the same resources to1This work was supported initially by the move, process, store, and displayAir Force office or Scientific Researbh information also intensifies -- frequently(Contract Number AFOSR-80-0229). Support for with disastrous results (i.e., excessivethe continued development of the system has message delays, system and user informationbeen granted by the Office of Naval Research overloads, etc.). Thus, the C3 system,(Contract Number ON/NOOO14-77-C-0532). viewed in terms of how well It provides the

Page 73: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

2-

information support expected by the objectives, a skeleton system wasdecision-maker, is perceived to degrade implemented at MIT beginning in 1981.exactly when it is most important that it Development of the system continues withinoperate well: when battle information is this same framework:flowing and the time available for decisionmaking is short. It follows then that thereis need to modify the information flow to 1) The testbed should be SMALL, with amatch it in real-time to the facilities and controlled plan for expansion, so that itthe time available for processing, will remain a manageable tool for project

research.The research problems formulated from thepreceding statements share a common premise: 2) The software should be structured soin order to develop techniques for that it can operate in a multi-usercontrolling the flow of information environment and meet the needs of users witheffectively in a C3 context, one must be different levels of software and systemable to express and exploit the expertise. Moreover, the system should berelationships between the activities of the interactive iand provide considerable on-lineuser and the conditions of the network. This documentation.premise is evident in research effortsaddressing all levels of the information 3) System interface and support softwareflow system -- the control of the underlying should be developed to facilitate bothcommunication network, the way information modeling and testing activities.is generated and used, and ultimately theinterface between the human users and the 4) Default models and representations ofsystems (Ducot, 1980 and 1982). As a result, the system should be available in order toone of the first goals in the development of reduce the effort required to initiateTECCNET was to encourage the integration, simple experiments.within a common framework, of the relevantideas drawn from diverse research areas 5) The modeling tools created for the(i.e., distributed data base, sensor and TECCNET system should make it easy for thenetwork management, information processing user to represent the asynchronousand presentation, etc.). interact!.ons and complex protocols that are

characteristic of the models and algorithmsAlong with the common premise indicated to be explored.above, a common concern has been expressedover the potential cost (both in terms ofsystem and user resources) of implementing The preceding statements encompass a broadproposed Information flow control schemes, range of system capabilities--capabilitiesHence the second hope in creating the outside those customarily associated withTECCNET system: that, through software for algorithmic and systemexperimentation, a better understanding research. As a result, the final design ofcould be developed of the complex TECCNET and the open-ended plans for itsinteractions between the distributed command development resemble procedures for theand control network elements, the various design of computer operating systemsmodels, algorithms and procedures that (Corbato, Saltzer, and Clingen, 1972) ascharacterize the information flow, the much as they do those applied to the typeneeds of the users of the C3 systems, and simulation system software originallythe environment within which these systems anticipated (Oren, Shub, and Roth, 1980).must function.

This dual nature of the software is apparentUltimately, however, the objective in in the organization of TECCNET, depicted increating TECCNET is to promote the Figure 1. Three basic research functions,development of new models for representing designated 1) the Model Generator, 2) thethe C3 information processes and new Scenario and Input Generator, and 3) theconcepts for dealing with the result,ng Information Network Simulator, are supportedinformation flow. An important goal, within an interactive structure. A brieftherefore, is to provide the type of description of the funtional elementsenvironment that will foster a broad range follows. The reader is referred to aof research activities and will facilitate discussion of the software system (Ducot,the testing of proposed algorithms and 1982) for additional detail and sampleprocedures. In the next section, the design TECCNET interactions.and characteristics of the TECCNET systemare described briefly, followed by adiscussion of the initial plans for Its use The Model Generatoras a research tool.

The Model Generator is the first of TECCNETcomponents. It permits the user to specify

TECCNET: THE SYSTEM IN OUTLINE the modeling environment, and, in some"sense, to build the simulation on-line. A

In order that TECCNET meet the goals view of the C3 Information flow network isoutlined above, a number of design defined by combining models of the localobjectives were established. Based on these processing nodes, constraints on te

Page 74: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

RN V -- - - - - - -WIN - . - . -~3

movement of messages, protocols governing capacity of the links etc., 2) the

the information flow, and the algorithms for association of nodes with particular

managing the network. In general, these processing models and descriptions Ot the

specifications are tightly coupled, bound traffic between them, and 3) the

together by the need for consistency in the representation of the environment. As the

modeling assumptions. Sets of simulation modeling of the information flow network

specifications, along with descriptions of elements becomes more sophisticated,

any built-in assumptions, may be stored in additional inputs representing different

the system as defaults -- defaults which can types of decision variables will be

then be manipulated by the user. developed.

For example, one such set (currently in Inputs are solicited from the user at the

place within TECCNET) permits analysis at terminal in free form. These data are

the level of the nodes and links f3mprising organized into permanent files and are

a store and forward data communication catalogued with descriptive coments that

network. In this case, the queueing model later may be displayed on-line. The files

of the processing elements used is may be shared between users, each of whom is

extremely simple. Processing of data packets given a private working copy that functions

is assumed to take 'zero" time compared to as a data base during his input session.

packet queueing and transmission delays. The Sample sessions, indicating how the data

link buffers at the nodes are not modeled bases are created and manipulated by

explicitly; their capacities are reflected TECCNET, are presented in (Ducot, 1982).

in an effective link capacity that is afraction of the physical limit of the line. Scenario inputs (describing the condition of

Moreover, the transmission and receipt of the information flow network) are

packets are assumed to be perfect processes. distinguished from those that define the

Certain characteristics of the message experiment (such as number of iterations,

traffic (exclusive of volume) also have been convergence criteria, cost function

specified as defaults. For simplicity, data parameters, type Of statistics to be

packets are assumed to have the same average collected, etc.) and are stored separately.

length, and only one conversation may be This distinction is best appreciated by the

active between a pair of nodes at any given user who attempts to combine Ocanned'

time. £ first-ln-first-ut (FIFO) service scenarios and model specifications for use

discipline is used for the treatment of data in multiple experiments. The scenario

packets, with preemptive logic for both the building process may occur in small segments

control packets and acknowledgements having at different TECCNET sessions until a

a higher priority in the system. complete scenario has been obtained and

stored in the system.

The structure ard content of the data

packets are not given for this simple

default model; data comprise background Network Simulator

traffic within the network. Control

messages, on the other hand, require Once a model and scenario of interest have

explicit treatment of both structure and been established, the execution phase of the

content, as these messages are used as experiment can be initiated. Discrete

signals to drive the TECCNET algorithms. An event simulation techniques form the basis

initial network management algorithm (an of the execution software. This Permits the

outgrowth of an original distributed routing integration of many procedure-driven models

scheme developed by Gallager (1977)) which and the represention of asynchronous

utilizes the preceding modeling assumptions, operation of the elements of a distributed

is included as part of this modeling system.

environment.Three types of events are modeled,

A library structure has been developed to designated for purposes of discussion

house modeling specifications and "external", "spontaneous", and "responsive".

algorithmic building blocks. Descriptive External events are derived from the

information is associated with each entry in environment, and refer to situations arising

the library in order that the user may outside the network. These events are not

select among default models and procedures, modeled within the system in detail; they

Additional specifications can be added to are represented only as time-dependent

modify an existing modeling environment, or effects applied to one or more of the

to specify a new one as desired by the user. capabilities of the system elements.

Spontaneous events simulate actions that are

Scenario Generator based solely on internal logic operating atthe nodes of the information flow network.

The Input Generator is the data-intensive Thus, these internal events correspond to

component of the TECCRET System in which the the decoupled actions of a cooperating

user defines the conditions to be simulated. member of a distributed system. These events

For the sample view of the network indicated may take many forms depending on the

above, three steps are required: 1) the modeling environment that has been

specification of the network topology, specified. The most straightforward

Page 75: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

..2 - V-,. _ .. , .- . , , 7 -WT Z - -. -%

spontaneous event is a scheduling event. Wbenever the user message (°Oe5USE::)An example, drawn from the current appears, TECCNET is awaiting input from thedistributed communication algorithm, Is the user. A specially designed command-linecommand from an individual node signalling interpreter monitors the user's entry tothe initialization of a routing/flow control dupdate cycle that will change te flow istinguih the following: 1) signals for

withn te newor. A ligtly ore movement within TECCUET (notion commands),within the network. A slightly me 2) requests for information (help commands)

elaborate form of the scheduling event Is a a) specfic dat n (epons

conditional one, In which some quantity and 3) specific data entries (responses to

(observable at the node) is monitored until system prompts and questions).

a threshold is reached, at which time theevent Is scheduled. Internal cloaks Notion commands allow the transfer between

(synchronized or unsynchronized) are the basic user activities. For example, the

maintained at the nodes to determine the command 'model* places the user in a

activation time for the spontaneous events, position to define his modeling environment.Unlike notion commands, help commands (which

Execution of a spontaneous event may provide on-line documentation and

initiate a sequence of responsive events, clarification) have no positional properties

Communication with other nodes In the system and may be issued without limit at any time.

is required to generate one or more of the When a help command is received by TECCNZT,

events In the sequence. Since responsive the information requested is displayed atevents are triggered only by the receipt of the terminal, at which time the user sayacontinue his session as though no interrupta appropriate control message, they are hdocre. I pcfcqeto a

used to model the various forms of bed occurred. If a specith question ad

cooperative actions among the distributed reet ahed of the he mesioe.

network elements. repeated at the end of the help Message.

The event generator as currently implemented These same help messages can also be used to

Is only partially interactive. The user is provide on-line training for the user. This

on-line while the simulation is running: he requires that an underlying sequence forcmand use be evident during the

may view the results, request that output at intean .u e eses coin the

various levels be displayed or suppressed, interaction. TECCUET messages contain the

and decide whether or not to continue the uggestion of a next logical command at the

experiment. In the future, the user of end of each response; suggestions which may

TCCNET will be permitted a dual role: that be used by the user to guide him through the

of researcher who is observing the system description. As an example, apartial sequence of commands and responses,

experiment, on the one hand, and that of C3 used as an introduction to the system, isInformation network customer who is changing depicted in Figure 2.inputs and requests in real time, on theother. This additional capability isreflected In the presence of an interactive USE OF TECCNETnode in Figure 1.

The preceding presentation of the TECCNETmodeling system has provided a brief

Conversational Interface indication of bow the software has beenstructured to support C3 system research.

The Conversational Interface provides the Since the major goal in the development oflink between the user and the body of the TECCKET is to promote the evolution of newTiCCNET system. Commun caston is approaches to information flow control, theinteractive, with comands and responses plans for using the TECCNET system as aentered and displayed at the user's research tool are of immediate interest. Aterminal. The forms of" the interction can sgiiatpyf satcptdi h

be controlled by the user, and the display expersiments can be structured into

level ('verbose' or 'terse*) may be *et by experimental building blocks; each of which

ht aeording to his familiarity with the contributes a portion of the insight andsystem, experience necessary to proceed to

This Interface software Is basically command successively hilher levels of abstraction in

driven; a feature which gives a user viewing the information flow network.

considerable flexibility In his use of the One of the chief beneficiaries of such ansystem. This is a *user active' style approach is expected to be the effort togenerally preferred by the designers of develop the Information IntermediaryInteractive systems, reflecting the fact (Ducot, 1982) which addresses thethat experienced users can learn to bypass information related interactions at thedetailed explanations and move efficiently highest system level -- the interfacethrough the system. Occassionly however, between the user of the Information and thewhen complex descriptions or order-dependent C3 network itself. The Intent of thisresponses must be solicited from the user, Intermediary is to assist the human user ofthe user active mods Is suppressed by the the C3 system; aiding him to reformulateConversational interface, and a more his requests for information and to changerestrictive question and answer (or "user his use of the information flow network Inpassive') format is employed.

Page 76: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

VMW

a . 5

light of network conditions. In order to that represent the Cost of rejecting flowintroduce notions of flow control for between individual node pairs.information (as opposed to data) into thenetwork, the Intermediary must have access The second of the TECCNET building blocksto a specially developed local status model presumes the existence of both the real-timeof the system; a model that integrates status information (of the type describeddynamic network, data base, and user above) and the distributed algorithm byinformation and requires the flow of which it is communicated. The experimentscontrol information between network being considered as part of this secondelements. In other words, this model must phase (Ozbek, ongoing), represent the firstreflect the interactions between three types attempt in the TECCNET framework toof information management procedures: associate the criteria for generating and1)strategies that induce changes in routing Injecting information into the network withand control of data flow, given network the network parameters themselves.parameters, 2)criteria for modifyingdecisions governing tiA generation and The decision variables are drawn from ainjection of information into the system, formulation of a decentralized estimationgiven these same or related status problem in which explicit use is made of theindicators, and 3)change3 in approaches to fact that communication from sensors toinformation retrieval, given the behavior of estimators is not instaneous. The normalthe network. Incentives to obtain high quality estimates

by transmitting complete informationIn considering candidate approaches on the frequently between nodes, are recognized as

* basis of their compatiblilty and potential being far from optimal. As part of thiscontribution to such a model, three research effort, a number of tradeoffsdesirable features were identified. The dealing with the generation and schedulingfirst Is the feasibility of representing of information reporting can be addressed.proposed technique for detecting flow Of immediate Interest are those describing:conditions and for exerting necessary 1) the frequency of reports (relating rawcontrol, in a way that can be Implemented data reporting frequency, traffic volume,via a distributed algorithm. The second is delay, and the use of sensor information)the ability to formulate the control actions and 2) the quality of reports (frequentand decisions to be exercised at the nodes compressed reports, partially processed atbased on limited local Information. And intermediate nodes, versus the lessthird is the possibility of sharing common frequent receipt of nearly raw data.status information and network parametersamong different types of management With the experience gained in creating thesealgorithms. two building blocks (type 1 and type 2

procedures), It is hoped that the next stageThese characteristics were considered In in the TECCNET utilization plan, thedetermining the first step in the TECCNET incorporation of information retrievalutilization plan; development of a modeling strategies (type 3), may be initiated in thebaseline from which a broad class of not too distant future.techniques for managing the communicationnetwork could be studied. The initialalgorithm included in the TECCNET system is CONCLUSIONSrepresentative of a procedure (type 1) thatinduces changes In data flow given network In the preceding sections, the design, andponditions. This approach (extended from intended use of a new research tool, createdthe original formulation (Gallager, 1977) by especially to support C3 system research,Golestaani (1980)) treats flow control and was presented. The potential contributionsrouting together, leading to a flow control to a variety of ongoing research activitiesalgorithm that is expressed in terms of were considered in the development of thethe following conflicting objectives: to initial version of TECCNET, now operationalreduce congestion in the network while at at MIT. Preliminary experience with the.the same time minimizing the amount of TECCNET software suggests that the designoffered traffic that is rejected by that objectives, outlined at the beginning ofnetwork. A convex optimization problem is this paper, are being met. The interactiveformulated in which short-term average format and modular structure of the systemInformation on network utilization is used appear appropriate to the needs of usersto allocate both maximum data rates for with different levels of software anduser sessions (viewed as source/destination system expertise who will be participatingpairs) and the optimum routes through the in this activity in the future. Thenetwork for information flowing within it modeling tools incorporated in the system(Oallager and Oolestaani, 1980). provide the capability for representing theFrom the point of view of potential asynchronous interactions and complexcontributions to the model required by the protocols Inherent In the models . andInformation Intermediary, the appeal of this algorithms likely to be explored.Initial approach lies in the formulation of Development of the system is continuing.the distributed algorithm, the type of Additional default modeling environmentsmarginal delay Information communicated, will be included to allow the pursuit ofand the structure of priority functions several lines of inquiry in parallel, each

' ' ~ ~ .~' %%~k. ~ \~ ~%B|

Page 77: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

ofwhchIsepete t onriut a Gllge .. ,(177a Aaaaau Daa

different perspective to the overall Routing Algorithm Using Distributed

development of information flow control Computationa', IEEE Trans. a n Communications,teehaiques. It is anticipated that Jan. 1977, pp.73-85.aztensive use of the TECCNET system willlead as a by-product to modifications and Gallager, A.G. and S.J. Golestaani, (1980)Improvements In the system. As these "Flow Control and Routing Algorithms forenhancements are made, it is hoped that the Data Networksg, Proceedings of ICCC'80,scope of the Information flow modeling Atlanta GA, October 1980.activities will continue to broaden.

Golestaani, U.. A Unified Theory of FlowControl and Routing in Data Communication

AEEENCES Networks. PhD Thesis LIDS-TH-963, Laboratoryfor Information and Decision Systems, MIT,

Corbato, F.J., J.H. Seltzer, and C.T. Cambridge, MA January 1980, 92 pages.Clingen, (1972) HMultics--The First SevenYearw, AFIP3 Conference Proceetdings 40, Oren, T.I., C.H. Shub , and P.?. Both,1972, 3JCC* AFIPS Press, M~ontvale (1980) *Simulation with Discrete Models: ANJppP.571-583. State-of-the-Art Viewo, Volume 2.

Proceedings Of 1980 Winter SimulationDuot, R.I. (1980) "Some Thoughts on Conference, Orlando FL, Dec. 1980. 258Information Flow Control in C3 Systems3 pages.Volume 5. Proceedings of the Third MIT/ONKWorkshop on Distributed Information and Ozbek, A. (ongoing) Unpublished memorandaDecision Systems, LIDS-R-1024, Laboratory In preparation for S.M. Thesis, Laboratoryfor Information and Decision Systems, MIT, for Information and Decision Systems, KITCambridge MA, December 1980. (scheduled for completion 1983).

Ducot, E.R. (1982) TECCNET: A Testbed forEvaluating Command and Control HETworks,LID-S-R-1227, Laboratory for Information andDecision Systems, MIT, Cambridge MA, August1982, 63pp.

I1CAO IN~tCItw - SU E(AO

RI? ~ ~ ~ (Ue as Information4 CA~ IIL ~ ~ ~ ~ e -or -- -- -- -- - -- -- -- --

IMI~~~~~~~~~~~aI~~~- aste I165,IshAo ~pw.psosedt(ipetiw/.6tIW Owt

Ae6.h ~ m Ito. igitel a~getit 01PI.ThbeItm esa st

"[?WOW to.LTO Traffic statistica

Fig.~1tn 1o Strutut ofTCC

Page 78: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

'*4*1CCN1T:

Welcome to trio information Flow Network Tootba (ticcITJ.For information on Pow to use the system. type:

help:ollowed by a carriage return. Otherwise, an receiving the-oer cue (.*ustl:: you may type any TICCmIT command.

help

**O+I1CCNEfT:TCCMIT to an Interactive tautbied wfich Is Intended to support

the analysis of a number of Information flow related issues. It Isstructured to provide user support in three areas:

1) the Specification of his model ing environment. selectionof local node models. message protocols and flow controlstrategies. 1program segment:'mel

2) the geneGration of simulation Snout and scanarloa that definethe network / traffic Conditions. (program segment: ascenariolJ

3) the on-line execution of the simulation experiment (programsegment: run').

For information on how to Interact with the TIECCNET system. theInexpert uWear should type: woo

**.;,UsE::

You Converse with TECCUET by entering commands and responses from yourterminal. When the user cue (*.-US9P::) &poers. It is the Indicationthat you may begn typing, To Signal the Computer that you hae completedyewr entry you MUST Strike the carriage return (CUI) key. The computer willnot respond until you din.

The commandi permit you to move freely within the TECCNET system.to exercise the various programs. or to receive explanations andassistance In progrm selection and data preparation. Occasionally.a specific response Is reauired. In these inatancei;. you will bePrompted f rem the terminal before the user cue Is given.

Depressing the OPEAK or ATTN key at *no, time will Interrupt TECCNETmeld return you to a point where yew may again enter commands.The Inexpert user should now type:

commands

The basic commands fee controlling and Interacting with tne VYECCNITsystem are organized Into throw groups:

1) movement within the system:model: to Change moling environmentscenario: to create scenario datarun: to execute the experimentstop: to leave the system

2) en-line documentatien:help: brief description of TICCNITuse: outline of Interaction modeshelp Model, help scenarie. halp run: descriptions of

the TI[CCNET submodelaWO use 40model41us1 scenario, use run: Instructions for their usehelp network. help traffic: description of Input parameters

2) user support:help eror: how to correct errors In typinghelp Comment: how to leave Comments about the system

S - comment: comment mechanismterse: rsquest for brief Interactive reportingverI1se1:1 request for complete Interactive reporting

Fig. 2 Introduction to TECCRfgT: A Tutorial

Page 79: i/l ||||| U CSIFIED NONElfllflfl E|hEE|h|h|hEEE EhE|hhEEE ...INTRODUCTION The analysis of generic aspects of Cs systems represents an area of research that requires the integration

71

F ED

fit.Nt 1 G-84

4, 7

DTIC'I J ill


Recommended