Design Science Research Workshop I-4 Science Research I.pdf · Outputs f Outputs of desi n design...

Conducting Design Science Conducting Design Science Research in IT: Introduction

Vijay K. Vaishnavij y K.

OutlineOutlineOverview of Design Science Research (DSR)Phil hi l G di f DSRPhilosophical Grounding of DSRDSR MethodologyAn Example of DSRAn Example of DSRDesign Science Research versus DesignConclusions

1/12/2011© Vijay K. Vaishnavi

Research related termsResearch related termsResearch: an activity that ycontributes to the understanding of a phenomenonPh t f b h i f Phenomenon: a set of behaviors of some entity(ies) that is found interesting by the researcher or by a

• Overview of DSR• Philosophical G d f DSR interesting by the researcher or by a

research communityUnderstanding: knowledge that allows

d f h b h f

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science prediction of the behavior of some

aspect of the phenomenonDesign Science

Research versus Design• Conclusions


Research related terms (2)Research related terms (2)Research Methods: The set of Research Methods: The set of activities a research community considers appropriate to the production of knowledgeParadigmatic Community: Having

l i s l m t th

• Overview of DSR• Philosophical G d f DSR nearly universal agreement on the

phenomenon of interest and the research methods for investigating

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science r r m f r n g ng

itDesign Science



Research related terms (3)Research related terms (3)Pre-Paradigmatic or Multi-gParadigmatic Research Community: Bound into a nominal community by overlap in sets of phenomena of interest overlap in sets of phenomena of interest and/or overlap in methods of investigation

• Overview of DSR• Philosophical G d f DSR

gInformation Technology/ Computer Science/ Information Systems, Biotechnology Examples of multi

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science Biotechnology – Examples of multi-

paradigmatic communitiesDesign Science



Design related terms D g m

Design: “Inventing things which do not yet g g g yexist” (Gregory, 1966)Design Science: “Organized, rational, and

h ll s st m tic ppr ch t d si n; n t wholly systematic approach to design; not just the utilization of scientific knowledge of artifacts, but design in some sense as a

• Overview of DSR• Philosophical G d f DSR scientific activity itself” (Cross, 2001).

Science of Design: “A federation of sub-disciplines having design as the subject of

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science disciplines having design as the subject of

their cognitive interests” (Cross, 2001).Design Science



Design related terms (2) D g m ( )

D i S i R h L i Design Science Research: Learning through building (Vaishnavi and Kuechler, 2004). “. . . Using design as a vehicle for

ti d i i k l d i creating design science knowledge in an area . . . Contributions of design science research are in the combined novelty and utility of

d if “ (M h d S

• Overview of DSR• Philosophical G d f DSR constructed artifacts “ (March and Storey,

2008).Design Theory (ISDT): A high level

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science D gn ry ( D ) g

description of the functional (design) requirements and the design methods for a class of artifacts (Walls et al.. 1992).

Design Science Research versus Design• Conclusions

class of artifacts (Walls et al.. 1992).


Can design be research?g

SymbolicSymbolic

Mathematics

Statutory Law

Analytic Synthetic

Statutory Law

Painting• Overview of DSR• Philosophical G d f DSR

Product Design

Mechanical Engineering

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science

Real

ChemistryDesign Science


Real

A Conceptual Map of Disciplines [Owen, 1997]


Can design be research?

Channel

Knowledge Building Process

Knowledge WorksParadigm

Channel


Knowledge Using Process

A General Model for Generatingand Accumulating Knowledge [Owen 1997]

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science and Accumulating Knowledge [Owen, 1997]Design Science Research versus Design• Conclusions


Knowledge Building Process

Can design be research?

Channel

Knowledge WorksParadigm

“Knowledge is generated and accumulated

ChannelKnowledge Using Process

Knowledge is generated and accumulated through action. Doing something and judging the results is the general model . . . the process is shown as a

l i hi h k l d i d


g pcycle in which knowledge is used to create works, and works are evaluated to build knowledge.The channels in the diagram of the general

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science The channels in the diagram of the general

model are the “systems of conventions and rules under which the discipline operates."

They embody the measures and values that have been empirically developed as “ways of knowing”


been empirically developed as ways of knowing as the discipline has matured.”

[Owen, 1997]1/12/2011© Vijay K. Vaishnavi

“Schools of architecture, business, education law and medicine are all education, law, and medicine, are all centrally concerned with the process of design…. However, in this century n tur l sci nc s lm st dr v ut th natural sciences almost drove out the design from professional school curricula in all professions, including business, with exceptions for management science, computer science, and chemical engineering --


sc ence, and chem cal eng neer ng an activity that peaked two or three decades after the Second World War ” [Simon 1996]

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science War. [Simon, 1996]. Design Science Research versus Design• Conclusions


“. . . The professional schools will reassume their . . . responsibilities just t th d th t th dis to the degree that they can discover a science of design, a body of intellectually tough, analytic, partly ntellectually tough, analyt c, partly formalizable, partly empirical teachable doctrine about the design

“ [Si 1996]

• Overview of DSR• Philosophical G d f DSR process . . . “ [Simon, 1996]Grounding of DSR• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions


Simon’s distinction between “natural sciences” and “sciences of the artificial”

“A natural science is a body of knowledge about some class of things

sc ences and sc ences of the art f c al

g g-- objects or phenomenon -- in the world (nature or society) that describes and explains how they describes and explains how they behave and interact with each other.

A science of the artificial, on the other • Overview of DSR• Philosophical G d f DSR

,hand, is a body of knowledge about artificial (man made) objects and phenomena designed to meet certain

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science phenomena designed to meet certain

desired goals.”Design Science



Simon’s framing of the Sciences of the Artificial

An inner environment, an outer environment, and the interface between the two that meets certain desired goals meets certain desired goals Outer Environment: the total set of external forces and effects that act on the artifact the artifact Inner Environment: the set of components that make up the artifact and their

l h h f h

• Overview of DSR• Philosophical G d f DSR relationships – the organization – of the

artifact Design Activity: the bringing-to-be of an

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science D gn y r ng ng f n

artifact, components and their organization, which interfaces in a desired manner with its outer environment


manner w th ts outer env ronment


Design science research framework (b d Si ’ k)(based on Simon’s work)

Apply/Deploy

RELE

RI

Knowledge Base(Inner

Design Practice/Research

Environment(Outer

Environment)

E

Knowledge Needs &Constraints

(Inner Environment)

Research(Interface)

Environment)VANC

GOR

E

Add/Contribute (Adapted from Hevner et al [2004])


Add/Contribute (Adapted from Hevner et al. [2004])

D ig i h f kDesign science research framework

Knowledge Base D i S iEnvironment

Needs/Knowledge

Foundations:•Theories Develop/Build:

People:•Roles

Knowledge Base(Inner

Environment)

Design Science Research

(Outer Environment)

Constraints

Contribute Deploy

•Theories•Frameworks•Instruments•Constructs•Models

p•Theories•Artifacts

Assess Refine

•Roles•Capabilities•Characteristics

Organizations:•Models•Instantiations

Methodologies:D t A l i T h i

Justify/Evaluate:•Analytical•Case Study

Organizations:•Strategies•Structure & Culture•Processes

•Data Analysis Techniques•Formalisms•Measures•Validation Criteria

y•Experimental•Field Study•Simulation

Technology:•Infrastructure•Applications•Communications Architecture•Development Capabilities

(Hevner et al. [2004])


Knowledge Flows

Process Steps

LogicalFormalism

Awareness of Problem

Suggestion Abduction

Circumscription

Development

Evaluation

Deduction

*Operational and


Conclusion

*Operational and Goal Knowledge Principles

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science

Reasoning in the Design Science Research Cycle (based on [Takeda, 1991] )

*Operational Principle: Any technique or frame of reference about a class of artifacts or its characteristics that facilitates

ti i l ti d difi ti f tif t l f


creation, manipulation and modification of artifactual forms [Dasgupta, 1996; Purao, 2002]


Outputs f desi n science researchOutputs of design science research

Output Description1 Constructs The conceptual vocabulary of a

domaindomain2 Models A set of propositions or statements

expressing relationships between constructs

• Overview of DSR• Philosophical G d f DSR constructs

3 Methods A set of steps used to perform a task – how-to knowledge

I i i Th i li i f

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science 4 Instantiations The operationalization of constructs,

models and methods.5 Better Artifact construction as analogous to


theories experimental natural science1/12/2011© Vijay K. Vaishnavi

Outputs of design science research

Emergent Theory about

E b dd d Ph

ConstructsBetter Theories

ModelsEmbedded Phenomena

K l d

Abstraction ModelsMethodsKnowledge as

OperationalPrinciples

MethodsConstructs

Better TheoriesAbstraction• Overview of DSR• Philosophical G d f DSR

Artifact as Situated

Implementation

AbstractionInstantiations

MethodsConstructs

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science ImplementationDesign Science Research versus Design• Conclusions


Example of community determined utputsoutputs

Outputs determined by:Phase of researchLevel of abstraction

Infl n d bInfluenced byCommunity performing research• Overview of

DSR• Philosophical G d f DSRGrounding of DSR• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions


Artifact: Construction of a data

Example of community determined outputs

rt fact n truct n f a ata visualization interface for complex queries against large relational databasesProblem Awareness: Need for an interface for quick and effective answers to questions about answers to questions about performance of business operationsResearch communities: Database

• Overview of DSR• Philosophical G d f DSR Research communities: Database,

Software Engineering, Decision Sciences, Information System Cognitive Researchers

Grounding of DSR• DSR Methodology• An Example of DSR • Design Science Cognitive ResearchersDesign Science Research versus Design• Conclusions


Research motivation and theoretical


Research motivation and theoretical impetus:

Software Engineering, Database:New knowledge of faster access techniques of visual rendering techniques

Decision Sciences, HCI, Cognitive Decision Sciences, HCI, Cognitive Research

New research in reference disciplines on visual impacts on cognition and/or on

• Overview of DSR• Philosophical G d f DSR visual impacts on cognition and/or on

decision-makingGrounding of DSR• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions



Community Perspective Knowledge Derived

HCI; IS CORE;

Artifact as experimental

What database visualization interfaces reveal about the cognition of complex dataCORE;

Decision science

experimental apparatus

about the cognition of complex data relationships

Database; Artifact as Principles for the construction of dataDatabase; Decision science Software

Artifact as focused design principle

Principles for the construction of data visualization interfaces

engineeringp pexploration

Database; Software

Artifact as improved

A better data visualization interface for relational, business oriented databases.Software

engineering improved instance of tool.

relational, business oriented databases.

Design Science Research Perspectives and Outputs byDesign Science Research Perspectives and Outputs by Community


Philosophical grounding of design science research

Ontology is the study that describes the gy ynature of reality: for example, what is real and what is not, what is fundamental and what is derivative? Epistemology is the study that explores the nature of knowledge: for example, on what does knowledge depend and how can

• Overview of DSR• Philosophical Grounding of DSR what does knowledge depend and how can

we be certain of what we know? Axiology is the study of values: what values does an individual or group hold and

DSR• DSR Methodology• An Example of DSR • Design Science values does an individual or group hold and

why? Design Science



Research PerspectiveBasic Belief Positivist Interpretive Design

Philosophical grounding of design science research

Ontology A single reality. Knowable,

b bili i

Multiple realities, socially constructed

Multiple, contextually situated alternative world-states. Socio-

h l i ll bl dprobabilistic technologically enabled

Epistemology Objective; dispassionate. Detached

Subjective, i.e. values and knowledge emerge from the

Knowing through making: objectively constrained construction within aDetached

observer of truth

emerge from the researcher-participant interaction.

construction within a context. Iterative circumscription reveals meaning.

Methodology Observation; quantitative, statistical

Participation; qualitative. Hermeneutical, di l i l

Developmental. Measure artifactual impacts on the composite system.

dialectical.

Axiology: what is of value

Truth: universal and beautiful;

Understanding: situated and description

Control; creation; progress (i.e. improvement); understandingvalue beautiful;

predictiondescription understanding


Design science research gmethodology

Knowledge Process Outputs


Proposal

Knowledge Flows

Process Steps

Outputs

Problem

Suggestion Tentative design

• Overview of DSR• Philosophical Grounding of DSR

Development Artifact

Circumscription• DSR Methodology• An Example of DSR • Design Science

Evaluation

Conclusion

Operation and Goal Knowledge

Performance measures

Results



Awareness of problem

Design science research methodology

Awareness of problemReference disciplineNew developments in industryNew developments in industryReadings in allied discipline

SuggestionNovel configuration of existing or new elementsEssentially a creative step


Essentially a creative step• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions



DevelopmentTentative design implementedImplementation technique depends on the artifact

An algorithm require formal description and An algorithm require formal description and possibly implementation• Overview of DSR

• Philosophical Grounding of DSR• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions



EvaluationContains an analytic sub-phase; h th d b t th b h i hypotheses made about the behavior of the artifactRarely, initial hypotheses completely y, yp mp yborne out

Results in additional information, fed back to another round of problem awareness and

• Overview of DSR• Philosophical Grounding of DSR to another round of problem awareness and

suggestion• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions


Conclusion


ConclusionFinale of a specific research effortTypically result of “satisficing”Typically result of satisficing

Results adjudged “good enough”; still deviations from the (multiply) revised hypothetical predictionshypothetical predictions

Research written up; knowledge gained classified as “firm” or “loose” –n m l us b h vi th t n ds


anomalous behavior that needs further research

• DSR Methodology• An Example of DSR • Design Science Design Science Research versus Design• Conclusions


An example of design science researchresearch

Awareness of problempDevelopment of a computerized decision support system for nuclear reactorsreactorsPilot development in Prolog

Problem insight: How to construct and


continuously maintain a supports system for the operation of a complex, hierarchical, procedure-driven environment

• DSR Methodology• An Example of DSR •Design Science Research versus Research versus Design• Conclusions


Suggestion

Example of design science research

SuggestionPotential solution approaches were explored which resulted in new insights into the problemp m

Insight: system complexity resulted primarily in the control of the system

Need to effectively model complex y pcontrol structures

Insight: Control information was knowledge and could be modeled using rules but

d d d l f h l f


executed independently from the rules for domain procedure knowledgeUse concepts from semantic data modeling

• DSR Methodology• An Example of DSR •Design Science Research versus

Use object-orientation to partition system knowledge



Awareness of Problem Redoux


Awareness of Problem RedouxAny of the earlier research phases may be spontaneously revisited p yBy the inception of the development stage, the problem statement had changed to:changed to:

“how to effectively model operations support systems for complex,

• Overview of DSR• Philosophical Grounding of DSR pp y p

hierarchical, procedure driven environments”



D l t


DevelopmentDevelopment was not straightforwardConstruction was conceptual involved Construction was conceptual, involved the “discovery” of details of the novel artifact – “smart objects”

lWhat would the syntax be for the two types of rules, domain and control?Should the two types of knowledge be

i d i f h


permitted to interact? If so, how?• DSR Methodology• An Example of DSR •Design Science Research versus Research versus Design• Conclusions


Evaluation


Evaluation-Informal “micro-evaluations” took place continuouslyp y

Each design decision followed by a thought experiment

Various operating environments were modeled and “hand stepped” through rule modeled and hand-stepped through rule execution to verify correct behavior

Grocery bagging “robot”Modeling of portions of the nuclear reactor

• Overview of DSR• Philosophical Grounding of DSR Modeling of portions of the nuclear reactor

operationsResulted in minor redesign of the artifact – the smart object conceptual model

• DSR Methodology• An Example of DSR •Design Science Research versus j pResearch versus Design• Conclusions


Conclusion


ConclusionSuccessful defense of a doctoral dissertationThree conference papersPublished in IEEE Trans. Knowledge

d D t E i i ft th and Data Engineering after three revisions

By the time of acceptance, smart objects


had gone through several additional design science research cycles



Desi n science research vs desi nDesign science research vs. designResearch distinguished by the production of interesting (to a research community) new interesting (to a research community) new knowledgeDistinguished by the intellectual risk,

b f k hi h h number of unknowns, which when successfully surmounted provides new information of value to the community


Most product design efforts preceded by meetings to “engineer the risk out of” the design effort

• DSR Methodology• An Example of DSR • Design Science Research versus gResearch versus Design• Conclusions


Design and design science research process

K l d P O t t


Proposal

Knowledge Flows

Process Steps

Outputs

Problem

Suggestion

Ci i ti

Tentative design• Overview of DSR• Philosophical Grounding of DSR

Development Artifact

Circumscription• DSR Methodology• An Example of DSR • Design Science Research versus

Evaluation

Conclusion

Operation and Goal Knowledge

Performance measures

Results


1/12/2011

Results

© Vijay K. Vaishnavi

Awareness of problem

Design ResearchReference

Design (IT)Interaction Reference

disciplineNew d l i

Interaction with clientsBusiness developments in

industryReadings in

Business analysisNew

• Overview of DSR• Philosophical Grounding of DSR Readings in

allied disciplinesNew developments in industry

• DSR Methodology• An Example of DSR • Design Science Research versus

yRequirements Analysis



Suggestion

Design Research

DesignResearchLiterature search

Domain analysisP li i Reuse of

existing knowledge

Preliminary designR f

• Overview of DSR• Philosophical Grounding of DSR knowledge

Case studiesReuse of existing elements

• DSR Methodology• An Example of DSR • Design Science Research versus elements

Test suiteResearch versus Design• Conclusions


DevelopmentDesign Research

Novel configuration

DesignDevelopment configuration

of existing or new elementsNature of

penvironment identifiedInitial Nature of

development depends on the artifact

Initial prototypeIterative


An algorithm requires formal description and possibly

addition of functionality

• DSR Methodology• An Example of DSR • Design Science Research versus possibly

implementationResearch versus Design• Conclusions


EvaluationDesign Research

Contains an analytic sub-

DesignExercising

ana yt c uphase; hypotheses made about the behavior of the artifact

test suite Bug fixing

Can lead artifactRarely, initial hypotheses completely borne

Can lead to visiting earlier

• Overview of DSR• Philosophical Grounding of DSR p y

outResults in additional information, fed

phasesField testing

• DSR Methodology• An Example of DSR • Design Science Research versus information, fed

back to another round of problem awareness and suggestion


gg


ConclusionDesign Research

Finale of a specific research

DesignFinale of a specific p c f c r arch

effortTypically result of “satisficing”R h itt

pdevelopment effort

Manuals and reports Research written

up; knowledge gained classified as “firm” or

reports Client satisfaction or market success

• Overview of DSR• Philosophical Grounding of DSR as firm or

“loose” –anomalous behavior that needs further

determines the degree of successIdeally should

• DSR Methodology• An Example of DSR • Design Science Research versus needs further

researchIdeally should result in learning and improvement



Concluding remarksConcluding remarks

Design science research needs to be conducted and taught in all professional disciplines –engineering, business, law, medicine, g g, , , ,information technology, …Certain phases – problem awareness, evaluation – can and should borrow well developed

s h m th ds (p siti ist i t p ti )


research methods (positivist, interpretive)Creativity important part of such research but the research can benefit from guidance through research patterns

• Design Science Research versus Design• DSR Methodology• An Example of through research patterns

General design cycle, a research framework, for research in professional disciplines

An Example of DSR • Conclusions


Date post:	30-Oct-2019
Category:	Documents
Upload:	others
View:	1 times
Download:	0 times

Design Science Research Workshop I-4 Science Research I.pdf · Outputs f Outputs of desi n design...

Documents