+ All Categories
Home > Documents > Understanding user differences in open-source workflow management system usage intentions

Understanding user differences in open-source workflow management system usage intentions

Date post: 04-Sep-2016
Category:
Upload: jan-recker
View: 217 times
Download: 1 times
Share this document with a friend
13
Understanding user differences in open-source workflow management system usage intentions Jan Recker a,n , Marcello La Rosa a,b a Queensland University of Technology, 126 Margaret Street, Brisbane, QLD 4000, Australia b NICTA Queensland Lab, Australia article info Article history: Received 20 September 2011 Received in revised form 6 October 2011 Accepted 6 October 2011 Recommended by: D. Shasha Available online 17 October 2011 Keywords: Information systems usage intentions Group differences Motivation Open-source system Workflow Survey research abstract Open-source software systems have become a viable alternative to proprietary systems. We collected data on the usage of an open-source workflow management system developed by a university research group, and examined this data with a focus on how three different user cohorts – students, academics and industry professionals – develop behavioral intentions to use the system. Building upon a framework of motivational components, we examined the group differences in extrinsic versus intrinsic motiva- tions on continued usage intentions. Our study provides a detailed understanding of the use of open-source workflow management systems in different user communities. Moreover, it discusses implications for the provision of workflow management systems, the user-specific management of open-source systems and the development of services in the wider user community. & 2011 Elsevier Ltd. All rights reserved. 1. Introduction Over the last decade, the open source software (OSS) phenomenon has revolutionized the way in which organiza- tions and individuals create, distribute, acquire and use information systems and services, making it an increasingly important topic for information systems researchers. Many aspects have been investigated in this vein of research, including participation in open-source development [29], business models [10], community ideology [34], motivation [6] and governance [33]. In this paper, we aim to contribute to this current and relevant body of knowledge by studying the behavioral factors that lead to individuals’ acceptance of an open-source workflow management system. To the best of our knowledge, this is the first time that the acceptance of an open-source workflow management system is analyzed. Also, our study is the first that explicitly examines differences in acceptance behaviors across three different user cohorts. Specifically, we consider the YAWL system [39] as an example of open-source workflow management system. Two reasons underpin this choice. First, the YAWL system represents a state-of-the-art open-source workflow man- agement system that is developed based on a solid ground- ing in research. Also, not only has it enjoyed uptake in industry practice, but it has also generated a significant impact in academia [36]. Second, the system is supported by a wide and diversified user community that includes three distinct user cohorts: student users, academic users and professional users. This is because the YAWL system is an OSS system that aims to address three different purposes: (i) to serve as a platform upon which researchers can prototype cutting-edge workflow technology; (ii) to educate students on business process modeling and automation; and (iii) to generate industry uptake. In this respect, the YAWL system shares some com- monalities with the open-source operating system GNU/ Linux (whose distributions are used both in educational Contents lists available at SciVerse ScienceDirect journal homepage: www.elsevier.com/locate/infosys Information Systems 0306-4379/$ - see front matter & 2011 Elsevier Ltd. All rights reserved. doi:10.1016/j.is.2011.10.002 n Corresponding author. Tel.: þ61 7 3138 9479; fax þ61 7 3138 9390. E-mail addresses: [email protected] (J. Recker), [email protected] (M. La Rosa). Information Systems 37 (2012) 200–212
Transcript
Page 1: Understanding user differences in open-source workflow management system usage intentions

Contents lists available at SciVerse ScienceDirect

Information Systems

Information Systems 37 (2012) 200–212

0306-43

doi:10.1

n Corr

E-m

m.laros

journal homepage: www.elsevier.com/locate/infosys

Understanding user differences in open-source workflowmanagement system usage intentions

Jan Recker a,n, Marcello La Rosa a,b

a Queensland University of Technology, 126 Margaret Street, Brisbane, QLD 4000, Australiab NICTA Queensland Lab, Australia

a r t i c l e i n f o

Article history:

Received 20 September 2011

Received in revised form

6 October 2011

Accepted 6 October 2011

Recommended by: D. Shashabehavioral intentions to use the system. Building upon a framework of motivational

Available online 17 October 2011

Keywords:

Information systems usage intentions

Group differences

Motivation

Open-source system

Workflow

Survey research

79/$ - see front matter & 2011 Elsevier Ltd. A

016/j.is.2011.10.002

esponding author. Tel.: þ61 7 3138 9479; fax

ail addresses: [email protected] (J. Recker),

[email protected] (M. La Rosa).

a b s t r a c t

Open-source software systems have become a viable alternative to proprietary systems.

We collected data on the usage of an open-source workflow management system

developed by a university research group, and examined this data with a focus on how

three different user cohorts – students, academics and industry professionals – develop

components, we examined the group differences in extrinsic versus intrinsic motiva-

tions on continued usage intentions. Our study provides a detailed understanding of the

use of open-source workflow management systems in different user communities.

Moreover, it discusses implications for the provision of workflow management systems,

the user-specific management of open-source systems and the development of services

in the wider user community.

& 2011 Elsevier Ltd. All rights reserved.

1. Introduction

Over the last decade, the open source software (OSS)phenomenon has revolutionized the way in which organiza-tions and individuals create, distribute, acquire and useinformation systems and services, making it an increasinglyimportant topic for information systems researchers. Manyaspects have been investigated in this vein of research,including participation in open-source development [29],business models [10], community ideology [34], motivation[6] and governance [33]. In this paper, we aim to contributeto this current and relevant body of knowledge by studyingthe behavioral factors that lead to individuals’ acceptance ofan open-source workflow management system. To the bestof our knowledge, this is the first time that the acceptance ofan open-source workflow management system is analyzed.Also, our study is the first that explicitly examines differencesin acceptance behaviors across three different user cohorts.

ll rights reserved.

þ61 7 3138 9390.

Specifically, we consider the YAWL system [39] as anexample of open-source workflow management system.Two reasons underpin this choice. First, the YAWL systemrepresents a state-of-the-art open-source workflow man-agement system that is developed based on a solid ground-ing in research. Also, not only has it enjoyed uptake inindustry practice, but it has also generated a significantimpact in academia [36]. Second, the system is supported bya wide and diversified user community that includes threedistinct user cohorts: student users, academic users andprofessional users. This is because the YAWL system is anOSS system that aims to address three different purposes:

(i)

to serve as a platform upon which researchers canprototype cutting-edge workflow technology;

(ii)

to educate students on business process modelingand automation; and

(iii)

to generate industry uptake.

In this respect, the YAWL system shares some com-monalities with the open-source operating system GNU/Linux (whose distributions are used both in educational

Page 2: Understanding user differences in open-source workflow management system usage intentions

J. Recker, M. La Rosa / Information Systems 37 (2012) 200–212 201

institutions to teach software and operating systems aswell as in commercial environments), but differs from themajority of other OSS products (e.g. Mozilla Firefox) thattarget general users and do not necessarily have an educa-tional purpose.

In this paper, we seek to examine differences in thebehavioral motivations to accept the YAWL system acrossits three different user cohorts. Knowing how different usercohorts perceive OSS software and how these perceptionsaffect their individual usage decisions is important because ithelps managers in charge of software acquisitions to designmore effective implementation strategies and offers guidancefor personalized management interventions. This knowledgeis also important for providers of OSS software solutions andrelated services for developing effective personalized market-ing strategies. Further, the open-source workflow manage-ment system YAWL that we are examining is different fromtraditional information systems in that it explicitly catersto different user cohorts instead of being purpose-built for aparticular cohort like many other systems (e.g., DSS fordecision makers, EIS for executives, TPS for operational staff).Systems that are built for a variety of users face importantchallenges in acceptance and usage behaviors because differ-ent stakeholders typically have multiple and often conflictingobjectives and priorities and rarely agree on a set of commonaims [31,51]. Correspondingly, in our paper we set out toanswer the following two research questions:

(1)

Which factors contribute to explaining individuals’acceptance of an open-source workflow managementsystem?

(2)

How do these factors differ across three user cohortsof an open-source workflow management system,viz., student, academic and professional users?

We proceed as follows. First, we review the literature ondeterminants of the behavioral intentions to use open-source systems and introduce the specific research contextof our study by providing relevant background to the YAWLinitiative. Then, we describe our research model anddevelop a set of hypotheses about the expected differencesacross the three user cohorts considered. Next, we describedesign and conduct of our empirical study to test the modeland the hypotheses. We discuss the results and identifyimportant implications for theory and practice beforeconcluding the paper with a review of contributions andlimitations.

2. Prior research

2.1. Determinants of the behavioral intentions to use

open-source systems

Much research has examined different motivatingfactors that lead to an individual’s intentions to use aninformation system. Venkatesh et al. [43,45] summarizethese studies. Importantly, research has shown that bothintrinsic motivators such as hedonistic motives (e.g., [17])or enjoyment [41] as well as extrinsic motivators suchas outcome value expectancies (e.g., [50]), perceptions of

usefulness [12] or social motives [46] are important motiva-tions for the behavioral intentions to use an informationsystem. The strength of these intentions, furthermore, is alsoknown to be dependent on people’s perceived control overusing the system [42], which is influenced by the technolo-gical and resource support facilities available to assist withthe use of an information system.

Much of the knowledge on technology acceptance anduse holds for both proprietary software and open-sourcesoftware systems. Still, with the emergence of OSS as analternative paradigm to propriety software, there areseveral key attributes that differentiate open-source soft-ware from proprietary systems:

Many OSS software development efforts are providednon-for profit [4].

Many OSS software products are provided at theexpense of limited end user support, uncertain bugfixing and upgrades, and negative network externalityeffects that typically favor the diffusion of proprietarysolutions [7].

The quality of service provided by an OSS softwareproduct can vary greatly [14].

OSS usage can be strongly influenced by one’s socio-cognitive perception of the related open-source usercommunity [3].

OSS software products are often associated withgreater affordances of flexibility than proprietary solu-tions [16], mostly due to the unconstrained access tosource code, free modifications, and the potential toreuse the code in other software [9].

Still, the usage of OSS is dependent on behavioral factorsnot dissimilar to those of other systems, such as proprietary

utilitarian or hedonic technologies. For instance, we alsoknow that in the open-source context evaluations of useful-ness and ease of use are key to understanding usagebehavior [43]. The prominent theories of reasoned actionand behavioral control specifically show that motivationalas well as control beliefs add to our understanding of howand why users accept and continuously use technologysystems. Still, there are certain peculiarities about OSSusage. For instance, some researchers have found that OSSusers are motivated by specific extrinsic factors relating tofuture rewards such as career opportunities, knowledgegains, reputation and status [20,22], and that these factorscan sometimes dominate utilitarian beliefs such as useful-ness, expected performance gains or ease of use. Otherstudies have also shown that intrinsic motivations such asself-determination, hedonic interest or even fun add to ourunderstanding of OSS use [18,20,52]. Other studies haveshown how social factors pertaining to the OSS community[3] or ideology [34] affect people’s usage behaviors.

Before the background of these findings, our interest inthis study is to advance an integrative model explaining theintentions to use an open-source workflow managementsystem that is based on an amalgamation of existing theories,and to examine this model across different user cohortsrelevant to the particular system in focus. To that end, wewill now detail the background of the open-source workflowmanagement system under consideration, YAWL.

Page 3: Understanding user differences in open-source workflow management system usage intentions

FacilitatingConditions

PerceivedBehavioral

Control

Intention toContinue to Use

Motivation toHelp Others

IntrinsicMotivation

PerceivedProvider Image

J. Recker, M. La Rosa / Information Systems 37 (2012) 200–212202

2.2. The YAWL system

The YAWL system is one of the most mature open-source workflow management systems available at present.The system has counted more than 100,000 downloadsfrom its main host site (SourceForge), with an average ofalmost 20,000 unique visitors in the last two years [1].YAWL has been used as a teching tool in more than 30universities across 16 countries, while several companiesfrom various business sectors such as utilities, healthcare,public defense and automotive industry, use the YAWLsystem or variants thereof for commercial purposes.1 Assuch, the YAWL community is not limited only to anacademic cohort, but also stretches into higher educationsectors as well as commercial industry sectors.

The development of the YAWL system started in theform of a proof-of-concept prototype in 2002, to demon-strate that it was possible to realize a workflow systemthat could offer comprehensive support for the so-calledWorkflow Patterns [40]. These patterns describe recurrentcontrol-flow structures within a business process, e.g.,a sequence or a parallel split, as observed through anextensive analysis of existing workflow managementsystems. Since then the tool has grown into a fully-fledged workflow management system and support envir-onment. As any workflow management system, its maincapabilities revolve around the automation of processmodels. This is achieved via three core components: theYAWL Editor, to design executable YAWL models and linkthese to organizational resources, business data andexternal applications; the YAWL Engine, to automate suchmodels; and the Resource service, to control the allocationof tasks to resources. However, besides the typical ame-nities of a workflow management system, the YAWLenvironment offers unique workflow features which stemfrom its research foundations. These include the under-lying YAWL workflow language and its support foradvanced workflow patterns (such as cancelation regionsand the OR-join), as well as state-of-the-art workflowverification, configuration and exception handling.

YAWL is licensed under the GNU Lesser General PublicLicense (LGPL), which fosters developers to contributemodifications and enhancements, while not restricting itsuse in proprietary works. Further, an entity named TheYAWL Foundation has been established to protect allintellectual property (IP) related to the YAWL environment.This serves to indemnify the Foundation from any copyrightor IP infringement issues, while providing the right todistribute the software on behalf of any contributor.

3. Hypothesis development

3.1. An integrative model of the behavioral intentions to use

OSS software

The literature to date has established knowledge about awide range of factors that contribute to individuals’ inten-tions to use technology, both in proprietary (e.g., [43]) as

1 http://yawlfoundation.org.

well as in open-source contexts (e.g., [14]). The literaturespans extrinsic and intrinsic motivating factors as well associal aspects. Reconfirming the importance of well-knownfactors such as the influence of perceived usefulness andperceived ease of use will, therefore, not contribute much tothe literature.

Our primary focus is thus not in establishing a newmodel of continued usage behavior of open-source sys-tems but rather in examining how important selecteddeterminants are among different user cohorts. To thatend, we developed a research model based on a synthesisof relevant findings from prior research on usage inten-tions associated with open-source systems. Fig. 1 displaysour research model graphically.

The model posits that the intention to (continue to)use an open-source workflow management system is afunction of two primary beliefs: perceived behavioralcontrol (PBC) and intrinsic motivation (MOT).

PBC is a construct that captures beliefs regardingaccess to the resources and opportunities needed to per-form a behavior, or the internal and external factors thatmay impede behavioral performance [2]. In the context ofsoftware system use, PBC relates to the beliefs of users tohave the skills as well as the resources available that arerequired to successfully use the system. Aside from self-efficacy beliefs [11], a key component in PBC is therefore‘‘facilitating conditions’’ [38], which reflects the resourcesmade available by a provider that are required to engagein a behavior.

Facilitating conditions are defined as the degree to whichan individual believes that an infrastructure exists to sup-port use of a software system [47]. Taylor and Todd [35]decomposed this infrastructure into technology facilitatingconditions (such as technology compatibility) and resourcefacilitating conditions (such as time, money, access toknowledge and support resources), and found that resourcefacilitating conditions have an importance greater thantechnology facilitating conditions.

In the context of open-source system use, the provisionof resource facilitating conditions (FC) is a key type offacilitating condition that can influence system usage inten-tions. By providing instruction and guidance resources tousers and assisting them when they encounter difficulties,some of the potential barriers to successful use are reducedor eliminated [37]. Open-source systems often come withlimited documentation, installation or other assistance

Fig. 1. Research model.

Page 4: Understanding user differences in open-source workflow management system usage intentions

J. Recker, M. La Rosa / Information Systems 37 (2012) 200–212 203

material, making the external availability of resources toprovide such knowledge an immensely important positivecontributor to successful usage. All other things equal,therefore, perceived behavioral control will increase asmore assistance and support access is available becauseusers will feel that if they have limited a priori knowledgeabout using a system, support and knowledge will bereadily available, thereby amplifying beliefs about thecontrol of use.

In contrast to control beliefs, intrinsic motivationdescribes those psychological forces that arise fromwithin an individual and cause him or her to volitionallyperform a task or activity for gains of satisfaction orinterest. Intrinsic motivation has been well-studied inthe literature and has been firmly established as a keydriver of OSS participation [21,33] and technology usage[12,42], which suggests its relevance to understandingbehavioral intentions to use OSS software. Intrinsic moti-vations capture those factors that determine the decisionto engage in system usage behavior volitionally [42].

In the specific context of OSS software system usage,we believe three key antecedents are particularly relevantto understanding the intrinsic motivations to use OSSsoftware, viz., the facilitating resource conditions (FC), themotivation to help others (HELP) and the perceptions ofthe provider image (IMG).

First, facilitating (resource) conditions are important tounderstanding motivations to use a system because theavailability of support and guidance structures can notonly increase control beliefs but also add to the motiva-tion to use a system because beliefs about the ease of useof the system can be amplified [24].

Second, OSS software use provides an opportunity tofeedback knowledge to the OSS community. Studies ofOSS participation have found that the opportunity to help

others in the community is a key motivator to contributeto the development of OSS software [50] or the prosperityof the community itself [18]. We believe that suchaltruistic motives also pertain to the decision to use OSSsoftware because the use of OSS software provides theground on which experiences, modifications or extensionscan be fed back to the developer/user communities.

As a last antecedent to the motivations to use OSSsoftware, we consider social motives—such as ideology orsense of belonging, which have been found to be key tounderstanding the OSS movement [3,34]. In light of therelevance of such social motives, we believe that espe-cially the status image of the OSS provider could be a keyfactor to examine OSS usage contexts. Consider theunlucky history of Netscape in the open-source commu-nity. In 1998, Netscape, in a move to counter the growthof Microsoft Internet Explorer, created the Mozilla project.Still, their strategy was not fully in line with the generalnotion of the OSS ideology. The source code of theprogram was released only partially, several interestingmodules were kept closed, and a specific license allowedNetscape to alter any external modifications made to theprogram. In effect, the initial system, Netscape Navigator,failed to attract any significant level of end user accep-tance and it was only when the company re-establishedits status as a true open-source company by incepting

a GPL-like licensing scheme for the Mozilla project thatOSS users started extending the system. These and othersimilar stories point to the relevance of the perceivedsocial status (we call this the perceived provider image) ofan OSS provider in the community of OSS users. Forinstance, firms try to conform to the social norms thatrule the OSS community to raise their perceived status asthe basis for cooperative behavior of users [7]. Placingtrust in the capabilities of a provider to provide high-quality software products and to act in the ‘true spirit’ ofthe open-source community is thus expected to raise themotivations to use OSS software. Thus, the construct‘‘provider image’’ defines the perceptual status image ofthe software provider and assesses the degree to whichpeople believe that the provider of an open source soft-ware solution has a high status as a provider in therelevant social network (i.e., the open source communityor the particular business domain in which an organiza-tion operates).

3.2. Expected differences in the behavioral patterns leading

to YAWL usage intentions

On the basis of the research model described above, wenow detail our expectations about how the three usercohorts of the YAWL system will differ in terms of thebehavioral factors explaining the system’s usage intentions.

First, we examine the role of antecedents to intrinsicmotivation. Turning to the role of the perceived providerimage, we believe that IMG is most important for students,then academics, and finally practitioners. Our argumentrests on the observation that students are typically requiredto actively and intensively research the development andfunctionality of the system. Moreover, they may engage inclose interactions with the research team involved in thedevelopment and maintenance of the system, as they readthe relevant research papers. Such engagement often leadsto elevated perceptions about the status of the systemprovider (in this case the university team behind it), in turnelevating motivations to use this system created by thoseresearchers that occupy roles such as lecturers, mentors andresearch advisors. Second, academics tend to use the YAWLsystem with the view to developing software extensions,because they believe on the solid research foundations ofthis system, which are evidenced by the proven track-recordof the research group that developed the system. Suchbeliefs would again manifest elevated perceptions of provi-der image. Still, we believe the influence of these beliefs tobe decreased in comparison to the strong status beliefsof students. By contrast, we believe that practitioners will

be motivated to use the system because they trust theuniversity environment in which it has been developed.They recognize the social function of universities and theunbiased judgment of academics as important requirementsto produce software with state-of-the-art functionality.However, practitioners know that software developed by auniversity typically lacks production quality and adequatecustomer support (as indeed in the case of the YAWLsystem). While these aspects are less important for aca-demics, they become critical in a commercial setting, in turn

Page 5: Understanding user differences in open-source workflow management system usage intentions

J. Recker, M. La Rosa / Information Systems 37 (2012) 200–212204

justifying a somewhat lesser influence of IMG than in theacademic and student user cohorts. Formally, we state:

H1a. The impact of IMG on MOT will be stronger foracademics than practitioners.

H1b. The impact of IMG on MOT will be stronger forstudents than academics, and by extension it will also bestronger than practitioners.

Second, we turn to the relevance of the motivation tohelp others. We believe that HELP is more important toacademics and students than practitioners. Academicsmainly use YAWL for research purposes. Thus, they mayhave an interest in helping the YAWL community growbecause this will give their YAWL extensions more visi-bility and uptake, which eventually will generate moreresearch impact. To a lesser extent, we expect students ofIT courses to be similarly motivated to use YAWL becauseof their desire to contribute to the community from whichthe system originates. Often, students develop close tiesto the research institute they are connected with, andthey may also become engaged in activities to promotethis software community (e.g. by participating in the OSSforum of the YAWL system, where they can report bugsand improvement requests, or better, by donating code).Such effects could manifest in increased motivations touse the YAWL system because students realize the oppor-tunity to contribute to the community.

Practitioners, by contrast, use the system mainly forcommercial purposes. Thus, helping the OSS communityaround YAWL may not necessarily influence their motiva-tion to use the system. For example, in our experience,those organizations that use YAWL for commercial pur-poses, have close-sourced their custom extensions to theYAWL code base (this is possible due to YAWL’s LGPLlicense). Therefore, we do not expect strong influence ofHELP on MOT for practitioners. Formally, we state:

H2a. The impact of HELP on MOT will be stronger foracademics than practitioners.

H2b. The impact of HELP on MOT will be stronger forstudents than practitioners.

Third, we turn to the role of facilitating conditions. Webelieve that the availability of FC such as documentation,customer support and periodic system updates, will play amost important role for academics. Facilitating conditionscan help academics develop their YAWL extensions quicker,especially through the availability of technical documenta-tion such as developer’s manuals. In an effort to extendthe system itself or the knowledge around the system, webelieve that the availability of assistance will stronglyleverage feelings of behavioral control over the system.Second, we believe the availability of facilitating conditionswill be important also to practitioners. This is because suchconditions increase the practitioner’s confidence that asystem is reliable since it is maintained over time (periodicupdates) and easy to use (documentation and customersupport). Thus these conditions can help justify an invest-ment in a commercial setting. And while licensing costsare cut down in OSS software, a company still needs to

significantly invest in training to be able to use the softwareproduct effectively and efficiently, which further justifiesthe importance of facilitating conditions for practitioners.Finally, we believe that facilitating conditions are lessrelevant to students since they do not typically need toextend or customize the YAWL system within the scope oftheir studies. In most instances, they will rather use thesystem to create examples and learn about process model-ing and automation. Formally, we state:

H3a. The impact of FC on PBC will be stronger forpractitioners than students.

H3b. The impact of FC on PBC will be stronger foracademics than practitioners, and by extension it will bestronger than students.

Finally, we examine the relative importance of the twomain drivers of usage intentions, viz., perceived beha-vioral control and intrinsic motivation.

One key difference between student, academic andpractitioner user cohorts is the degree to which the use ofYAWL is driven by mandate. Consider the situation ofstudents, for example. The use of YAWL in universitycourses on process modeling and automation is oftenmandated or at least encouraged. It is thus most oftennot up to the students to use YAWL out of pure intrinsicinterest. Given this scenario, it is likely to expect thatintrinsic motivation plays a relatively minor role incontributing to the intention to use YAWL. By contrast,the relative importance of perceptions of behavioralcontrol will be more important because perceptions ofcontrol are important especially in situations wheresystem usage is mandated [8]. For academic users, how-ever, we believe a different mechanism will be at work.Academics dominantly use YAWL out of individualresearch interest, to study the workflow technology and/or to develop extensions or other artifact contributions.These interests are driven by an intrinsic motivation tostudy topics around workflow and by an intrinsic interestto use the particular system. In turn, we believe therelative importance of intrinsic motivation will be strongfor this cohort. Last, turning to the practitioner cohort,we believe that for organizational end-users, the decisionabout which software or system to use is often anorganizational decision made by managers or boards ofIT directors [8]. We believe that in this situation, similarto the student cohort, the role of PBC will be relativelystronger than that of MOT. Formally, we state:

H4a. For students, the impact of PBC on ITU will bestronger than the impact of MOT on ITU.

H4b. For academics, the impact of MOT on ITU will bestronger than the impact of PBC on ITU.

H4c. For practitioners, the impact of PBC on ITU will bestronger than the impact of MOT on ITU.

Page 6: Understanding user differences in open-source workflow management system usage intentions

J. Recker, M. La Rosa / Information Systems 37 (2012) 200–212 205

4. Research method

4.1. Data collection

We collected empirical data via a field survey of usersof the YAWL system during 6 months in 2009/10. Thesurvey method is appropriate when clearly identifiedindependent and dependent variables exist, and a specificmodel is present that theorizes the relationships betweenthe variables [27], which is the case in our study.

As discussed above, the YAWL system has threeprimary user cohorts: it is in use in small-to-mediumsized organizations, it is in use by academics working onbusiness process management solutions, and it is in usein higher-education teaching institutions in courses onprocess modeling and automation. Across these threecohorts, the application purposes range from classicalworkflow engineering, process modeling and processautomation to discrete process simulation [30].

Data was collected globally from YAWL users via a web-based instrument. Web-based surveys are advantageousover paper-based surveys in several ways (e.g., lower costs,no geographical restrictions, faster responses). Users wereinvited to participate in the online survey through adver-tisements made in online forums and blogs, emailannouncements, through the YAWL community (www.yawl-foundation.org) and through a link present in theYAWL system itself. Participants were informed about thetype and nature of the study and they were offeredincentives for participation, specifically, a summary of theresults and the opportunity to win a textbook.

We received 220 responses in total, of which 14 wereincomplete and twelve invalid. After eliminating theseentries, we obtained a sample of 194 usable responses.The respondent group varied in organizational and personaldemographics. Over 87% of respondents were male. 28.4%of participants were academic users, 27.3% were student

users, 44.3% were practitioners (in positions such as analyst,developer, IT manager, system administrator, softwareengineer, process manager), with the rest indicating ‘‘other’’occupations. Practitioner respondents were spread amongstsmall (41.1%), medium (23.3%) and large (35.6%) companies.These statistics are largely similar to those reported in otheropen-source community studies [18,20,50], thereby indicat-ing appropriateness of the survey population. Over 50% ofrespondents had more than one year experience withworkflow systems in general, while 21% had less than onemonth experience with such systems. On average, therespondents had created nearly 30 workflow models usingthe YAWL system.

4.2. Design and measures

According to the research model illustrated in Fig. 1,we measured six latent constructs in this study: inten-tions to continue to use the open-source system (ITU),intrinsic motivation (MOT), perceived behavioral control(PBC), facilitating conditions (FC), motivation to helpothers (HELP), and perceived provider image (IMG). Allconstructs were measured using pre-validated multiple-item scales, using a seven-point Likert scale for each item,

anchored between ‘‘strongly disagree’’ (coded as 1) and‘‘strongly agree’’ (coded as 7), with the midpoint ‘‘neitherdisagree nor agree’’ (coded as 4).

Specifically, ITU was measured using a four-item scaleadapted from Bhattacherjee [5]. This scale had been usedextensively in prior work (e.g., [28]) and captures theextent to which users are willing to continue using asystem after initial usage experiences, in contrast to otherpotential alternatives as well as globally. We set the focusof the scale on the behavioral intentions to continue touse the OSS because, first, our data examination con-cerned how motivations stood in relation to behavioralintentions (i.e., a reflective purpose) and second, becauseour data set only comprised users that already had usageexperience with the OSS we considered—YAWL.

MOT was measured using the three item scale used byVenkatesh et al. [49]. The scale was originally developedby Davis et al. [12] and extensively validated [48].

PBC was measured using the scale used by Venkatesh[42], which was adapted from [23,35]. The scale itemsmeasured perceptions of control over using the system interms of required knowledge, technology compatibility, aswell as an overall scale measuring control over resources,knowledge and opportunities.

FC was measured using the resource facilitating condi-tions scale developed by Thompson et al. [37]. The scaleitems measured the perceived provision of support resourcesavailable when users encounter difficulties pertaining to theusage of a system in terms of guidance, specialized instruc-tions and assistance.

HELP was measured using the four-item scale onaltruistic motivation from Hars and Ou’s [18]. The scaleitems specifically measured individuals’ recognition of theimportance of helping each other in the OSS community,the self-perceived relevance of helping others, altruisticmotives, and the recognition of a helping opportunity.

Finally, IMG was measured by adapting three items fromthe social image scale used by Venkatesh and Davis [44],which was adopted from the scale developed by Moore andBenbasat [26]. Specifically, we did not anchor our IMGmeasurement items on perceptions on one’s social statusgains through the use of a system. Instead, we anchoredthem on perceptions on the social status of the provider ofthe open-source system within the organizational setting interms of prestige, community profile and organizationalimage. The Appendix A displays all scale items used.

Aside from the latent constructs, we collected demo-graphic data such as age (ordinal scale with the categories:Less than 20 years, 20–35 years, 36–50 years, Older than50 years), gender (male/female), experience with workflowmanagement systems (I am evaluating to do so/I havejust started, less than 1 month, 1–6 months, 7–12 months,1–5 years, more than 5 years), experience with processspecifications (number of process models read or created),experience with workflow specifications (number of YAWLworkflow specifications designed), and breadth of YAWLusage (number of features used and their ranking of impor-tance; the features include execution environment, syntaxchecker/verification, cancellation region, OR-join, multipleinstantiation, deferred choice and other workflow features).This data was collected (a) to provide demographics for the

Page 7: Understanding user differences in open-source workflow management system usage intentions

Table 3Construct correlations.

Construct FC HELP IMG ITU MOT PBC

FC 1.00

HELP 0.27 1.00

IMG 0.66 0.23 1.00

ITU 0.49 0.46 0.50 1.00

MOT 0.59 0.38 0.60 0.71 1.00

PBC 0.52 0.35 0.48 0.72 0.71 1.00

J. Recker, M. La Rosa / Information Systems 37 (2012) 200–212206

sample frame for our study population, and (b) to be ableto profile the different user groups, viz., practitioners, aca-demics and students.

4.3. Scale validation

To avoid potential interpretational confounding, weassessed the validity of our empirical indicators viaconfirmatory factor analysis before proceeding with thedata analysis, following the suggestions by Segars andGrover [32]. Each scale item was modeled as a reflectiveindicator of its theorized latent construct.

Table 1 shows the factor loadings, and Table 2 presentsconstruct reliabilities and descriptive statistics. Constructcorrelations are shown in Table 3. Reliabilities of thescales were assessed using Cronbach’s alpha and foundto be greater than 0.78 in all cases. The means of all scaleswere above the midpoint of 4, with standard deviationsbeing above 1. All constructs were correlated with eachother, with the highest correlations being between per-ceived behavioral control (PBC) and intention to useYAWL (ITU). Principal components analysis, with varimaxrotation yielded a six-factor solution, as expected. Thoseresults supported internal consistency, with all loadings

Table 1Factor loadings.

Item’construct Loading Std. dev t-Statistic Sig.

FC1’FC 0.04 0.04 10.07 o0.001

FC2’FC 0.05 0.05 7.65 o0.001

FC3’FC 0.04 0.04 9.09 o0.001

HELP1’HELP 0.04 0.04 5.90 o0.001

HELP2’HELP 0.04 0.04 7.25 o0.001

HELP3’HELP 0.03 0.03 8.46 o0.001

HELP4’HELP 0.05 0.05 5.16 o0.001

IMG1’IMG 0.03 0.03 11.76 o0.001

IMG2’IMG 0.03 0.03 11.13 o0.001

IMG3’IMG 0.05 0.05 8.96 o0.001

ITU1’ITU 0.02 0.02 12.46 o0.001

ITU2’ITU 0.02 0.02 11.86 o0.001

ITU3’ITU 0.03 0.03 10.86 o0.001

ITU4’ITU 0.02 0.02 14.22 o0.001

MOT1’ MOT 0.02 0.02 17.35 o0.001

MOT2’MOT 0.02 0.02 20.34 o0.001

MOT3’MOT 0.02 0.02 19.48 o0.001

PBC1’PBC 0.03 0.03 14.55 o0.001

PBC2’PBC 0.02 0.02 16.89 o0.001

PBC3’PBC 0.02 0.02 16.99 o0.001

Table 2Scale properties.

Construct Numberof items

Averagefactorscore

Std.dev.

Cronbach’sa

qc AVE

FC 3 4.01 1.22 0.79 0.88 0.70

HELP 4 4.82 1.29 0.92 0.95 0.82

IMG 3 4.09 1.33 0.83 0.90 0.74

ITU 4 4.97 1.25 0.92 0.95 0.81

MOT 3 4.44 1.10 0.90 0.93 0.83

PBC 3 4.68 1.23 0.89 0.93 0.81

being significant (0.79 or above), and discriminant valid-ity with all cross-loadings being less than 0.5. Convergentvalidity was further supported by all composite reliabil-ities exceeding 0.8 and average variance extracted (AVE)of each construct exceeding 0.7 or above. Discriminantvalidity was supported by showing that the AVE ofeach construct was higher than the squared correlationbetween any two factors (the highest squared correlationbeing 0.52, between PBC and ITU).

5. Analysis and results

Data analysis proceeded in several steps. First, our dataanalysis concerned the examination of the introducedresearch model in terms of the significances and effectsizes (b) for each hypothesized path, and explainedvariance (R2) for each dependent variable. Data analysiswas carried out using component-based structural equa-tion modeling implemented in SmartPLS v2.0 (www.smartpls.de). Fig. 2 gives the results.

The results displayed in Fig. 2 show that our modelexplained 59% of the variance in intention to continue touse, 27% of the variance in perceived behavioral control, and47% of the variance in intrinsic motivation. As expected, PBCwas a significant predictor of ITU (b¼0.44, po0.001) and sowas MOT (b¼0.39, po0.001). Facilitating conditions posi-tively influenced perceptions of behavioral control (b¼0.52,po0.001) and, to a lesser extent, intrinsic motivation(b¼0.31, po0.01). Intrinsic motivation was further a func-tion of HELP (b¼0.22, po0.05) and IMG (b¼0.35, po0.01),as expected. These results are in line with our expectationsand consistent with prior literature (e.g., [18,37,42,44,49]).

Second, we examined the research model individuallyfor all three user groups, and compared the significanceof the path coefficient differences among the three usergroups employing the multi-group analysis approach sug-gested by Henseler [19]. This approach does not requireany distributional assumptions. The significance of differ-ences is based on pair-wise comparisons of the bootstrapestimates that are generated by prevailing PLS implemen-tations such as SmartPLS. The descriptive profile of thedifferent user groups is shown in Table 4, and the resultsfrom the multi-group analysis are summarized in Table 5.

As expected, we find that academics tend to use theYAWL system more broadly (average number of featuresused is 4.89 versus 3.83 for students and 2.95 for practi-tioners) and also more intensively (in number of hoursper week) than the other two cohorts. Likely, this isbecause academics are exposed to a broader range of

Page 8: Understanding user differences in open-source workflow management system usage intentions

FacilitatingConditions

PerceivedBehavioral

ControlR2 = 0.27

Intention toContinue to Use

R2 = 0.59

IntrinsicMotivation

R2 = 0.47

PerceivedProvider Image

Motivation toHelp Others

******ns

p < 0.01p < 0.001

p < 0.05non significant

0.44***

0.39***

0.35**

0.22*

0.31**

0.52***

Fig. 2. Structural model results (all groups).

Table 4User group descriptive statistics.

Measure Academics Students Practitionersn¼55 n¼53 n¼86

Age

Less than 20 years 1 1 0

20–35 years 40 45 39

36–50 years 12 6 26

Older than 50 years 2 1 21

Gender

Male 44 44 86

Female 11 9 0

Experience with the YAWL system

I’m evaluating to do so/I have

just started

17 24 60

Less than 1 month 8 6 6

1–6 months 16 15 12

7–12 months 2 3 2

More than 1 year 12 5 6

Use of YAWL per week (in hours)

Mean 21.3 13.03 2.53

Std. dev. 71.15 29.03 2.26

Number of process models created or read

Mean 167.54 33.67 92.03

Std. dev. 705.88 50.99 259.01

Number of YAWL workflow specifications defined

Mean 15.76 63.47 9.59

Std. dev. 25.68 411.20 30.42

Number of YAWL features used

Mean 4.89 3.83 2.95

Std. dev. 3.48 2.80 2.97

J. Recker, M. La Rosa / Information Systems 37 (2012) 200–212 207

system features due to the nature of their in-depth workthan, for instance, practitioners, who are more likely torely on a limited set of features steadily over a longerperiod of time.

This also reflects on the average time spent on thesystem. Both academics and students use YAWL signifi-cantly more intensively than practitioners (21.3 h and

13.03 h per week versus 2.53 h per week). This would beexplained by their more exploratory usage of the systemand active participation to the OSS community aroundYAWL, in comparison with practitioners who wouldtypically use the system to maintain control over somededicated business processes.

Another aspect that is in line with our expectations isthe experience with the YAWL system. While academicshave used YAWL for longer, students are typicallyinvolved with the system during a semester or two. Thisis in the context of the units they are enrolled in wherethey may model a great number of YAWL processes.However, they rarely continue using the system beyondtheir university commitments (e.g. through alumni net-works). Similarly, since the YAWL system has only beenadopted in industry quite recently, only a few practi-tioners out of those who participated in the experimenthave actually used YAWL for more than one year (lessthan 10%). Most of them are still evaluating to do so orhave just started using YAWL.

After discussing the descriptive statistics, we turn tothe results from our multi-group analysis summarized inTable 5. This data allows us to reason about our hypoth-eses. Our first set of hypotheses concerned differences inthe impact of IMG on MOT. In line with our expectationsin H1a and H1b, the data in Table 5 shows that IMGdisplays the strongest impact on MOT for the studentcohort (b¼0.61, po0.001), followed by academics(b¼0.34, po0.01) and then practitioners (b¼0.27,po0.05). The contrast between students to academicsas well as practitioners is significant (Db¼0.27, p¼0.04and Db¼0.34, p¼0.02, respectively), while the differencebetween academics and practitioners is not significant(Db¼0.07, p¼0.30).

Regarding the role of HELP, we note that the impacton MOT is almost identical between students and practi-tioners (b¼0.47 and 0.48, respectively); but for academicsthe impact is weak and insignificant (b¼0.01, p40.05).In turn, these results are not in line with our hypothesesH2a and H2b.

Page 9: Understanding user differences in open-source workflow management system usage intentions

Table 5Multi-group analysis results.

Criterionvariable

Predictor Group 1(academics)

Group 2(students)

Group 3(practitioners)

Academics vs.students

Academics vs.practitioners

Students vs.practitioners

n¼55 n¼53 n¼86

ITU R2¼0.72 R2

¼0.68 R2¼0.51

PBC 0.53nnn 0.68nnn 0.18ns 0.16 0.01 0.00MOT 0.39nn 0.21nn 0.57nnn 0.14 0.12 0.00

PBC R2¼0.42 R2

¼0.19 R2¼0.28

FC 0.65nnn 0.44nnn 0.53nnn 0.04 0.15 0.22

MOT R2¼0.54 R2

¼0.50 R2¼0.57

FC 0.41nn�0.07ns 0.47nnn 0.00 0.36 0.00

HELP 0.01ns 0.47nnn 0.48nnn 0.00 0.00 0.48

IMG 0.34nn 0.61nnn 0.27n 0.04 0.30 0.02

Note: The italic values highlight the overall variance explained in the relevant criterion variable.

The bold values highlight group differences in the variance explained in the relevant criterion variable that are statistically significant at at least po0.05.nnn po0.001,nn po0.01,n po0.05,

ns: p40.05.

Table 6Hypothesis testing results.

No Hypothesis Support

H1a The impact of IMG on MOT will be stronger for academics than practitioners Yes, but not significantly (p¼0.30)

H1b The impact of IMG on MOT will be stronger for students than academics and by extension

it will also be stronger than practitioners

Yes, significantly (p¼0.04 and 0.02)

H2a The impact of HELP on MOT will be stronger for academics than practitioners. No, directionality reversed

H2b The impact of HELP on MOT will be stronger for students than practitioners No, impact almost equal

H3a The impact of FC on PBC will be stronger for practitioners than students Yes, but not significantly (p¼0.22)

H3b The impact of FC on PBC will be stronger for academics than practitioners, and by extension

it will be stronger than students.

Yes, partially significantly (p¼0.15 and 0.04)

H4a For students, the impact of PBC on ITU will be stronger than the impact of MOT on ITU Yes, (b¼0.68 vs. b¼0.21)

H4b For academics, the impact of MOT on ITU will be stronger than the impact of PBC on ITU No, PBC stronger that MOT

H4c For practitioners, the impact of PBC on ITU will be stronger than the impact of MOT on ITU No, PBC not significant at all.

J. Recker, M. La Rosa / Information Systems 37 (2012) 200–212208

Third, we turn to the role of FC. Regarding its impact onPBC, the data shows that FC displays the strongest impacton PBC for the academic cohort (b¼0.65, po0.001),followed by practitioners (b¼0.53, po0.001) and thenstudents (b¼0.44, po0.001). The results support hypoth-esis H3a and H3b.

Finally, we examine the role of PBC in relation to MOT.Our data shows that PBC is a stronger predictor of ITUthan MOT in the student user cohort (b¼0.68, po0.001and b¼0.21, po0.01, respectively), in line with hypoth-esis H4a. PBC is also a stronger predictor of ITU thanMOT in the academic user cohort (b¼0.53, po0.001 andb¼0.39, po0.01, respectively), although the relativedifference is not that stark. This result does not supporthypothesis H4b. Finally, for practitioners we see thatMOT is the only significant predictor of ITU (b¼0.57,po0.001), which is not what we expected in hypothesisH4c.

6. Discussion

In our data analysis, we examined differences in therelative importance of behavioral factors on the inten-tion to (continue to) use the open-source workflow

management system YAWL. Our research model, synthe-sized from prior literature, received overall strong supportfrom the data and confirmed relationships as expected.More importantly, our subsequent analysis showed anumber of significant differences between academic,student and practitioner users; with some of the differ-ences being in line with our expectations, and someuncovered differences being surprising indeed. Table 6summarizes the findings about our hypotheses.

Overall, our analysis clearly confirms the cohort-spe-cificity of the open-source workflow management systemintention to use decision. We identify a number of keyfindings: First, we note how, for practitioners, intentionsto use the YAWL system were fully determined byintrinsic motivation and not at all by perceived behavioralconditions. This is in stark contrast to the other twocohorts, where perceived behavioral control was a stron-ger determinant than intrinsic motivation. We interpretthis result before the background of the experiencepractitioners have with YAWL. As shown in Table 4, mostof the practitioners who use YAWL are at an early stage, orare still evaluating to do so. This may indicate thatperceived behavioral control has not fully developed inthese people, since behavioral control perceptions tend to

Page 10: Understanding user differences in open-source workflow management system usage intentions

J. Recker, M. La Rosa / Information Systems 37 (2012) 200–212 209

develop with increased longitudinal exposure to a system[44]. Another possible explanation may be derived whenconsidering the background of the different applicationsettings. Practitioners mostly employ the YAWL system tomaintain or develop control over the coordination ofspecific business processes; while academics and studentstend to use the system in a more exploratory, research-oriented manner. In exploratory or academic applicationssettings, therefore, our findings suggest that the percep-tions of control over the use of the system are stronglyimportant whereas for ‘pure’ application purposes suchcontrol is not that important.

In line with this interpretation, we found that facil-itating resource conditions are specifically important toacademic users, to assist them in their bids to extend thesoftware and/or to extend the knowledge around the useof the system. Having access to technical expertise andguidance around the details and specifics of the systemappears to be important to allow academics to focus ontheir key work.

Further, we found that the role of perceived providerimage was a strong determinant especially for studentusers of the YAWL system. These findings draw attentionto the motivational components that inform how studentsperceive and behave in relation to technological artifactscreated at research institutes. The influence of a positiveimage conveyed by a research group can have a strongimpact on behavioral intentions exerted by student users.

Interestingly, we also found that motivations to helpothers appear not to be a strong motivational componentfor academic users of the YAWL system. We can speculatethat this cohort decides to use the system not for reasonsto assist the community but rather for the individual(selfish) motives of progressing their own research andwork. In that regard, it would appear that a research jobprofile demands more selfishness than other profiles.Students as well as practitioners showed strong interestsin contributing to the user community.

Overall, our research draws attention to the questionwhether our models of technology acceptance and usagebehaviors can be applied unequivocally to different usercohorts. Our analysis revealed significant cohort-specificdifferences across all determinants considered. In turn,these findings provide a note of caution to apply theore-tical models to technologies that are being used by usergroups with different application purposes and tasks(such as user groups associated with decision-supportsystems, different user types of hedonistic systems orwidespread information systems such as mobile devicesand laptop systems).

6.1. Implications for research

We identify several opportunities for future research thatcan extend the scope of our work. First, our analysisuncovered user group-specific differences in a theoreticalmodel of workflow management system acceptance. Ouranalysis can yield similar insights into user differences forother theoretical models such as those describing prop-rietary system acceptance [43] or task performance [13].

Our approach can also be applied to study other differencessuch as those stemming from cultural backgrounds [25].

Second, our research set out to examine a set ofspecific antecedents to open-source system acceptanceand is by no means considered compete or exhaustive.Further research could examine user differences acrossother antecedents previously found relevant to OSS usage,such as knowledge gains [22], sense of belonging [34]or fun [20].

Finally, our work calls for further research on theoriz-ing around different types of technology users, and theimpacts on behavioral processes and outcomes in inter-acting with technology that user differences implicate.

6.2. Implications for practice

In addition to the academic merits of this work, weidentify several implications for practice, stemming fromthe specific insights our empirical study provided. Wegroup these implications in three main strategies: (i) theprovision of open-source system solutions, (ii) the user-specific management of workflow management systems,and (iii) the further development of the YAWL communityspecifically. In doing so, we can draw specific suggestionsfor three important roles: (i) the providers of open-sourcesystems, (ii) the different user types (especially studentand academic users), and (iii) university developers ofopen-source systems.

6.2.1. Implications for the provision of open-source systems

Our data revealed several interesting findings forproviders of open-source system solutions. For example,while we expected a high influence of FC on intrinsicmotivation for practitioners (b¼0.47), we did not expectto have an equally high influence of HELP on the motiva-tion of practitioners to use the open-source workflowmanagement system we examined (b¼0.48). This sug-gests that providers of open-source systems can poten-tially increase the uptake of their products in commercialsettings if they aliment a practitioner’s desire to helpothers, besides enhancing the system’s facilitating condi-tions. For example, this can be achieved by

1.

Making it easier for users to extend the system, e.g. viawell documented code, developer’s manuals and wikis(which, in turn, would provide facilitating conditions);but also

2.

Providing infrastructure services to engage the com-munity, such as forums for users to help solve eachother’s issues with the product, and submission sys-tems for users to donate their own code and receivefeedback from the community. Such services couldincrease the ability of users to help each others, in turnalso contributing to usage motivations.

Considering the example of YAWL as an OSS workflowmanagement system, we note that it is actually not veryeasy to help others through code contributions. Typically,the code base is not consistently well commented, and thetechnical documentation about the system is often not in

Page 11: Understanding user differences in open-source workflow management system usage intentions

J. Recker, M. La Rosa / Information Systems 37 (2012) 200–212210

synch with the actual system implementation (which is inpart related to a lack of proper facilitating conditions).

Such situations are especially typical for softwaredeveloped in university settings, where various researchstudents and academics contribute to the development ofthe system, instead of having a dedicated team of devel-opers who work on the system over a prolonged periodof time. One potential ramification of this situation isto provide resource support for university-based OSSproviders, to implement and promote facilitation servicescomplementary to the software development. At present,however, such staffing is often obstructed by financiallimitations. Our research can provide some substantivearguments in favor of additional resource provision inorder to increase the uptake of research solutions inindustry networks.

2 http://www.signavio.com/en/academic.html.

6.2.2. Implications for the user-specific management of

workflow management systems

One key finding of our work is the significant differ-ences in control and motivation perceptions of differentuser groups as they relate to the intention to use an open-source workflow management system.

Considering students as a dedicated user cohort ofinterest to the workflow management community, webelieve that an important implication for practice derivesfrom the noted strong importance of IMG over MOT forstudents (b¼0.61). This finding suggests that by investingin the social image of the provider of a workflow manage-ment system, providers can increase acceptance of theproduct by students. In the case of YAWL, for instance, thedevelopment team is a research team, since the product hasbeen developed at a university. Thus, a possible way ofelevating the social image of the YAWL team is by activelyadvertising, through various channels, the impact of theresearch team, as an indicator of the team’s reliability andhigh quality. For example, the YAWL Foundation web-sitecould feature a dedicated page for each team memberhighlighting their main achievements in workflow manage-ment research and beyond, besides reporting on the specificcontribution that member has brought to the YAWL system.At the moment, the web-site only briefly reports on theindividual contributions and provides a link to each mem-ber’s personal page for further information. This can befurther extended to the image of the research group theYAWL team belongs to, and to that of its hosting universityand to the network of other research institutions the YAWLteam collaborates with.

Considering academics as a second dedicated usercohort of workflow management systems, we found thatFC is the strongest antecedent to both PBC and MOT(b¼0.65 and 0.41, respectively). This suggests that enhan-cing facilitating conditions will strongly contribute toincrease academics’ intentions to (continue to) use aworkflow management system. This finding drawsattention to the importance of developing complementaryservices such as documentation, manuals, training provi-sion and assistance offered to the community ofworkflow users, especially those within an academicapplication setting.

6.2.3. Implications for the development of the

YAWL community

As previously discussed, most OSS solutions – includ-ing the YAWL system – suffer from poor facilitatingconditions. While this situation tends to be true for mostOSS products [22], the situation is exacerbated in the caseof YAWL. Similar to other OSS products developed in aresearch institute where limited funds are available, mostfunding tends be directed towards advancing its develop-ment rather than on enhancing its facilitating conditions.And while for such reasons the provision of a help desk orthe availability of dedicated consultancy services wouldbe out of reach, the YAWL community could still beleveraged to enhance other facilitating conditions. Thereare various ways in which this could be achieved. Forexample, the host team of YAWL could outsource themaintenance and development of specific sections of theuser manual to wider parts of the YAWL community. Thecommunity itself could also be stimulated to providetutorials, illustrative videos and examples, and to managea user-based wiki around the product. Leveraging a com-munity to assist the wider management of university-ledproduct development has already been demonstrated toyield benefits. The BPM Academic Initiative,2 for example,illustrates how a modeling solution developed at aresearch institute leverages the wider academic commu-nity working with the platform. Notably, the communityprovides additional content in terms of modeling exam-ples, exercises and tutorials. A similar initiative could beenvisaged to further enhance the profile and services of theYAWL community.

In summary, given the scarce availability of funds, theYAWL community with its three different user cohorts, isprobably the most important assess for the YAWL team toguarantee the future of this product, both in terms ofextending the functionality of the system as well as provid-ing complementary services that boost provider image andfacilitating conditions—both of which, as per our study, willresult in increased acceptance of the system.

7. Conclusions

In this paper, we examined a model of open-sourceworkflow management system acceptance across threespecific user cohorts, viz., academic users, practitionerusers and student users. To the best of our knowledge,this is the first time such a comparative study on open-source system acceptance is carried out over differentuser cohorts. Our findings attest to significant differencesin the perceptions of motivations and behavioral controlleading to the intentions to use the open-source system.Thereby, our research provides empirical evidence aboutbehavioral differences among technology user cohortsand can be used to stimulate further theoretical work tocircumscribe the characteristics, role and implications ofuser differences in technology use.

Page 12: Understanding user differences in open-source workflow management system usage intentions

Table A1Operationalization and instrumentation of constructs.

Theory construct Reference No. Item definition

Intention to

continue to use

Adapted from [5] ITU1 I intend to continue to use YAWL.

ITU2 I predict I would continue to use YAWL.

ITU3 I plan to use YAWL in the future.

ITU4 I prefer to continue to work with YAWL.

Intrinsic

motivation

Adapted from [49] MOT1 I find using the YAWL system to be enjoyable.

MOT2 The actual process of using the YAWL system is pleasant.

MOT3 I have fun using the YAWL system.

Perceived

behavioral

control

Adapted from [42] PBC1 I have the knowledge necessary to use the YAWL system.

PBC2 Given the resources, opportunities and knowledge it takes to use the YAWL

system, it would be easy for me to use it.

PBC3 The YAWL system is not compatible with other IT systems I use (inversely

coded).

Facilitating

conditions

Adapted from [37] RFC1 Guidance was available to me in the selection of the YAWL system.

RFC2 Specialized instruction concerning the YAWL system was available to me.

RFC3 A specific person or group was available for assistance with difficulties with

the YAWL system.

Motivation to

help others

Adapted from [18] HELP1 Being able to help OSS developers is important to me.

HELP2 Participating in OSS projects gives me an opportunity to help others.

HELP3 Helping each other in an OSS community is important to me.

HELP4 Members of the OSS community do help each other.

Perceived

provider image

Self-developed on

basis of [44]

IMG1 I use the YAWL system because the system provider has more prestige than

other workflow system providers.

IMG2 The people who designed and built the YAWL system have a high profile

IMG3 The YAWL system is important to the image of my organization.

J. Recker, M. La Rosa / Information Systems 37 (2012) 200–212 211

Acknowledgments

Dr La Rosa’s contributions to this work have partiallybeen sponsored by NICTA. NICTA is funded by the AustralianGovernment as represented by the Department of Broad-band, Communications and the Digital Economy and theAustralian Research Council through the ICT Centre ofExcellence program.

Appendix A

See Table A1.

References

[1] M. Adams, A.H.M. ter Hofstede, M. La Rosa, Open source softwarefor workflow management: the case of YAWL, IEEE Software28 (2011) 16–19.

[2] I. Ajzen, T.J. Madden, Prediction of goal-directed behavior: atti-tudes, intentions, and perceived behavioral control, Journal ofExperimental Social Psychology 22 (1986) 453–474.

[3] R.P. Bagozzi, U.M. Dholakia, Open source software user commu-nities: a study of participation in linux user groups, ManagementScience 52 (2006) 1099–1115.

[4] H. Benbya, N. Belbaly, Understanding developers’ motives in opensource projects: a multi-theoretical framework, Communications ofthe Association for Information Systems 27 (2010) 589–610.

[5] A. Bhattacherjee, Understanding information systems continuance:an expectation-confirmation model, MIS Quarterly 25 (2001)351–370.

[6] J. Bitzer, W. Schrettl, P.J.H. Schroder, Intrinsic motivation in opensource software development, Journal of Comparative Economics35 (2007) 160–169.

[7] A. Bonaccorsi, C. Rossi Lamastra, Comparing motivations to takepart in the open source movement: from community to business,Knowledge, Technology & Policy 18 (2006) 40–64.

[8] S.A. Brown, A.P. Massey, M.M. Montoya-Weiss, J.R. Burkman, Do Ireally have to? User acceptance of mandated technology, EuropeanJournal of Information Systems 11 (2002) 283–295.

[9] P. Carmichael, L. Honour, Open source as appropriate technologyfor global education, International Journal of Educational Develop-ment 22 (2002) 47–53.

[10] I. Chengalur-Smith, S. Nevo, P. Demertzoglou, An empirical analysisof the business value of open source infrastructure technologies,Journal of the Association for Information Systems 11 (2010)708–729.

[11] D.R. Compeau, C.A. Higgins, Computer self-efficacy: development ofa measure and initial test, MIS Quarterly 19 (1995) 189–211.

[12] F.D. Davis, R.P. Bagozzi, P.R. Warshaw, Extrinsic and intrinsicmotivation to use computers in the workplace, Journal of AppliedSocial Psychology 22 (1992) 1111–1132.

[13] S. Devaraj, R. Kohli, Performance impacts of information technol-ogy: is actual usage the missing link? Management Science 49(2003) 273–289.

[14] M.D. Gallego, P. Luna, S. Bueno, User acceptance model of opensource software, Computers in Human Behavior 24 (2008)2199–2216.

[16] S. Goode, Something for nothing: management rejection of opensource software in australia’s top firms, Information & Manage-ment 42 (2005) 669–681.

[17] G. Hackbarth, V. Grover, M.Y. Yi, Computer playfulness and anxiety:positive and negative mediators of the system experience effecton perceived ease of use, Information & Management 40 (2003)221–232.

[18] A. Hars, S. Ou, Working for free? Motivations for participating inopen-source projects, International Journal of Electronic Commerce6 (2002) 25–39.

[19] J. Henseler, On the convergence of the partial least squares pathmodeling algorithm, Computational Statistics 25 (2010) 107–120.

[20] G. Hertel, S. Niedner, S. Hermann, Motivation of software devel-opers in open source projects: an internet-based survey ofcontributors to the linux kernel, Research Policy 32 (2003)1159–1177.

[21] W. Ke, P. Zhang, Motivations in open source software communities:the mediating role of effort intensity and goal commitment,International Journal of Electronic Commerce 13 (2009) 39–66.

[22] J. Lerner, J. Tirole, Some simple economics of open source, TheJournal of Industrial Economics 50 (2002) 197–234.

Page 13: Understanding user differences in open-source workflow management system usage intentions

J. Recker, M. La Rosa / Information Systems 37 (2012) 200–212212

[23] K. Mathieson, Predicting user intentions: comparing the technologyacceptance model with the theory of planned behavior, Informa-tion Systems Research 2 (1991) 173–191.

[24] K. Mathieson, E. Peacock, W.W. Chin, Extending the technologyacceptance model: the influence of perceived user resources, ACMSIGMIS Database 32 (2001) 86–112.

[25] S. McCoy, D.F. Galletta, W.R. King, Applying TAM across cultures:the need for caution, European Journal of Information Systems 16(2007) 81–90.

[26] G.C. Moore, I. Benbasat, Development of an instrument to measurethe perceptions of adopting an information technology innovation,Information Systems Research 2 (1991) 192–222.

[27] A. Pinsonneault, K.L. Kraemer, Survey research methodology inmanagement information systems: an assessment, Journal ofManagement Information Systems 10 (1993) 75–105.

[28] J. Recker, Continued use of process modeling grammars: the impactof individual difference factors, European Journal of InformationSystems 19 (2010) 76–92.

[29] J.A. Roberts, Understanding the motivations, participation, andperformance of open source software developers: a longitudinalstudy of the apache projects, Management Science 52 (2006)989–999.

[30] N. Russell, A.H.M. ter Hofstede, Surmounting BPM challenges: TheYAWL Story, Computer Science—Research and Development 23(2009) 67–79.

[31] D. Sedera, G.G. Gable, T. Chan, Measuring enterprise systems success:the importance of a multiple stakeholder perspective. In: T. Leino, T.Saarinen, S. Klein (Eds.), Proceedings of the 13th European Conferenceon Information Systems, Turku School of Economics and BusinessAdministration, Turku, Finland, 2004, pp. 1732–1744.

[32] A.H. Segars, V. Grover, Re-examining perceived ease of use andusefulness: a confirmatory factor analysis, MIS Quarterly 17 (1993)517–525.

[33] S.K. Shah, Motivation, governance, and the viability of hybrid formsin open source software development, Management Science 52(2006) 1000–1014.

[34] K.J. Stewart, S. Gosain, The impact of ideology on effectiveness inopen source software development teams, MIS Quarterly 30 (2006)291–314.

[35] S. Taylor, P.A. Todd, Understanding information technology usage:a test of competing models, Information Systems Research 6 (1995)144–176.

[36] A.H.M. ter Hofstede, W.M.P. van der Aalst, M. Adams, N. Russell,Modern Business Process Automation: YAWL and Its SupportEnvironment, Springer, New York, NY, 2010.

[37] R.L. Thompson, C.A. Higgins, J.M. Howell, Personal computing:towards a conceptual model of utilization, MIS Quarterly 15 (1991)125–143.

[38] H.C. Triandis, Values, attitudes, and interpersonal behavior, in: H.E.Howe Jr., M.M. Page, (Eds.), Proceedings of the Nebraska Sympo-

sium on Motivation, University of Nebraska Press, Lincoln,Nebraska, 1979, pp. 195–259.

[39] W.M.P. van der Aalst, A.H.M. ter Hofstede, YAWL: Yet AnotherWorkflow Language, Information Systems 30 (2005) 245–275.

[40] W.M.P. van der Aalst, A.H.M. ter Hofstede, B. Kiepuszewski,A.P. Barros, Workflow patterns, Distributed and Parallel Databases14 (2003) 5–51.

[41] H. van der Heijden, User acceptance of hedonic informationsystems, MIS Quarterly 28 (2004) 695–704.

[42] V. Venkatesh, Determinants of perceived ease of use: integratingcontrol, intrinsic motivation, and emotion into the technology accep-

tance model, Information Systems Research 11 (2000) 342–365.[43] V. Venkatesh, H. Bala, Technology acceptance model 3 and a

research agenda on interventions, Decision Sciences 39 (2008)273–315.

[44] V. Venkatesh, F.D. Davis, A. Theoretical, Extension of the technologyacceptance model: four longitudinal field studies, ManagementScience 46 (2000) 186–204.

[45] V. Venkatesh, F.D. Davis, M.G. Morris, Dead or alive? The develop-ment, trajectory and future of technology adoption research,

Journal of the Association for Information Systems 8 (2007)267–286.

[46] V. Venkatesh, M.G. Morris, Why don’t men ever stop to ask fordirections? Gender, social influence, and their role in technologyacceptance and usage behavior, MIS Quarterly 24 (2000) 115–139.

[47] V. Venkatesh, M.G. Morris, G.B. Davis, F.D. Davis, User acceptanceof information technology: toward a unified view, MIS Quarterly

27 (2003) 425–478.[48] V. Venkatesh, C. Speier, Computer technology training in the

workplace: a longitudinal investigation of the effect of mood,Organizational Behavior and Human Decision Processes 79 (1999)1–28.

[49] V. Venkatesh, C. Speier, M.G. Morris, User acceptance enablers inindividual decision-making about technology: toward an inte-

grated model, Decision Sciences 33 (2002) 297–316.[50] C.-G. Wu, J.H. Gerlach, C.E. Young, An empirical analysis of open

source developers’ motivations and continuance intentions, Infor-mation & Management 44 (2007) 253–262.

[51] Y. Yoon, T. Guimaraes, Q. O’Neal, Exploring the factors associatedwith expert systems success, MIS Quarterly 19 (1995) 83–106.

[52] D. Zeitlyn, Gift economies in the development of open sourcesoftware: anthropological reflections, Research Policy 32 (2003)1287–1291.


Recommended