Developing an Effective Entrepreneurship Program Assessment:

Adapting a Model from the Creative Disciplines

Kenneth R. PhillipsDr. Mick Jackowski

Assessment in Entrepreneurial Education

• The literature related to entrepreneurship education indicates a lack of information regarding assessment practice (Pittaway and Hannon, 2009).

• Pittaway and Cope (2007) conducted a systematic literature review and identified assessment practice as one of the many gaps in enterprise education

• Entrepreneurial training assessment has received scant attention by researchers

Program Description- CFI Assessment

• Program Development- origins/collaboration• Program Outcomes• Data Collection• Curriculum Mapping• Data Analysis• Process for Improvement

Center for Innovation CurriculumCreative Problem-Solving

(Freshmen)

Business Planning Education

New Venture Feasibility

(Sophomore)

Internship—Minor Only

(Junior/Senior)

New Venture Creation I

(Junior/Senior)

New Venture Creation II

(Junior/Senior)

Implementation Phase

Center for Innovation Program Learning Outcomes

Students should demonstrate:

1) An ability to design a self-sustaining business model to meet desired needs within realistic constraints, such as economic, environmental, social, political, ethical, and regulatory. 2)An ability to function on and assume leadership roles in diverse, multidisciplinary teams. 3) An understanding of entrepreneurship and an ability to develop business plans. 4) An ability to use a problem-solving process to create appropriate solutions for business success. 5) An ability to prepare and deliver verbal presentations demonstrating visual organizational skills, proficiency in media technology and communicate effectively at the interpersonal level. 6) An ability to apply basic knowledge of accounting, finance, legal, management, and marketing, in relation to entrepreneurial ventures.

Center for Innovation Curriculum Map

Entrepreneurship Topics in Required

Courses

Creative Problem-Solving

New Venture

Feasibility

New Venture

Creation I

New Venture Creation

II

Professional Internship

Problem Defining I & R R R R RLeadership I R R R R

Understanding Entrepreneurship

I R R R R

Design Business Models

I R D D

Communication I R R D RDevelop Business

PlanI R D

Accounting IMarketing I R D

FinanceManagement

Legal

I RII

DRR

I= IntroducedR= Reviewed and reinforced

D= Demonstrates application/integration in personal

business plans

Figure 2

Program Implementation

• Currently administered through Internship only

• Exit survey of students• New Venture Creation II• Future- Online portfolio• Faculty Retreat

1. A

bilit

y to

per

form

rese

arch

rele

vant

to g

iven

des

ign

prob

lem

s.

2. A

bilit

y to

org

aniz

e an

d re

port

rese

arch

.

3. W

ritt

en c

omm

unic

ation

skill

s.

4. A

bilit

y to

exa

min

e an

d ap

ply

rese

arch

to d

esig

n pr

oble

ms.

5. A

bilit

y to

form

ulat

e m

ultip

le d

esig

n co

ncep

ts.

6. A

bilit

y to

ass

ess,

deb

ate,

and

sele

ct a

fina

l des

ign.

7. H

and

sket

chin

g.

8. P

ersp

ectiv

e re

nder

ing.

9. T

echn

ical

dra

win

g.

10. P

hysi

cal m

odel

ing/

prot

otyp

ing.

11. 3

D c

ompu

ter m

odel

ing

skill

s.

12. K

now

ledg

e of

man

ufac

turi

ng m

ater

ial/

proc

esse

s.

13. C

onsu

mer

safe

ty is

sues

.

14. V

erba

l pre

sent

ation

skill

s.

15. V

isua

l org

aniz

ation

/gra

phic

com

mun

icati

on.

16. K

now

ledg

e of

com

mun

icati

on te

chno

logy

.

17. K

now

ledg

e of

des

ign

hist

ory.

18. H

uman

fact

ors k

now

ledg

e.

19. F

orm

sem

antic

s.

20. C

ultu

ral c

onsi

dera

tions

.

21. B

usin

ess p

racti

ces.

22. K

now

ledg

e of

Sus

tain

able

des

ign

conc

epts

.

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

2009-2010 Mean Evaluation Scores

Pro Studio Internship Student

Perc

enta

ge o

f tot

al p

oint

s ava

ilabl

e

on percentage basis for comparison

1. A

bilit

y to

per

form

rese

arch

rele

vant

to g

iven

de

sign

prob

lem

s.

2. A

bilit

y to

org

anize

and

repo

rt re

sear

ch.

3. W

ritten

com

mun

icatio

n sk

ills.

4. A

bilit

y to

exa

min

e an

d ap

ply

rese

arch

to d

esig

n pr

oble

ms.

5. A

bilit

y to

form

ulat

e m

ultip

le d

esig

n co

ncep

ts.

6. A

bilit

y to

ass

ess,

deba

te, a

nd se

lect

a fi

nal d

esig

n.

7. H

and

sket

chin

g.

8. P

ersp

ectiv

e re

nder

ing.

9. T

echn

ical d

raw

ing.

10. P

hysic

al m

odel

ing/

prot

otyp

ing.

11. 3

D co

mpu

ter m

odel

ing

skill

s.

12. K

now

ledg

e of

man

ufac

turin

g m

ater

ial/p

roce

sses

.

13. C

onsu

mer

safe

ty is

sues

.

14. V

erba

l pre

sent

ation

skill

s.

15. V

isual

org

aniza

tion/

grap

hic c

omm

unica

tion.

16. K

now

ledg

e of

com

mun

icatio

n te

chno

logy

.

17. K

now

ledg

e of

des

ign

hist

ory.

18. H

uman

fact

ors k

now

ledg

e.

19. F

orm

sem

antic

s.

20. C

ultu

ral c

onsid

erati

ons.

21. B

usin

ess p

racti

ces.

22. K

now

ledg

e of

Sus

tain

able

des

ign

conc

epts

.65%

70%

75%

80%

85%

90%86%

83%81%

84%81%

83%

76% 76%

82%85% 85%

80%77%

82% 81% 81%83%

79% 80% 80%

72%

82%

2009-2010 Composite Mean Evaluation Scores

Perc

enta

ge o

f Mea

n

Process for Change based on Assessment Data

Instructional and Curricular changesProcess is Faculty/Data Driven