+ All Categories
Home > Documents > Learner Centered Assessment in Online...

Learner Centered Assessment in Online...

Date post: 15-Mar-2018
Category:
Upload: nguyendan
View: 241 times
Download: 5 times
Share this document with a friend
31
10/29/2014 1 LearnerCentered Assessment in Online Courses Using SelfEvaluation and Peer Review to Document Student Learning Outcomes Shawntel Landry, Ed. D. Alana Sloan, Ed. D. Assessment Institute October 21, 2014 Agenda 1. Background/Set the Stage 2. Assessment System 3. Learner-Centered Assessment 4. Learner-Centered Assessment: Study 1 5. Learner-Centered Assessment: Study 2 6. Overall Findings and Continuous Improvement
Transcript
Page 1: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

1

Learner‐Centered Assessment in Online 

Courses Using Self‐Evaluation and Peer Review to Document Student Learning Outcomes

Shawntel Landry, Ed. D.Alana Sloan, Ed. D.

Assessment InstituteOctober 21, 2014

Agenda

1. Background/Set the Stage2. Assessment System3. Learner-Centered Assessment4. Learner-Centered Assessment: Study 15. Learner-Centered Assessment: Study 26. Overall Findings and Continuous Improvement

Page 2: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

2

Background and Set the Stage

American College of Education

• Regionally accredited graduate-level education college

• Located in Indianapolis, IN

• Programso 16 graduate certificateso 23 master’s programso 1 specialist programo 1 doctoral program

Page 3: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

3

Setting the Stage• Moved in 2013 from a proprietary learning management

system (LMS) to Canvas LMS• Increased interactivity and opportunity for learner-centered

assessment through more automated survey capabilities and peer review assessment

• Prior to 2013:- pre- and post- self-assessments were in Word documents, and data were analyzed by hand.

- peer reviews could only be conducted in discussion boards.

Guiding Questions• How can learner-centered assessment provide

evidence of student mastery of learning outcomes?

• What measures can serve as rich data sources?

Page 4: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

4

Research QuestionCan learner-centered assessment be used to provide evidence of student mastery of learning outcomes?

Let’s take a poll…

Poll Results

Page 5: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

5

Assessment System

Assessment System Four Components

Student Learning Outcomes

Quantitative

Qualitative

Performance

Learner‐Centered

Page 6: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

6

SLOAlignment

Academic Outcomes

Program Outcomes

Course Objectives

Module Objectives

‐rubrics‐surveys‐institution‐wide

‐state and nat. standards‐discipline‐specific standards

Program Blueprint and SLOAlignments

Page 7: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

7

Assessment Alignment • Course Level

o Course TOTS Alignment Map

o Course Alignment Map

• Program Levelo Program Alignment Map

• Course Levelo Course Assessment Alignment

Map (Signature Assessments, Peer Review)

American College of Education T2T/MAT Program Alignment Map 

Revised 2.14.12 

Program Outcomes 

Course Objectives 

EDTT 520  EDTT 504  EDTT 506 EDTT 507 

EDTT 508 

EDTT 511 

EDTT 502 

DL 501 

EDTT 513 

EDTT 516  EDTT 501  EDTT 515 EDTT 505 

% of Emphasis 

1. Design and deliver instruction that is responsive to student diversity and differences and promotes high achievement for all 

students. 

15, 16  1, 2, 3, 4, 5, 6, 7, 8, 

9, 11, 12, 13, 14, 16, 

17 

1, 2, 3, 6, 7, 8, 9, 11, 12, 

13, 14, 15, 16, 17, 18 

3, 7, 12 

4, 5, 6, 8, 11 

1, 9, 12, 13, 

15, 16 

2, 4, 6, 10 

  3, 4, 6, 7 

1, 4, 6, 7, 8, 9, 10, 15 

5, 6     

23% 

2. Use standards‐based, data‐driven decision making and 

integrated, differentiated instruction that effectively integrates appropriate technologies and tools and supports the learning of all students.  

4, 6, 7, 

18, 19, 20, 23 

7, 11  12, 18  2, 4, 8, 

9, 10, 13 

4, 5, 6, 

8, 11 

2, 3, 4, 

6, 7, 8, 17 

1, 4, 6, 

10 

1, 2, 

3, 4, 5 

3, 4  4, 6, 7, 8, 

9, 10, 14, 17, 18, 19, 20, 21 

3    2 

19% 

3. Explain the multiple forms of assessment, and use assessment results to inform instructional decision making.  

2, 13, 14, 21, 22 

4  4, 5  5, 6, 10, 12, 14 

3  8, 10  11  7  1, 2, 7  22, 23  1, 2, 3, 4, 5, 6, 7 

1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 

17,18, 19, 20, 21, 22 

19% 

4. Construct well‐organized, positively managed, and safe learning environments that positively impact instructional 

effectiveness and student achievement.  

  2, 10, 15    11  7  18  7, 8  2, 3, 4, 5 

5  2, 3, 11, 12, 13, 14 

    1, 3, 5 

8% 

5. Validate participation in activities that promote continuous professional growth, inquiry, research, and collaboration with 

others to improve student achievement and to maintain the high ethical standards of the teaching profession.  

3, 8, 9, 24, 25, 26 

10, 18  10  3, 14    14  1, 3, 5, 9, 12, 

13, 14 

6  1, 2  2, 3, 5, 16, 25, 26, 27, 

28, 29, 30, 31, 32, 33, 

34 

  1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 

11, 12, 13, 14, 15, 16, 17,18, 19, 20, 21, 22 

21% 

6. Apply knowledge of scientifically based research to plan and deliver instruction in content areas, including reading, language arts, mathematics, science, social studies, fine arts, health, wellness, and physical education, for the purpose of improving the achievement of all students.  

1, 5, 10, 11, 12, 17 

1, 2, 3, 5, 6, 9, 12, 14, 16, 17 

  1  1, 2, 9, 10, 11 

4, 11      8  6       

9%  

 

 

Learner‐Centered 

Assessment 

Page 8: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

8

Learner‐Centered Assessment

“An activity designed by the professor that yields comprehensive information for analyzing, discussing, and judging a learner’s performance on valued abilities and skills” (p. 12)

- Huba & Freed (2000)

Let’s take a poll…

Poll Results 

Page 9: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

9

Benefits of a Learner‐Centered Approach

At the student level:• Students become “active participants rather than

passive consumers of content” (p. 903).- Bayat (2012)

• Learner-centered assessment:- helps students synthesize learning experiences.

- Huba & Freed (2000)

Benefits of a Learner‐Centered Approach

At the institutional level, learner-centered assessment:- promotes high expectations in the learning environment.

- demonstrates respect for diverse talents and learning styles.

- promotes coherence in providing data to improvecurriculum and guide revisions.

- Huba & Freed (2000)

Page 10: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

10

Learner‐Centered Assessment: Two Studies

1. Pre- and Post-Course Self-Evaluation to measure Student Learning Outcomes (SLOs)

2. Peer Review Assessment to measure SLOs

Learner‐Centered Assessment: Study 1 

(Self‐Assessment) 

Page 11: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

11

Self‐AssessmentDefinitions…The involvement of learners in making judgments about their own learning, particularly about their achievements and the outcomes of their learning

- Boud & Falchikov (1989)

…Evaluations learners make about their current knowledge levels or increases in their knowledge levels in a particular domain.

- Sitzman, Ely, Brown, & Bauer (2010)

Benefits of Self‐Assessment

Debate: Are self-assessment results more representative of cognitive or affective learning growth?

Self-assessment can be used as a triangulation technique to supplement information (about student learning) acquired through direct measures.

- Moskal (2010)

Change in students’ psychological perspectives resulting in:• Metacognitive knowledge• Learning constructivism• Development of self-efficacy

- Basnet, Basson, Hobohm, & Cochrane (2012)

Page 12: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

12

Benefits of Self‐Assessment

Self-assessments of knowledge have a critical role in the learning process; learners benefit from having an accurate understanding of their knowledge levels.

- Dunning et al. as cited in Sitzman et al. (2010)

Guiding Questions• What data can we harvest from pre- and post-

course self-evaluations?• How can we graphically show this data?

Page 13: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

13

Research Question• Can self-assessment provide evidence of mastery of

student learning outcomes?

Study 1 Design• Three programs – M. Ed. in Curriculum and

Instruction, Educational Leadership, Educational Technology

• Random term selected from 8 terms in 2013• From the term, 10% of the total number of courses

randomly selected from a numbered course list• Pre- and Post- Self-Evaluations collected and

analyzed from all student sections of selected courses

Page 14: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

14

Study 1 DesignCurriculum & 

Instruction

Educational Leadership Educational Technology

Year 6.3.2013 11.18.2013 4.22.2013

Term (1‐8) 4 8 3

Number of Courses Per Term 

Per Program

8 5 3

Numbers and Titles of 

Courses Per Term

1. CI5033

2. CI5313

3. CI5333

4. CI5353

5. CI5393

6. CI5423

7. CI5453

8. CI5503

1. EL5033

2. EL5623

3. EL5653

4. EL5753

5. EL5903

1.ET5013

2.ET5023

3.ET5033

Randomly Selected Course 

Numbers (10% of total 

courses per selected term)

5. CI5393 2. EL5623 3. ET5033

Number of Sections Per 

Selected Course

2 (56) 5 (153) 1 (30)

Number of Students 

Completing Pre‐ and Post‐

Self‐Evaluations

Pre – 35

Post – 29

Pre – 118

Post – 101

Pre – 22

Post ‐ 21

Data Comparisons: C&I

Page 15: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

15

Data Comparisons: EL

Data Comparisons: ET

Page 16: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

16

Findings• In all selected courses and across programs, students self-

reported significant growth in the acquisition of student learning outcomes when pre- and post- results were compared.

• Across programs, post-course results showed an overwhelming majority of students rating their knowledge level as a 3 or 4.

4-Point Likert Scale1. I am unfamiliar with this concept.2. I have heard of this but need to learn more.3. I am fairly confident in my knowledge of this and can

implement this on my own.4. I can teach or consult with someone else to help them

implement this.

Findings: Item 1 Perceived Growth Comparison

0 20 40 60 80 100 120

Curriculum & Instruction

Educational Leadership

Educational Technology

Post

Pre

Page 17: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

17

Learner‐Centered Assessment: Study 2 

(Peer Assessment) 

Peer AssessmentA method in which students evaluate each other’s work based on set criteria

- Falchikov (2001) & Gouli et al. (2006)

Page 18: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

18

Benefits of Peer Assessment

Peer evaluations help students who are being evaluated by “adding insight of people (fellow students) with different perspectives than their professor.”

“The act of evaluating peer work can strengthen critical thinking skills and help students understand faculty expectations…”

- Suskie & Banta (2009)

Guiding Questions• What is the level of student involvement in the peer

review assessment process?• To what extent are students applying peer

feedback to improve their work prior to final submission?

Page 19: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

19

Research Question• How can peer assessment provide evidence of

student mastery of learning outcomes?

Peer Review Assessment Setting the Stage

• Signature assessments are chosen by department chairs for inclusion in selected courses. - Are assignments appropriate for inclusion in the student’s portfolio?

• All signature assessments are aligned to course objectives and learning outcomes.

Page 20: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

20

Peer Review Assessment Setting the Stage

• Peer review is an interactive capability within the Canvas LMS.

• Currently, 38 courses in master’s programs have signature assessments with a peer review component.

• Peer review is a pre-step to final submission of a signature assessment. The peer review portion of the assignment is non-graded.

• The professor assigns peer review partners in the LMS.• Each student is directed to submit the draft of the

signature assessment for peer review. • Partners review and critique each other’s papers.

Peer Review Assessment Setting the Stage

• Peer review tools:- Rubric aligned to academic outcomes (identical to the rubric the professor uses to grade final signature assessment)

- Comments within each rubric category- Comments in a discussion format – upload of

critique - Tracked changes and comments in document

Page 21: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

21

Evaluation Tools

Study 2 Design• The 38 courses with peer assessments spread across

all master’s degree programs served as the data pool for the study.

• Random term was selected from 8 terms in 2013.• From the total courses with peer reviews, 25% of the

courses were randomly selected.• From the selected courses, 25% of the sections in

the identified term were randomly chosen.• From each identified section, 25% of the students

were randomly chosen.

Page 22: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

22

Study 2 DesignCurriculum & 

Instruction

Educational 

Leadership

Educational 

Leadership (TX)

Core C&I‐

ESL/Bilingual

Totals

Year 6.3.2013 6.3.2013 6.3.2013 6.3.2013 6.3.2013

Term (1‐8) 4 4 4 4 4

Total # of Courses ‐

Peer Assessments

38

Randomly Selected 

Courses (25% of 38 

total courses = 10)

1. CI5333

2. CI5423

1. EL5033 1.EDX5123

2.ELX5623

3.EDX5153

1. ED5153

2. LIT5203

1. BE5013

2. BL5063 (0 

students this 

term)

10

Number of Sections 

Per Selected Course 

(25% of total sections 

per selected course)

1(32)

1(33)

1(31) 1(2)

1(1)

1(15)

1(29)

1(34)

1(29)

0(0)

206

Number of Students 

Randomly Selected 

(25% of total per 

randomly selected 

section)

8

8

8 1

1

4

7

9

7

0

53

Number of Selected 

Students 

Participating in Peer 

Assessment Per 

Course

7/8

8/8

8/8 0/1

0/1

3/4

7/7

8/9

5/7

0

46

Guiding Question 1• What is the level of student involvement in the peer

review assessment process?

Page 23: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

23

Peer Review Level of Involvement (87%)

n = 53 students in sample

46

7

0

5

10

15

20

25

30

35

40

45

50

Participant Non‐Participant

Peer Reviewers Completing Scoring Rubric (85%)

n = 46 participants of the 53 sampled

39

7 7

0

5

10

15

20

25

30

35

40

45

Completed Rubric Did Not Complete

Rubric

Non‐Participants

Page 24: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

24

Peer Reviewers Using Tracked Changes (24%)

n = 46 participants of the 53 sampled

11

35

7

0

5

10

15

20

25

30

35

40

Tracked Changes Did Not Track Non‐Participants

Peer Reviewers Making Rubric‐Related Comments (96%)

n = 46 participants of the 53 sampled

44

2

7

0

5

10

15

20

25

30

35

40

45

50

Made Comment Did Not Comment Non‐Participant

Page 25: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

25

Guiding Question 2• To what extent are students applying peer

feedback to improve their work prior to final submission?

Students Applying Peer Review Feedback Before Final Submission (63%)

n = 46 participants of the 53 sampled

20

9

6

11

7

0

5

10

15

20

25

Applied Feedback Partially Applied

Feedback

Received All

Positive Feedback

Did Not Apply

Feedback

Non‐Participants

Page 26: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

26

Peer Review FeedbackCourse Objective Aligned to Program Outcomes

Identify methods to evaluate learner motivation and characteristics and contextual factors that affect learner motivation. (Instructional Program, Learning Environment)

CI5333 Student Engagement ‐ Assignment Description

In this module’s Application, you will examine and reconstruct an existing curriculum unit through the lens of student engagement and motivation. In the process, you will apply the ARCS Model of Motivation and the TARGET framework. 

You did a great job describing how the ARCS Model of Motivation is incorporated in the unit and what specific modification you would make to improve the unit. I think adding concrete ocean animals would increase the attention of your students. I also like your “frog‐tastic” wall. I think it is a great way to display students work. 

Peer Review FeedbackCourse Objective Aligned to Program Outcomes

Identify methods to evaluate learner motivation and characteristics and contextual factors that affect learner motivation. (Instructional Program, Learning Environment)

CI5333 Student Engagement ‐ Assignment Description

In this module’s Application, you will examine and reconstruct an existing curriculum unit through the lens of student engagement and motivation. In the process, you will apply the ARCS Model of Motivation and the TARGET framework. 

I enjoyed reading about the unit you developed. I also teach Westward Expansion, so it was interesting to read someone elseʹs perspective on teaching the content. I think your unit does focus on increasing intrinsic motivating and engaging students. Your paper was well written, but I think in order to make your points more powerful it would be helpful to incorporate more research. For example, you could cite why your choice of instructional activities are engaging and motivating. Finally, there were some minor APA errors. I have uploaded an edited paper with my formatting changes in red. Thanks! 

Page 27: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

27

Peer Review FeedbackCourse Objective Aligned to Program Outcomes

Explain the characteristics of action research and the process for conducting a research project  (Vision for Learning, Instructional Program)

EDX5153  Research Methods  ‐ Assignment Description

In this module’s Application, you will describe the methodology you will use to collect the data for your study. Your methodology is your data collection plan.

Youʹre introduction definitely addresses a need for literacy improvement and very good use of data to support your need. I would recommend a little more specifics in the questions such as What effective strategies can be used to increase classroom journal writing among low socioeconomic African American students? The journal articles you selected provide good information and are directly linked to your research questions. I would recommend narrowing your focus. There are too many variables to keep track of with three separate strategies. The use of data is a good foundation, perhaps tying the questions together to address a single strategy would be more manageable for the timeframe we are working with.

Peer Review FeedbackCourse Objective Aligned to Program Outcomes

Describe formal and informal assessment procedures and instruments (language proficiency and academic achievement) used in ESL programs (Assessment)

BE5013  Foundations of ESL and Bilingual Education  ‐Assignment Description

In this module, you will continue work on your unit by designing a formative assessment and rubric to measure student performance and an intervention activity for those who do not master an objective outcome for the first time.

I really like your unit.  It seems like you have some great ideas to teach students about immigration.  I had a bit of a hard time getting the full idea of your activity ‐ I think it would be helpful to describe exactly what you are having the students read and answer in the first paragraph.  One other idea ‐perhaps for your intervention, you could have the students complete summary outlines or graphic organizers to go along with the text, as they are reading it. I often find this to be helpful when Iʹm working with students who have difficulty understanding a longer text.  Nice work 

Page 28: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

28

Peer Review FeedbackCourse Objective Aligned to Program Outcomes

Describe formal and informal assessment procedures and instruments (language proficiency and academic achievement) used in ESL programs (Assessment)

BE5013  Foundations of ESL and Bilingual Education  ‐Assignment Description

In this module, you will continue work on your unit by designing a formative assessment and rubric to measure student performance and an intervention activity for those who do not master an objective outcome for the first time.

Also, I think that your intervention is very thoughtful (as to the varying degrees of student participation and abilities). My only question being, are you listing all the students’ similarities and differences on the same chart paper? I feel as though students may wish to compare different cultures than one another (if given the choice). If so, this may get confusing when translating the information from the chart paper onto their individualized Venn Diagrams. For the intervention, if the main goal is to properly complete a Venn diagram by identifying similarities and differences, maybe you could have them vote on one culture they’d like to research/discuss together? This way the information for every Venn Diagram is the same. I hope this makes sense☺ I am truly impressed by your unit! Awesome Job! 

Peer Review Findings

• Peer review is a valuable tool in strengthening the student-centered assessment component of our assessment system.

• Descriptions of 4 tools to be used in the peer review process should be defined in the instructions.

• Criteria for peer review must be well-defined.• The stronger the construction of the criteria, the

more measurable the outcomes.• Criteria should stress key areas of instructional focus.

For example, APA is a college-wide focus, which appeared as a gap in the peer review process.

Page 29: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

29

Overall Findings and Continuous Improvement 

Summary of Learner‐Centered Assessment Studies

• Evidence we have collected thus far indicates that both pre- and post- self-evaluation and peer review are useful as learner-centered assessment approaches.

• Self-Evaluationo Student perceptions indicate that majority of students believe their

knowledge and skills as aligned to program outcomes are increasing.

• Peer Reviewo 87% of students participated in the Peer Review process.o 73% of students used peer review to improve their final submissions.o Students’ written comments are reflective of their knowledge of course

objectives and program outcomes.

Page 30: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

30

Continuous Improvement• How can we maximize the use of learner-centered

assessment? • How can we clearly define the criteria for learner-

centered assessment?• How do learner-centered assessment data

compare among the programs and degree levels?• Triangulation of data sources: What other measures

might be used to strengthen the learner-centered assessment component of the assessment system?

Future Research• Compare learner-centered assessment data across

programs and degree levels.• Examine correlation between student and faculty

ratings of performance on learning outcomes related to learner-centered assessment.

• Examine consistency of APA emphasis across programs and degree levels.

• REMAINING QUESTIONo How do we use the learner-centered assessment data to inform decision-

making about student performance?

Page 31: Learner Centered Assessment in Online Coursesassessmentinstitute.iupui.edu/overview/institute-files/2014... · Assessment in Online Courses ... Design anddeliverinstructionthatisresponsivetostudent

10/29/2014

31

ReferencesBasnet, B., Basson, M., Hobohm, C., & Cochrane, S. (2012). Students’ self-assessment of

assignments: Is it worth it? In Llewellyn Mann(Ed.) & Scott Daniel, (Ed). Profession of Engineering Education: Advancing Teaching, Research and Careers. The 23rd Annual Conference of the Australasian Association for Engineering Education 2012.

Bayat, A., & Naicker, V. (2012). Towards a learner-centered approach: Interactive online peer assessment. South African Journal of Higher Education, 26(5), 891.

Boud, D., & Falchikov, N. (1989). Quantitative studies of student self assessment in highereducation: A critical analysis of findings. Higher Education, 18, 529-549.

Falchikov, N. (2001). Learning together: Peer tutoring in higher education. London:Routledge Falmer.

Gouli, E., Kornilakis, H., Papanikolaou, K., & Grigoriadou, M. (2001). Adaptive assessment improving interaction in an educational hypermedia system. Proceedings of the PanHellenic Conference with International Participation in Human-Computer Interaction, 217-222.

Huba, M. E., & Freed, J. E. (2010). Learner-centered assessment on college campuses: Shifting the focus from teaching to learning. Needham Heights, MA: Allyn & Bacon.

Moskal, B. M. (2010). Self-assessments: What are their valid uses? Academy of Management Learning & Education, 9(2), 314-320. DOI:10.5465/AMLE.2010.51428553. ,

Sitzman, T., Ely, K., Brown, K. G., & Bauer, K. (2010). Self-assessment of knowledge: A cognitive learning or affective measure? Academy of Management Learning & Education, 9(2), 169-191. DOI: 10.5465/AMLE.2010.51428542.

Susie, L., & Banta, T. (2009). Assessing student learning: A commonsense guide (2nd ed.), San Francisco, CA: Jossey-Bass.

QuestionsQuestions?

Contact Information:Alana Sloan

[email protected]

Shawntel Landry [email protected]


Recommended