RUBRICS: BUILDING, GRADING, AND PROVIDING TARGETED FEEDBACK TO STUDENTS
(BLACKBOARD AND TURNITIN)
CPS FACULTY CONFERENCE 2018
2
AQA Director, Assessment: Dr. Mamta SaxenaAssociate Director, Assessment: Melanie Kasparian
Instructional Designer: Donna DiGiovanniCPS Faculty: Dr. Hattie Hammonds
3
4
• Collect data about program outcomes to inform the teaching and learning at the program level
• Promote a culture of assessment and inquiry to achieve college and program goals and mission
• Provide a shared understanding of good assessment practices
Annual Report Stages
IV: Act I: Define
III: Analyze II: Collect
AQA Mission and Goals
How Can We Help You?
Program Evaluation
Data Collection
Assessment Cycle
5
Assessment Support• Developing Learning
Outcomes• Crafting Assignments• Capstone Experiences• Assessment Measurement
AND…
Workshop Outcomes
At the end of the workshop, you will be able to:
• Build rubrics in Blackboard and Turnitin
• Grade with rubrics in Blackboard and Turnitin
• Offer targeted feedback using rubrics
• Download and interpret Rubric Evaluation Reports and data ONLY for Blackboard rubrics
6
Questions
• How many of you are familiar with rubrics?
• How many of you use or have used rubrics in your class?
• What are some ways you currently use rubrics?
• What were some of the challenges you faced when using rubrics?
7
RUBRICS: QUICK REFRESHER
CPS FACULTY CONFERENCE 2018
8
CPS Rubrics Framework
9
VALUE Rubrics accessed by:
42,000 individuals
4,200 unique institutions
2,800 colleges and universities.
Maintaining Course Alignment via Rubrics
10
Assessments
Outcomes Activities
What kind of tasks will show if students have achieved the
identified outcomes?
What do we want students to be able to
do when they complete the course?
What kind of activities will reinforce the
learning outcomes and prepare students for
assessments?
Using Rubrics
A rubric is an assessment tool that uses clearly specified
criteria and proficiency levels to measure or
judge student achievement or mastery of a given task or skills
11
Why Use Rubrics?
Spells out Expectations
Helps scaffold learning
Informs students on
performance
Reinforces adherence to
learning
Makes grading
more transparent
Makes grading more
consistent
12
Elements of a Rubric
13
RUBRICS: BUILDING IN BLACKBOARD
CPS FACULTY CONFERENCE 2018
14
Create a Blackboard Rubric
15
Spend time writing useful feedback for each cell.
Create a Blackboard Rubric
16
Associate Rubric with a Gradable Item
17
RUBRICS: GRADING IN BLACKBOARD
CPS FACULTY CONFERENCE 2018
18
Grade using a Rubric
19
Grade using a Rubric
Click this icon to view the rubric in a separate window
20
21
Grade Center with Rubric Grade
22
23
My Grades Student View
RUBRICS: REPORTS FOR BLACKBOARD RUBRICS
CPS FACULTY CONFERENCE 2018
24
25
Rubric Evaluation Reports
26
Sample Rubric Report
72% of students exemplified strong analysis and evaluation (meets or above standards).
Sample Data
27
38%
17%
68%
12%
0% 20% 40% 60% 80%
Business Knowledge
Research Competency
Teamwork
Ethics
Meeting Learning Outcomes
Percent ofStudents at aCompetencyLevel
Goal: 65%
Resources & Support
Rubrics Repository: For trainings, please watch the following videos:Building and Using RubricsExporting and Importing Rubrics
Rubrics Module, Webinars & Best Practices Guide: Coming soon!
IRC Training, December 3rd at 12:15-1:[email protected] as the registration contact: http://www.northeastern.edu/nuolirc/events/grading-with-rubrics-tips-and-best-practices/
Center for Advancing Teaching and Learning Through Research: CATLR Workshops
Support:• Program Manager• Instructional Designer• Assessment Support, AQA
28
RUBRICS: BUILDING & GRADING IN TURNITINFACULTY PERSPECTIVE
CPS FACULTY CONFERENCE 2018
29
Why use Turnitin for building rubrics or grading assignments?
1. Papers are already submitted for plagiarism.2. Rubrics can be built in the same location where you
check student papers for plagiarism.3. No need to download paper, save, track changes, save
again and upload to Grade Center.4. Comments/feedback can be made directly in a student’s
paper using Quickmarks or a comment bubble.5. Grades in TurnItIn can be synched to Grade Center;
there is no need to input manually.
30
Building Rubrics with Turnitin
31
Select the week that you want to place the
TurnItIn assignment in
Building Rubrics with Turnitin
32
Click on “Assessments” and scroll down and
select “TurnItInAssignment”
Building Rubrics with Turnitin
33
Now you are on the screen where you can
create a TurnItInAssignment
Building Rubrics with Turnitin
34
Set your assignment’s “Start Date”, “Due Date”
and “Post Date” (the date you want this
assignment’s grades to be available to students
in TurnItIn)
Click on “Optional Settings” to locate the place where you can
build a rubric
Create an Assignment name
and give the maximum points allowed on the
assignment
Building Rubrics with Turnitin
35
Decide if you want students to turn in assignments late
Decide if you want to see how similar your students’ papers are to other sources and
whether you want students to see that
information
Decide if you want to exclude references
and quotes from being screened for
plagiarism
Building Rubrics with Turnitin
36
Most of the choices on this screen are pre-selected; you
can change if desired
Building Rubrics with Turnitin
37
Launch the Rubric/Form
Manager to start building your TurnItIn rubric
Building Rubrics with Turnitin
38
This is what your blank rubric will look like.
1. Name your rubric. 2. Decide what criterion
you want to evaluate and the percentage each criterion counts. You can add criterion by clicking on the “+” sign. Criterion percentages must equal 100%.
3. Select the scales/grades that correspond with
your criterion. You can add criterion
and scales by clicking on the “plus signs”.
Building Rubrics with Turnitin
39
1. This is an example of a rubric I used last quarter in EDU 7214.
2. Pay particular attention to the scales and grades that you use…this will affect the grade that students receive if the scales are too high/low.
Building Rubrics with Turnitin
40
Once you build the rubric, select it for the assignment you are grading. Go to the bottom of the screen and submit your choice.
Building Rubrics with Turnitin
41
If you’ve done everything correctly, then this is the screen you should see.
Building Rubrics with Turnitin
42
This is what students will see when they go to
submit their assignment to
TurnItIn
Building Rubrics with Turnitin
43
This page shows that the Practice Assignment was 17% similar to other sources, was submitted on-time and is ready to grade with the rubric you created.
Building Rubrics with Turnitin
44
This is a breakdown of the sources that made up the 17% similarity.
Building Rubrics with Turnitin
45
While you’re evaluating a student’s paper in TurnItIn, you can put commonly used Quickmarkssuch as C/S (comma splice), Frag (fragment). You can also add your own Quickmarks.
Building Rubrics with Turnitin
46
Building Rubrics with Turnitin
47
Once you’re done reading and typing comments or putting in Quickmarks, then you click on this button to use the rubric you created to grade the paper. After inputting the scores that you desire, click “Submit”.
Building Rubrics with Turnitin
48
The grade you gave on the rubric now appears on the main assignment page.
In order to get the grade from TurnItIn into Blackboard’s Grade Center, click on “Roster Sync” and the grade will transfer automatically.
Questions???
Contact InformationDr. Hattie Hammonds
LecturerNortheastern University
(I reside in NC and am a full-time teacher, so responses will be after 3:00 pm most days).
49
Pros and Cons: BB vs. Turnitin Rubrics
50
Blackboard Rubrics • Connects to any grade center column, in
particular Assignment items
• Can use points, weights, or ranges
• Autograded
• Can provide feedback within each cell
• Data shows overall and row-level rubric scores
• Data is presented for overall class, not by individual student
• Can edit rubrics in section and import/export to other sections
Recommendation: • Use BB rubrics for summative, final grading and Turnitin for formative feedback and plagiarism
check. If you use Turnitin for summative, you can attach the rubric to the grade center column and use that to grade.
• If you teach a course that has a signature assignment for a program student learning outcome measure, you MUST use the Blackboard rubrics.
Turitin Rubrics • Grading occurs in same place as paper if
Turnitin item is created and graded
• Can use weights or points
• Autograded
• Can provide feedback within each cell, and within line of paper
• Data shows overall and row-level rubric scores
• Data is presented for overall class, and by individual student
• Editing has restrictions as rubric lives with Turnitin account user
Allan, J. (1996). Learning outcomes in higher education. Studies in Higher Education, 21(1) 93-108.
Anderson, L.W., Krathwohl, D.R. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s Taxonomy of educational objectives. New York: Longman.
Brady, L. (1996). Outcome-based education: A critique. The Curriculum Journal, 7(1): 5-16.
Driscoll, A., & Wood, S. (2007). Developing Outcomes-based assessment for learner-centerededucation: A faculty introduction. Sterling, VA: Stylus.
Jonassen, D. H. (1997). Instructional design models for well-structured and ill-structured problem-solving learning outcomes. Educational Technology: Research and Development, 45(1), 65-94.
Wiggins, G. P. (1998). Educative assessment: Designing assessment to inform and improve student performance. San Francisco, CA: Jossey-Bass A Wiley Imprint.
Maki, P.L. (2017). Real-time student assessment: Meeting the imperative for improved time to degree, closing the opportunity gap, and assuring student competencies for 21rst century. Sterling, VA: Stylus.
References
51