Page 74 - JRCERT Update Articles
P. 74
JRCERT Update
identified. For example, if students were assigned a Box 1
research paper, the rubric would address factors such Steps in Developing a Rubric
as the number of references used, whether they were Define purpose of assignment or assessment.
applied appropriately in paraphrases and quotes, and Determine whether the rubric should be holistic or analytic.
whether the citations were properly formatted.
Define the criterion.
Determine the rating scale.
Rubric Benefits Write descriptors for each level of the rating scale.
The holistic rubric scoring method provides expedited Trial the rubric on sample work.
grading, yet this single score might not provide clear Reflect and revise the rubric as necessary.
information about where or how students can improve.
3
In contrast, the analytical rubric provides a focused Box 2
and detailed assessment of each criterion, which offers Suggestions for Rubric Development
students feedback about their strengths and weaknesses
on each component. An example of an analytical rubric Base criterion on student learning outcomes.
3
Limit rating scales to 3 to 5 quantifiers.
component is the use of a point scale to grade compre- Solicit student and colleague feedback.
hension of directions for writing research papers, which Ensure clarity, especially if multiple individuals will be
requires applying numerous citations. A student who applying the rubric.
submits a paper and follows the directions by using 3 ref- Provide training in application to increase inter-rater reliability.
erences and paraphrasing from other sources will receive Review and revise periodically.
more points than a student who uses 1 reference and pro-
vides direct quotes rather than paraphrasing the material. Table 1
Using holistic or analytical rubrics can provide Template for Holistic Rubric
students with effective feedback and aid in providing Criterion Rating
comprehension and acceptable performance for given Scale Level Performance Descriptors
tasks. Providing rubrics before the assignment enables 1 Descriptor of performance at level 1
3
students to better understand how their performance
will meet each criterion for the tasks or assignments, 2 Descriptor of performance at level 2
which allows them to take steps to ensure the quality of 3 Descriptor of performance at level 3
their work. Rubrics are formative assessment tools, pro-
vide constructive feedback for students to identify areas Before creating a rubric, faculty should determine
that need improvement, and provide equitable, fair, and the purpose of the assignment (see Box 2). To deter-
transparent grades. 3 mine the purpose and whether the holistic or analytical
rubric approach is more appropriate, instructors should
Developing a Rubric consider the following questions:
Rubric construction requires reflection and col- Will the rubric measure students’ progress on a
laboration and provides students with feedback and learning objective?
measures student learning (see Box 1). Rubrics can be Will the rubric assess a capstone project that
created with pencil and paper or electronically. Two evaluates level of competency?
websites, iRubric and RubiStar, provide free rubric The holistic rubric is simpler during the develop-
development. Other rubrics are available that have been ment phase because it requires fewer criteria. The
tested and are modifiable. The American Association holistic rubric enables the evaluator to assess student
of Colleges and Universities provides a variety of Valid work or performance with a broad scope and make an
Assessment of Learning in Undergraduate Education, overall judgment (eg, pass or fail).
commonly referred to as VALUE, rubrics that are avail- The first step in rubric development is to deter-
able online. mine the number of quantifiers for the rating scale. In
RADIOLOGIC TECHNOLOGY, November/December 2020, Volume 92, Number 2 211
Reprinted with permission from the American Society of Radiologic Technologists for educational purposes. ©2019. All rights reserved.