Difference between revisions of "Moderated Assessments"

From RCampus Wiki
Jump to: navigation, search
m
Line 19: Line 19:
 
==Key Elements:==
 
==Key Elements:==
  
# Initial Assessments:  
+
* Initial Assessments:  
 
Multiple raters perform the initial assessments while iRubric records their assessments results and comments.
 
Multiple raters perform the initial assessments while iRubric records their assessments results and comments.
  
# Final Review Process:
+
* Final Review Process:
 
Moderators examine the assessment results by multiple raters in an easy-to-use display and make the final decision.
 
Moderators examine the assessment results by multiple raters in an easy-to-use display and make the final decision.
 +
  
 
== iRubric Setup: ==
 
== iRubric Setup: ==

Revision as of 18:59, 11 January 2024

A moderated assessment is a thorough and collaborative process where one or more assessors take on the responsibility of examining the assessments that have been performed by multiple raters and deciding on a single final assessment result. This approach ensures a comprehensive and fair evaluation by consolidating the judgments of initial raters and adds an extra layer of assurance and reliability to the evaluation process. It also aligns with the commitment to delivering accurate and meaningful assessment results to support student success and academic excellence.


Purpose and Benefits:

  • Consolidating Perspectives:

Moderated assessments enable the consolidation of different viewpoints, which can promote a more holistic and balanced evaluation.

  • Ensuring Consistency:

The involvement of assessors helps maintain consistency in the interpretation of assessment results, minimizing discrepancies.

  • Quality Assurance:

The final decision made by moderators serves as a quality assurance measure, ensuring that the assessment outcomes align with established standards defined in the rubric. It also ensures all raters have the same understanding of the underlying assessment criteria defined in the rubric.

  • Fairness and Transparency:

The process underscores fairness and transparency, as it involves a thorough examination of varied ratings before reaching a conclusive decision.


Key Elements:

  • Initial Assessments:

Multiple raters perform the initial assessments while iRubric records their assessments results and comments.

  • Final Review Process:

Moderators examine the assessment results by multiple raters in an easy-to-use display and make the final decision.


iRubric Setup:

Following focuses on the additional steps beyond regular assessments:

For facilitators

  1. Setup an iRubric Rapid assessment and assign evaluators.
  1. In the assessment settings are, select assign moderators.
  1. Set the assessment to "Moderated", select moderators and press Save.

For Evaluators

Evaluators perform the initial assessments similar to any collaborative/juried assessment.

For Moderators

After initial assessments are completed, moderators can do the following:

  1. Open the assessment list and click on "moderate" for each item.
  1. Review initial assessments on the easy-to-use screen and select the final decision. iRubric automatically selects final decisions for unanimous initial ratings.
  1. Save the final assessment and continue to next.