Difference between revisions of "Moderated Assessments"

From RCampus Wiki
Jump to: navigation, search
Line 1: Line 1:
 
A moderated assessment is a thorough and collaborative process where one or more assessors take on the responsibility of examining the assessments that have been performed by multiple raters and deciding on a single final assessment result. This approach ensures a comprehensive and fair evaluation by consolidating the judgments of initial raters and adds an extra layer of assurance and reliability to the evaluation process. It also aligns with the commitment to delivering accurate and meaningful assessment results to support student success and academic excellence.
 
A moderated assessment is a thorough and collaborative process where one or more assessors take on the responsibility of examining the assessments that have been performed by multiple raters and deciding on a single final assessment result. This approach ensures a comprehensive and fair evaluation by consolidating the judgments of initial raters and adds an extra layer of assurance and reliability to the evaluation process. It also aligns with the commitment to delivering accurate and meaningful assessment results to support student success and academic excellence.
 +
 +
 +
== Purpose and Benefits: ==
 +
 +
* Consolidating Perspectives:
 +
Moderated assessments enable the consolidation of different viewpoints, which can promote a more holistic and balanced evaluation.
 +
 +
* Ensuring Consistency:
 +
The involvement of assessors helps maintain consistency in the interpretation of assessment results, minimizing discrepancies.
 +
 +
* Quality Assurance:
 +
The final decision made by moderators serves as a quality assurance measure, ensuring that the assessment outcomes align with established standards defined in the rubric.  It also ensures all raters have the same understanding of the underlying assessment criteria defined in the rubric.
 +
 +
* Fairness and Transparency:
 +
The process underscores fairness and transparency, as it involves a thorough examination of varied ratings before reaching a conclusive decision.
 +
  
 
==Key Elements:==
 
==Key Elements:==
  
=== Initial Assessments: ===
+
# Initial Assessments:  
 
Multiple raters perform the initial assessments while iRubric records their assessments results and comments.
 
Multiple raters perform the initial assessments while iRubric records their assessments results and comments.
  
=== Final Review Process: ===
+
# Final Review Process:
 
Moderators examine the assessment results by multiple raters in an easy-to-use display and make the final decision.
 
Moderators examine the assessment results by multiple raters in an easy-to-use display and make the final decision.
  
== Purpose and Benefits: ==
+
== iRubric Setup: ==
 +
 
 +
Following focuses on the additional steps beyond regular assessments:
 +
 
 +
=== For facilitators ===
 +
 
 +
# Setup an iRubric Rapid assessment and assign evaluators.
 +
 
 +
# In the assessment settings are, select '''assign moderators'''.
 +
 
 +
# Set the assessment to "Moderated", select moderators and press Save.
 +
 
 +
=== For Evaluators ===
 +
 
 +
Evaluators perform the initial assessments similar to any collaborative/juried assessment.
 +
 
 +
=== For Moderators ===
  
=== Consolidating Perspectives:===
+
After initial assessments are completed, moderators can do the following:
Moderated assessments enable the consolidation of different viewpoints, which can promote a more holistic and balanced evaluation.
 
  
=== Ensuring Consistency: ===
+
# Open the assessment list and click on "moderate" for each item.
The involvement of assessors helps maintain consistency in the interpretation of assessment results, minimizing discrepancies.
 
  
=== Quality Assurance:===
+
# Review initial assessments on the easy-to-use screen and select the final decision.  iRubric automatically selects final decisions for unanimous initial ratings.
The final decision made by moderators serves as a quality assurance measure, ensuring that the assessment outcomes align with established standards defined in the rubricIt also ensures all raters have the same understanding of the underlying assessment criteria defined in the rubric.
 
  
=== Fairness and Transparency:===
+
# Save the final assessment and continue to next.
The process underscores fairness and transparency, as it involves a thorough examination of varied ratings before reaching a conclusive decision.
 

Revision as of 17:07, 9 January 2024

A moderated assessment is a thorough and collaborative process where one or more assessors take on the responsibility of examining the assessments that have been performed by multiple raters and deciding on a single final assessment result. This approach ensures a comprehensive and fair evaluation by consolidating the judgments of initial raters and adds an extra layer of assurance and reliability to the evaluation process. It also aligns with the commitment to delivering accurate and meaningful assessment results to support student success and academic excellence.


Purpose and Benefits:

  • Consolidating Perspectives:

Moderated assessments enable the consolidation of different viewpoints, which can promote a more holistic and balanced evaluation.

  • Ensuring Consistency:

The involvement of assessors helps maintain consistency in the interpretation of assessment results, minimizing discrepancies.

  • Quality Assurance:

The final decision made by moderators serves as a quality assurance measure, ensuring that the assessment outcomes align with established standards defined in the rubric. It also ensures all raters have the same understanding of the underlying assessment criteria defined in the rubric.

  • Fairness and Transparency:

The process underscores fairness and transparency, as it involves a thorough examination of varied ratings before reaching a conclusive decision.


Key Elements:

  1. Initial Assessments:

Multiple raters perform the initial assessments while iRubric records their assessments results and comments.

  1. Final Review Process:

Moderators examine the assessment results by multiple raters in an easy-to-use display and make the final decision.

iRubric Setup:

Following focuses on the additional steps beyond regular assessments:

For facilitators

  1. Setup an iRubric Rapid assessment and assign evaluators.
  1. In the assessment settings are, select assign moderators.
  1. Set the assessment to "Moderated", select moderators and press Save.

For Evaluators

Evaluators perform the initial assessments similar to any collaborative/juried assessment.

For Moderators

After initial assessments are completed, moderators can do the following:

  1. Open the assessment list and click on "moderate" for each item.
  1. Review initial assessments on the easy-to-use screen and select the final decision. iRubric automatically selects final decisions for unanimous initial ratings.
  1. Save the final assessment and continue to next.