Difference between revisions of "Moderated Assessments"

From RCampus Wiki
Jump to: navigation, search
m
m
 
(2 intermediate revisions by the same user not shown)
Line 4: Line 4:
 
== Purpose and Benefits: ==
 
== Purpose and Benefits: ==
  
* Consolidating Perspectives:
+
* '''Consolidating Perspectives:''' Moderated assessments enable the consolidation of different viewpoints, which can promote a more holistic and balanced evaluation.
Moderated assessments enable the consolidation of different viewpoints, which can promote a more holistic and balanced evaluation.
 
  
* Ensuring Consistency:
+
* '''Ensuring Consistency:''' The involvement of assessors helps maintain consistency in the interpretation of assessment results, minimizing discrepancies.
The involvement of assessors helps maintain consistency in the interpretation of assessment results, minimizing discrepancies.
 
  
* Quality Assurance:
+
* '''Quality Assurance:''' The final decision made by moderators serves as a quality assurance measure, ensuring that the assessment outcomes align with established standards defined in the rubric.  It also ensures all raters have the same understanding of the underlying assessment criteria defined in the rubric.
The final decision made by moderators serves as a quality assurance measure, ensuring that the assessment outcomes align with established standards defined in the rubric.  It also ensures all raters have the same understanding of the underlying assessment criteria defined in the rubric.
 
  
* Fairness and Transparency:
+
* '''Fairness and Transparency:''' The process underscores fairness and transparency, as it involves a thorough examination of varied ratings before reaching a conclusive decision.
The process underscores fairness and transparency, as it involves a thorough examination of varied ratings before reaching a conclusive decision.
 
  
  
 
==Key Elements:==
 
==Key Elements:==
  
* Initial Assessments:  
+
* '''Initial Assessments:''' Multiple raters perform the initial assessments while iRubric records their assessments results and comments.
Multiple raters perform the initial assessments while iRubric records their assessments results and comments.
+
* '''Final Review Process:''' Moderators examine the assessment results by multiple raters in an easy-to-use display and make the final decision.
 
 
* Final Review Process:
 
Moderators examine the assessment results by multiple raters in an easy-to-use display and make the final decision.
 
  
  
Line 30: Line 23:
 
Following focuses on the additional steps beyond regular assessments:
 
Following focuses on the additional steps beyond regular assessments:
  
=== For facilitators ===
+
=== For Facilitators ===
  
 
# Setup an iRubric Rapid assessment and assign evaluators.
 
# Setup an iRubric Rapid assessment and assign evaluators.
 
 
# In the assessment settings are, select '''assign moderators'''.
 
# In the assessment settings are, select '''assign moderators'''.
 
 
# Set the assessment to "Moderated", select moderators and press Save.
 
# Set the assessment to "Moderated", select moderators and press Save.
  
Line 47: Line 38:
  
 
# Open the assessment list and click on "moderate" for each item.
 
# Open the assessment list and click on "moderate" for each item.
 +
# Review initial assessments on the easy-to-use screen and select the final decision.  iRubric automatically selects final decisions for unanimous initial ratings.
 +
# Save the final assessment and continue to next.
 +
 +
 +
== See also ==
 +
*[[IRubric|iRubric Assessment System]]
 +
*[[Collaborative_assessment_with_rubrics|Collaborative/Juried Assessments]]
 +
*[[RCampus - Enterprise Edition]]
 +
  
# Review initial assessments on the easy-to-use screen and select the final decision.  iRubric automatically selects final decisions for unanimous initial ratings.
 
  
# Save the final assessment and continue to next.
+
[[Category:Rubrics]]
 +
[[Category:Reports]]

Latest revision as of 19:07, 11 January 2024

A moderated assessment is a thorough and collaborative process where one or more assessors take on the responsibility of examining the assessments that have been performed by multiple raters and deciding on a single final assessment result. This approach ensures a comprehensive and fair evaluation by consolidating the judgments of initial raters and adds an extra layer of assurance and reliability to the evaluation process. It also aligns with the commitment to delivering accurate and meaningful assessment results to support student success and academic excellence.


Purpose and Benefits:

  • Consolidating Perspectives: Moderated assessments enable the consolidation of different viewpoints, which can promote a more holistic and balanced evaluation.
  • Ensuring Consistency: The involvement of assessors helps maintain consistency in the interpretation of assessment results, minimizing discrepancies.
  • Quality Assurance: The final decision made by moderators serves as a quality assurance measure, ensuring that the assessment outcomes align with established standards defined in the rubric. It also ensures all raters have the same understanding of the underlying assessment criteria defined in the rubric.
  • Fairness and Transparency: The process underscores fairness and transparency, as it involves a thorough examination of varied ratings before reaching a conclusive decision.


Key Elements:

  • Initial Assessments: Multiple raters perform the initial assessments while iRubric records their assessments results and comments.
  • Final Review Process: Moderators examine the assessment results by multiple raters in an easy-to-use display and make the final decision.


iRubric Setup:

Following focuses on the additional steps beyond regular assessments:

For Facilitators

  1. Setup an iRubric Rapid assessment and assign evaluators.
  2. In the assessment settings are, select assign moderators.
  3. Set the assessment to "Moderated", select moderators and press Save.

For Evaluators

Evaluators perform the initial assessments similar to any collaborative/juried assessment.

For Moderators

After initial assessments are completed, moderators can do the following:

  1. Open the assessment list and click on "moderate" for each item.
  2. Review initial assessments on the easy-to-use screen and select the final decision. iRubric automatically selects final decisions for unanimous initial ratings.
  3. Save the final assessment and continue to next.


See also