Difference between revisions of "Co-Evaluation"
From RCampus Wiki
| Line 40: | Line 40: | ||
'''Q: Can two evaluators score the same criterion?''' | '''Q: Can two evaluators score the same criterion?''' | ||
| − | A: No. Once a criterion is scored and saved by one evaluator, it becomes locked to others. | + | *A: No. Once a criterion is scored and saved by one evaluator, it becomes locked to others. |
'''Q: Can evaluators change their own input after saving?''' | '''Q: Can evaluators change their own input after saving?''' | ||
| − | A: Yes, evaluators can revise their own input until the rubric is finalized. After finalization, editability depends on the system’s configuration. | + | *A: Yes, evaluators can revise their own input until the rubric is finalized. After finalization, editability depends on the system’s configuration. |
'''Q: What if a criterion is left blank?''' | '''Q: What if a criterion is left blank?''' | ||
| − | A: The rubric cannot be finalized until all criteria are scored. Incomplete rubrics remain in draft mode. | + | *A: The rubric cannot be finalized until all criteria are scored. Incomplete rubrics remain in draft mode. |
'''Q: Who can finalize the rubric?''' | '''Q: Who can finalize the rubric?''' | ||
| − | A: Any evaluator can finalize the rubric once all rows are completed. Finalization compiles all scores and feedback into a single evaluation record. | + | *A: Any evaluator can finalize the rubric once all rows are completed. Finalization compiles all scores and feedback into a single evaluation record. |
'''Q: Can evaluators see each other’s feedback and scores?''' | '''Q: Can evaluators see each other’s feedback and scores?''' | ||
| − | A: Yes, once a criterion is saved, its input becomes visible to other evaluators. The visibility of evaluator names depends on anonymity settings. | + | *A: Yes, once a criterion is saved, its input becomes visible to other evaluators. The visibility of evaluator names depends on anonymity settings. |
'''Q: What does anonymity control?''' | '''Q: What does anonymity control?''' | ||
| − | A: Anonymity settings determine whether evaluator names are shown to each other. When enabled, evaluators remain anonymous to each other but are still identifiable to facilitators. | + | *A: Anonymity settings determine whether evaluator names are shown to each other. When enabled, evaluators remain anonymous to each other but are still identifiable to facilitators. |
'''Q: Do evaluators see the full rubric?''' | '''Q: Do evaluators see the full rubric?''' | ||
| − | A: Yes. All evaluators always see the full rubric layout, including criteria, descriptions, and scoring options. | + | *A: Yes. All evaluators always see the full rubric layout, including criteria, descriptions, and scoring options. |
'''Q: Who creates the rubric?''' | '''Q: Who creates the rubric?''' | ||
| − | A: Rubrics are typically created by institutional leads, program coordinators, or designated assessment designers—not by the evaluators themselves. | + | *A: Rubrics are typically created by institutional leads, program coordinators, or designated assessment designers—not by the evaluators themselves. |
'''Q: Can the rubric be used without student submissions?''' | '''Q: Can the rubric be used without student submissions?''' | ||
| − | A: Yes. Co-Evaluation Mode supports evaluations linked to topics, documents, or matrix cells, and does not require a student artifact. | + | *A: Yes. Co-Evaluation Mode supports evaluations linked to topics, documents, or matrix cells, and does not require a student artifact. |
'''Q: Can evaluators provide feedback?''' | '''Q: Can evaluators provide feedback?''' | ||
| − | A: Yes. Feedback can be entered per criterion as well as overall. Plain text and rich-media (e.g., audio, images, video) are supported. | + | *A: Yes. Feedback can be entered per criterion as well as overall. Plain text and rich-media (e.g., audio, images, video) are supported. |
'''Q: Are timestamps and attribution tracked?''' | '''Q: Are timestamps and attribution tracked?''' | ||
| − | A: Yes. The system records who entered what, and when, including timestamps for transparency and reporting. | + | *A: Yes. The system records who entered what, and when, including timestamps for transparency and reporting. |
'''Q: What happens after finalization?''' | '''Q: What happens after finalization?''' | ||
| − | A: The finalized rubric is stored as a completed evaluation. Depending on configuration, it may become read-only or remain editable under specific conditions. | + | *A: The finalized rubric is stored as a completed evaluation. Depending on configuration, it may become read-only or remain editable under specific conditions. |
'''Q: Can Co-Evaluation be used for accreditation or compliance reporting?''' | '''Q: Can Co-Evaluation be used for accreditation or compliance reporting?''' | ||
| − | A: Yes. Co-Evaluation Mode is suitable for internal assessments, program reviews, accreditation evidence collection, and more. | + | *A: Yes. Co-Evaluation Mode is suitable for internal assessments, program reviews, accreditation evidence collection, and more. |
'''Q: Can facilitators override evaluator input?''' | '''Q: Can facilitators override evaluator input?''' | ||
| − | A: If configured, facilitators may unlock, override, or reassign specific criteria before or after finalization. | + | *A: If configured, facilitators may unlock, override, or reassign specific criteria before or after finalization. |
Revision as of 01:21, 9 July 2025
Contents
Co-Evaluation Mode
Co-Evaluation Mode enables multiple evaluators to collaboratively complete a single rubric evaluation, where each evaluator selects and scores the criteria they wish to assess. It is designed to support flexible, distributed evaluation by multiple raters.
Key Concepts
- A single rubric is evaluated collectively by multiple evaluators.
- Each evaluator selects and completes any criteria they are qualified to assess.
- The rubric is shared in real-time, with saved entries visible to others depending on settings.
- Co-Evaluation can be conducted synchronously or asynchronously.
Workflow
- Evaluators access the shared rubric and evaluate different criteria.
- For each criterion, evaluators enter a score and optional feedback (text and/or rich-media).
- As evaluators save their entries, their input updates the cumulative rubric.
- Once all criteria are completed, any evaluator can save the rubric as the final evaluation.
Visibility and Anonymity
- All evaluators can view the full rubric at all times.
- Evaluator input (scores and feedback) becomes visible to others upon saving a criterion.
Feedback Support
- Evaluators can provide:
- Feedback for each individual criterion.
- Overall feedback for the entire rubric.
- Feedback may include plain text or rich-media (e.g., images, video, audio).
Finalization
- The rubric is considered near-complete when all criteria have been evaluated.
- Any evaluator can trigger the final save, saving the completed evaluation.
Reporting and Audit
- All evaluator inputs are tracked with timestamps.
- Finalized evaluations include a record of who completed each criterion.
- Anonymity settings are respected in all reports and displays.
FAQ
Q: Do evaluators have to wait for others to finish?
- A: No. Co-Evaluation can be performed either synchronously or asynchronously. Evaluators may work at the same time or at different times. Saved inputs become visible based on system refresh or user actions.
Q: Can two evaluators score the same criterion?
- A: No. Once a criterion is scored and saved by one evaluator, it becomes locked to others.
Q: Can evaluators change their own input after saving?
- A: Yes, evaluators can revise their own input until the rubric is finalized. After finalization, editability depends on the system’s configuration.
Q: What if a criterion is left blank?
- A: The rubric cannot be finalized until all criteria are scored. Incomplete rubrics remain in draft mode.
Q: Who can finalize the rubric?
- A: Any evaluator can finalize the rubric once all rows are completed. Finalization compiles all scores and feedback into a single evaluation record.
Q: Can evaluators see each other’s feedback and scores?
- A: Yes, once a criterion is saved, its input becomes visible to other evaluators. The visibility of evaluator names depends on anonymity settings.
Q: What does anonymity control?
- A: Anonymity settings determine whether evaluator names are shown to each other. When enabled, evaluators remain anonymous to each other but are still identifiable to facilitators.
Q: Do evaluators see the full rubric?
- A: Yes. All evaluators always see the full rubric layout, including criteria, descriptions, and scoring options.
Q: Who creates the rubric?
- A: Rubrics are typically created by institutional leads, program coordinators, or designated assessment designers—not by the evaluators themselves.
Q: Can the rubric be used without student submissions?
- A: Yes. Co-Evaluation Mode supports evaluations linked to topics, documents, or matrix cells, and does not require a student artifact.
Q: Can evaluators provide feedback?
- A: Yes. Feedback can be entered per criterion as well as overall. Plain text and rich-media (e.g., audio, images, video) are supported.
Q: Are timestamps and attribution tracked?
- A: Yes. The system records who entered what, and when, including timestamps for transparency and reporting.
Q: What happens after finalization?
- A: The finalized rubric is stored as a completed evaluation. Depending on configuration, it may become read-only or remain editable under specific conditions.
Q: Can Co-Evaluation be used for accreditation or compliance reporting?
- A: Yes. Co-Evaluation Mode is suitable for internal assessments, program reviews, accreditation evidence collection, and more.
Q: Can facilitators override evaluator input?
- A: If configured, facilitators may unlock, override, or reassign specific criteria before or after finalization.
