Co-Evaluation
Contents
Co-Evaluation Mode
Co-Evaluation Mode enables multiple evaluators to collaboratively complete a single rubric evaluation, where each evaluator selects and scores the criteria they wish to assess. It is designed to support flexible, distributed evaluation by a team, without predefined assignments.
Key Concepts
- A single rubric is evaluated collectively by multiple evaluators.
- Evaluators are not pre-assigned to specific criteria.
- Each evaluator selects and completes any criteria they are qualified to assess.
- The rubric is shared in real-time, with saved entries visible to others depending on settings.
- Co-Evaluation can be conducted synchronously or asynchronously.
Workflow
- A rubric is created and enabled for Co-Evaluation mode by the institution, program, or assessment designer.
- Evaluators access the shared rubric and select any number of criteria to evaluate.
- For each criterion, evaluators enter a score and optional feedback (text and/or rich-media).
- As evaluators save their entries, their input becomes visible to others according to anonymity settings.
- Once all criteria are completed, any evaluator can save the rubric as the final evaluation.
Visibility and Anonymity
- All evaluators can view the full rubric at all times.
- Evaluator input (scores and feedback) becomes visible to others upon saving a criterion.
- If anonymity is enabled:
- Evaluator names are hidden from peers but visible to facilitators.
- If anonymity is disabled:
- Evaluator names are shown next to their input to all participants.
Feedback Support
- Evaluators can provide:
- Feedback for each individual criterion.
- Overall feedback for the entire rubric.
- Feedback may include plain text or rich-media (e.g., images, video, audio).
Finalization
- The rubric is considered complete when all criteria have been evaluated.
- Any evaluator can trigger the final save, submitting the completed evaluation.
- Once finalized, the rubric may be locked or remain editable, depending on configuration.
Use Cases
Co-Evaluation Mode is ideal for:
- Multi-disciplinary reviews (e.g., institutional assessments, shared program evaluation).
- Evaluations without direct student submissions.
- Structured discussions or observations linked to topics, documents, or matrix cells.
- Flexible assessments where expertise areas vary among evaluators.
Compatibility
Co-Evaluation Mode can be used in conjunction with:
- Standard Rubric Evaluations
- Matrices
- Documents or artifacts
- Submission-based assessments
Reporting and Audit
- All evaluator inputs are tracked with timestamps.
- Finalized evaluations include a record of who completed each criterion.
- Anonymity settings are respected in all reports and displays.
Related Pages
FAQ
Q: Do evaluators have to wait for others to finish? A: No. Co-Evaluation can be performed either synchronously or asynchronously. Evaluators may work at the same time or at different times. Saved inputs become visible based on system refresh or user actions.
Q: Can two evaluators score the same criterion? A: No. Once a criterion is scored and saved by one evaluator, it becomes locked to others.
Q: Can evaluators change their own input after saving? A: Yes, evaluators can revise their own input until the rubric is finalized. After finalization, editability depends on the system’s configuration.
Q: What if a criterion is left blank? A: The rubric cannot be finalized until all criteria are scored. Incomplete rubrics remain in draft mode.
Q: Who can finalize the rubric? A: Any evaluator can finalize the rubric once all rows are completed. Finalization compiles all scores and feedback into a single evaluation record.
Q: Can evaluators see each other’s feedback and scores? A: Yes, once a criterion is saved, its input becomes visible to other evaluators. The visibility of evaluator names depends on anonymity settings.
Q: What does anonymity control? A: Anonymity settings determine whether evaluator names are shown to each other. When enabled, evaluators remain anonymous to each other but are still identifiable to facilitators.
Q: Do evaluators see the full rubric? A: Yes. All evaluators always see the full rubric layout, including criteria, descriptions, and scoring options.
Q: Who creates the rubric? A: Rubrics are typically created by institutional leads, program coordinators, or designated assessment designers—not by the evaluators themselves.
Q: Can the rubric be used without student submissions? A: Yes. Co-Evaluation Mode supports evaluations linked to topics, documents, or matrix cells, and does not require a student artifact.
Q: Can evaluators provide feedback? A: Yes. Feedback can be entered per criterion as well as overall. Plain text and rich-media (e.g., audio, images, video) are supported.
Q: Are timestamps and attribution tracked? A: Yes. The system records who entered what, and when, including timestamps for transparency and reporting.
Q: What happens after finalization? A: The finalized rubric is stored as a completed evaluation. Depending on configuration, it may become read-only or remain editable under specific conditions.
Q: Can Co-Evaluation be used for accreditation or compliance reporting? A: Yes. Co-Evaluation Mode is suitable for internal assessments, program reviews, accreditation evidence collection, and more.
Q: Can facilitators override evaluator input? A: If configured, facilitators may unlock, override, or reassign specific criteria before or after finalization.
