Difference between revisions of "Collaborative assessment with rubrics"

From RCampus Wiki
Jump to: navigation, search
m
 
(12 intermediate revisions by 3 users not shown)
Line 1: Line 1:
'''Collaborative assessment''' is when multiple evaluators assess the same item.  For example, a faculty member may invite a department to assess his/her course or a student may invite his/her classes and teachers to assess his/her ePortfolio.
+
'''Collaborative assessment''' is when multiple evaluators evaluate the same item.  For example, a faculty member may invite a department to evaluate his/her course, or a student may invite his/her classes and teachers to evaluate his/her ePortfolio.
  
Any member can attach a rubric to a document, a website, or any object, and invite others to engage in a collaborative assessment. Our collaborative assessment comes with a live report of results and graded rubrics. Our collaborative assessment feature can also be used for collecting data and taking surveys.
+
Any member can attach a rubric to a document, website, or other object, and then invite others to engage in a collaborative assessment. Our collaborative assessment comes with a live report of results and graded rubrics. Our collaborative assessment feature can also be used for collecting data and taking surveys.
  
 
http://www.rcampus.com/images/rubric2/Rubric_Collaborate_sm.gif
 
http://www.rcampus.com/images/rubric2/Rubric_Collaborate_sm.gif
  
  
==Starting collaborative assessment==
+
'''Note''': If you need to collect multiple artifacts, evaluate multiple students/evaluatees, track evaluation progress, [https://info.rcampus.com/blog/2022/03/04/rubric-reliability validate reliability], etc., then you want [[Matrices|Matrix assessment system]] that includes iRubric.
[[Image:AssessmentSettings.JPG|thumb|Use apply rubric page to create collaborative assessment and invite others]]
+
 
===Creating assessment===
+
 
# Select '''assessments''' from '''rubrics''' menu.
+
==Starting a collaborative assessment==
# Click on '''create a new assessment''' button.
+
===Creating an assessment===
# Build a rubric from scratch or select an existing rubric. [[How to build a rubric|Learn more about how to build a rubric]].
+
# Build a rubric or select an existing rubric. [[How to build a rubric|Learn more about how to build a rubric]].
# Click on the '''apply to...''' (http://www.rcampus.com/images/icons/16/rubricapply.gif) icon.
+
# From the rubric preview page, click on the '''apply to...''' (http://www.rcampus.com/images/icons/16/rubricapply.gif) icon.
 
# Under Option 2, click on the '''go''' (http://www.rcampus.com/images/icons/16/go.gif) icon next to an object type (e.g. Assess a website).
 
# Under Option 2, click on the '''go''' (http://www.rcampus.com/images/icons/16/go.gif) icon next to an object type (e.g. Assess a website).
# Enter assessment information in '''apply rubric to ...''' page and press ''save''.
+
# Enter the assessment title and other information and press ''save''.
 
* Continue to the next steps (Inviting evaluators).
 
* Continue to the next steps (Inviting evaluators).
 
===Inviting evaluators===
 
===Inviting evaluators===
 
* Continued from the above steps (Creating assessment).
 
* Continued from the above steps (Creating assessment).
# Check box next to evaluators you want to invite and press ''continue''.
+
# Check the box next to the evaluators you want to invite and press ''continue''.
# Send out an invitation to evaluators using one of two methods:
+
# Send out an invitation to evaluators using one of the three methods:
 
#* Method 1: Send an invitation message to evaluators using our [[message board]].
 
#* Method 1: Send an invitation message to evaluators using our [[message board]].
 
#* Method 2: Send an email to evaluators with a link to the rubric.
 
#* Method 2: Send an email to evaluators with a link to the rubric.
Line 27: Line 27:
 
'''Note''': The evaluators page shows a list of communities you belong to, i.e. classes, teams, groups, clubs, etc.  
 
'''Note''': The evaluators page shows a list of communities you belong to, i.e. classes, teams, groups, clubs, etc.  
  
If you have not joined any community yet, the page will only show the '''invite evaluators''' button.
+
If you have not joined a community yet, the page will only show the '''invite evaluators''' button.
 
 
  
 
==Steps for invited evaluators==
 
==Steps for invited evaluators==
Line 34: Line 33:
 
# Select '''assessments''' from '''rubrics''' menu.
 
# Select '''assessments''' from '''rubrics''' menu.
 
#* To view the attached rubric and read its description, click on the '''assessment title''' link.
 
#* To view the attached rubric and read its description, click on the '''assessment title''' link.
#* To do an evaluation, click on the '''assess''' link. You can view the item that is being evaluated, perform assessment and leave comments. Press ''save score'' to submit your assessment.
+
#* To do an evaluation, click on the '''score it''' link. You can view the item that is being evaluated, score it and leave comments. Press ''save score'' to submit your assessment.
#* To view other evaluators' assessment (if available), click on the '''number of assessments''' link. Click on the link next to the evaluator. You will see how this evaluator assessed the item and read the comment.
+
#* To view other evaluators' scores (if available), click on the '''number of assessments''' link. Click on the link next to the evaluator. You will see how this evaluator scored the item and read the comment.
 +
 
  
 +
'''Note 1''': You can always save your scores and continue scoring later, or go back and re-do your scoring until the assessment period is over.
  
'''Note''': If you see a blocked (http://www.rcampus.com/images/icons/16/block.gif) icon, it means the person who initiated the collaborative assessment has blocked evaluators to access the information or the assessment period has expired.
+
'''Note 2''': If you see a blocked (http://www.rcampus.com/images/icons/16/block.gif) icon, it means the person who initiated the collaborative assessment has blocked evaluators from accessing the information, or the assessment period has finished.
  
  
Line 45: Line 46:
  
 
# Pick a rubric that can be applied to a website.   
 
# Pick a rubric that can be applied to a website.   
#* If you don't have a rubric, copy the rubric at [http://www.rcampus.com/rubricshowc.cfm?code=Y48C7&sp=yes Website/ePortfolio Rubric] to your area (open the link and click on '''copy''' on top of the rubric).
+
#* If you don't have a rubric, copy the rubric at [http://www.rcampus.com/rubricshowc.cfm?code=Y48C7&sp=yes Website/ePortfolio Rubric] to your area (open the link and click on the '''duplicate''' icon (http://www.rcampus.com/images/icons/16/copy.gif) on top of the rubric).
 
# Create a collaborative assessment for this rubric:
 
# Create a collaborative assessment for this rubric:
## Click on '''apply to...''' (http://www.rcampus.com/images/icons/16/rubricapply.gif) icon on top of the rubric.
+
## Click on the '''apply to...''' (http://www.rcampus.com/images/icons/16/rubricapply.gif) icon on top of the rubric.
 
## Under Option 2, select "assess a website".
 
## Under Option 2, select "assess a website".
## Enter a title (E.g. Rank this website) and the address of the site (e.g. http://www.rcampus.com) and press ''save''.
+
## Enter a title (E.g. Rank this website) and the address of the site (e.g. http://www.rcampus.com) and press [save].
## Enter general info about this assessment and press ''continue''.
+
## Enter general info about this assessment and press [continue].
## Select the class to send the rubric to and press ''continue''.
+
## Select the class to send the rubric to and press [continue].
 
## At "Invite evaluators using one of the following methods:" page, select the ''message board'' link next to '''Method 1'''
 
## At "Invite evaluators using one of the following methods:" page, select the ''message board'' link next to '''Method 1'''
 
## Send a message to your class.  A link for this assessment is automatically sent with the message.  The class can also access it any time by selecting '''rubrics''', '''assessments''' from the top menu.
 
## Send a message to your class.  A link for this assessment is automatically sent with the message.  The class can also access it any time by selecting '''rubrics''', '''assessments''' from the top menu.
Line 62: Line 63:
  
 
[[Category:Rubrics]]
 
[[Category:Rubrics]]
 +
[[Category:Assessments]]

Latest revision as of 18:56, 3 February 2023

Collaborative assessment is when multiple evaluators evaluate the same item. For example, a faculty member may invite a department to evaluate his/her course, or a student may invite his/her classes and teachers to evaluate his/her ePortfolio.

Any member can attach a rubric to a document, website, or other object, and then invite others to engage in a collaborative assessment. Our collaborative assessment comes with a live report of results and graded rubrics. Our collaborative assessment feature can also be used for collecting data and taking surveys.

Rubric_Collaborate_sm.gif


Note: If you need to collect multiple artifacts, evaluate multiple students/evaluatees, track evaluation progress, validate reliability, etc., then you want Matrix assessment system that includes iRubric.


Starting a collaborative assessment

Creating an assessment

  1. Build a rubric or select an existing rubric. Learn more about how to build a rubric.
  2. From the rubric preview page, click on the apply to... (rubricapply.gif) icon.
  3. Under Option 2, click on the go (go.gif) icon next to an object type (e.g. Assess a website).
  4. Enter the assessment title and other information and press save.
  • Continue to the next steps (Inviting evaluators).

Inviting evaluators

  • Continued from the above steps (Creating assessment).
  1. Check the box next to the evaluators you want to invite and press continue.
  2. Send out an invitation to evaluators using one of the three methods:
    • Method 1: Send an invitation message to evaluators using our message board.
    • Method 2: Send an email to evaluators with a link to the rubric.
    • Method 3: Cut and paste a link onto a document, website, email, etc.


Note: The evaluators page shows a list of communities you belong to, i.e. classes, teams, groups, clubs, etc.

If you have not joined a community yet, the page will only show the invite evaluators button.

Steps for invited evaluators

  1. Login to your account. If you don't have an account yet, please become a member first.
  2. Select assessments from rubrics menu.
    • To view the attached rubric and read its description, click on the assessment title link.
    • To do an evaluation, click on the score it link. You can view the item that is being evaluated, score it and leave comments. Press save score to submit your assessment.
    • To view other evaluators' scores (if available), click on the number of assessments link. Click on the link next to the evaluator. You will see how this evaluator scored the item and read the comment.


Note 1: You can always save your scores and continue scoring later, or go back and re-do your scoring until the assessment period is over.

Note 2: If you see a blocked (block.gif) icon, it means the person who initiated the collaborative assessment has blocked evaluators from accessing the information, or the assessment period has finished.


A Collaborative Assessment Exercise to Engage a Classroom

We have found the following to be a great exercise to learn about collaborative assessment, to teach students about rubrics and get them engaged.

  1. Pick a rubric that can be applied to a website.
    • If you don't have a rubric, copy the rubric at Website/ePortfolio Rubric to your area (open the link and click on the duplicate icon (copy.gif) on top of the rubric).
  2. Create a collaborative assessment for this rubric:
    1. Click on the apply to... (rubricapply.gif) icon on top of the rubric.
    2. Under Option 2, select "assess a website".
    3. Enter a title (E.g. Rank this website) and the address of the site (e.g. http://www.rcampus.com) and press [save].
    4. Enter general info about this assessment and press [continue].
    5. Select the class to send the rubric to and press [continue].
    6. At "Invite evaluators using one of the following methods:" page, select the message board link next to Method 1
    7. Send a message to your class. A link for this assessment is automatically sent with the message. The class can also access it any time by selecting rubrics, assessments from the top menu.


See Also

Learn More About Rubrics

Working with rubrics

iRubric Public Tools