Uploaded image for project: 'Sakai'
  1. Sakai
  2. SAK-17606

Please provide mechanism for anonymous grading in the Assignment tool

    XMLWordPrintable

    Details

    • Type: Feature Request
    • Status: CLOSED
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.6.1, 2.7.1, 2.8.0, 2.9.1, 10.0
    • Fix Version/s: 10.3, 11.0
    • Component/s: Assignments
    • Environment:
      Sakai 2.6.
    • 10 status:
      Resolved
    • Test Plan:
      Hide
      • ensure you have assignment.anon.grading.enabled=true in sakai.properties
      • create an assignment:
      • accepts any type of submission
      • the checkbox 'Anonymous grading' is checked (under the 'Grading' heading)
      • as several students, submit something for the assignment
      • as instructor, view assignment list by student
      • ensure that the search filter text box is not present when there is an anonymous assigment in the site
      • for any student who has not yet submitted, ensure that you are not given a link to 'Submit as Student'
      • for any student who has submitted, ensure that submission date is withheld
      • as instructor, go to Grade Report
      • ensure that the search filter text box is not present when there is an anonymous assignment in the site
      • for any student who has submitted, ensure that the submission date is withheld
      • as instructor, go to the submission list interface for the anonymous assignment
      • verify that you see anonymous IDs rather than usernames in the list
      • ensure that the search filter text box is not present for this assignment (but should be available for any non-anonymous assignment)
      • click the 'Grade' link for any student in the list
      • verify that you see the anonymous ID rather than the username
      • give the student a grade, save and return to the submision list
      • repeat for any other students with submissions
      • click 'Download All'
      • ensure usernames are not leaked in the downloaded file(s)/folder(s)
      Show
      ensure you have assignment.anon.grading.enabled=true in sakai.properties create an assignment: accepts any type of submission the checkbox 'Anonymous grading' is checked (under the 'Grading' heading) as several students, submit something for the assignment as instructor, view assignment list by student ensure that the search filter text box is not present when there is an anonymous assigment in the site for any student who has not yet submitted, ensure that you are not given a link to 'Submit as Student' for any student who has submitted, ensure that submission date is withheld as instructor, go to Grade Report ensure that the search filter text box is not present when there is an anonymous assignment in the site for any student who has submitted, ensure that the submission date is withheld as instructor, go to the submission list interface for the anonymous assignment verify that you see anonymous IDs rather than usernames in the list ensure that the search filter text box is not present for this assignment (but should be available for any non-anonymous assignment) click the 'Grade' link for any student in the list verify that you see the anonymous ID rather than the username give the student a grade, save and return to the submision list repeat for any other students with submissions click 'Download All' ensure usernames are not leaked in the downloaded file(s)/folder(s)

      Description

      The faculty at our university would like a way to minimize grading bias in assignments. For example, in a 200+ student Humanities class with multiple TAs, a way to mask the identity of each student submission to prevent the TA (or instructor!) from raising or lowering grades based on their personal relationship with the students. Also, our School of Law requires this feature in any LMS they would consider using. (FYI, the option within the Tests&Quizzes tool doesn't cut the mustard in these situations.)

      When creating an assignment in Sakai, an instructor would have a setting to turn on anonymous grading (and may have some settings nested that turn on/off other features specific to anonymous grading). If anonymous grading is requested, an alternate view would be available to review any submissions that masks the submitter's identity. Neither the instructor nor TAs would know who submitted a particular assignment until a grade has been assigned to the assignment.

      Ideally, this view would also provide a workaround for any Turnitin review service employed. An example workflow might look like this: (1) anonymous view of all submissions is displayed, (2) grader sees the available assignments and reviews one of the works; (3) grader applies a "draft" grade to the work that is not published to the student yet; (4) once a draft grade has been applied, then access to the review service score and report are available (which will contain the student's identity); (5) with this additional information, a final grade can be assigned. Other refined logic might be desired by the faculty member, such as withholding the review service and final grade feature until all available assignments have received a draft grade, etc. Also, I could see some programming that would prevent TAs from adjusting assignment settings if anonymous grading has been enabled by the instructor, etc.

      I'm sure that there are multiple schools that would benefit from an anonymous grading feature within the Assignments tool, so I hope this need will be considered. Thank you for your time.

        Gliffy Diagrams

          Attachments

          1. anonGradingList.png
            anonGradingList.png
            20 kB
          2. anonGradingSettings.png
            anonGradingSettings.png
            13 kB
          3. assignment-2.9.1_AnonymousGrading.patch
            28 kB
          4. EXCEL-CSV export.png
            EXCEL-CSV export.png
            317 kB
          5. SAK-17606_10x_rev4.patch
            33 kB
          6. SAK-17606_trunk.patch
            41 kB
          7. SAK-17606-10.diff
            30 kB
          8. sam-revised-tabs.patch
            37 kB

            Issue Links

              Activity

                People

                • Assignee:
                  ottenhoff Sam Ottenhoff
                  Reporter:
                  alanregan Alan Regan
                • Votes:
                  2 Vote for this issue
                  Watchers:
                  15 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Git Source Code