Uploaded image for project: 'Sakai'
  1. Sakai
  2. SAK-37056

Auto-submit always sends last score which can allow zeros to override scores on multiple submissions in various cases

    Details

    • 12 status:
      Resolved
    • 11 status:
      Resolved
    • Previous Issue Keys:
      SAM-2435
    • Test Plan:
      Hide

      Steps to replicate:

      There are a few slight variations on settings that should be tested here. Most of the test plan for each is the same with the variation at the end. The variations are

      • Timed verses un-timed
      • Autosubmit or not
      • All 3 grading options in grading and feedback (hightest/last/average)

      {Common for all}

      Add Tests & Quizzes and Gradebook to a site. This needs to be a server where auto-submit is enabled (most of the nighties should have this setup now)

      1) Create assessment with 2 questions each with points assigned to them (10 points is best)
      In settings
      2) Ensure that Grading and Feedback "Send assessment score to Gradebook immediately, regardless of options below" is checked
      3) Ensure that unlimited submissions are allowed

      Save this assessment as a working copy. All published copies will be differing variations of this.

      3) Click settings on the Working copy

      (Test 1 to 3 - No special submission, highest/average/last)

      1) In settings set due and retract date in 5 minutes from now
      2) Set grading option to highest
      3) Change the name to indicate "No special highest" Publish
      4) Take the assessment as a student. Get all answers correct the first time scoring 20, submit.
      5) Take again get all answers wrong the second time scoring 0, submit.
      6) Login as instructor, the highest grade (20) should be recorded in the gradebook.

      Repeat all steps using average and last. For the average 10 should be recorded and for the last 0 should be recorded.

      (Test 4-6 Auto Submit job, highest/average/last)

      This is similar to the previous tests, however autosubmit should be checked.
      Complete steps 1-4 in the previous tests
      In Step 5 do NOT submit, just save.
      After the due date, run the auto submit job as admin.

      Check all of the scores as in the previous test. It should be correct (20 for highest, 10 for average 0 for last)

      (Test 7-9 Timed assessment, highest/average/last)

      Similar to the autosubmit, but this is a timed assessment

      • Set a timer of 5 minutes in addition to the other settings
      • Wait for 5 minutes
      • After the time is up check the grading (There might be some delay?)

      These tests are essentially verifying any second (and subsequent submissions) automatically done or done manually provide the correct scores into the gradebook.

      Show
      Steps to replicate: There are a few slight variations on settings that should be tested here. Most of the test plan for each is the same with the variation at the end. The variations are Timed verses un-timed Autosubmit or not All 3 grading options in grading and feedback (hightest/last/average) {Common for all} Add Tests & Quizzes and Gradebook to a site. This needs to be a server where auto-submit is enabled (most of the nighties should have this setup now) 1) Create assessment with 2 questions each with points assigned to them (10 points is best) In settings 2) Ensure that Grading and Feedback "Send assessment score to Gradebook immediately, regardless of options below" is checked 3) Ensure that unlimited submissions are allowed Save this assessment as a working copy. All published copies will be differing variations of this. 3) Click settings on the Working copy (Test 1 to 3 - No special submission, highest/average/last) 1) In settings set due and retract date in 5 minutes from now 2) Set grading option to highest 3) Change the name to indicate "No special highest" Publish 4) Take the assessment as a student. Get all answers correct the first time scoring 20, submit. 5) Take again get all answers wrong the second time scoring 0, submit. 6) Login as instructor, the highest grade (20) should be recorded in the gradebook. Repeat all steps using average and last. For the average 10 should be recorded and for the last 0 should be recorded. (Test 4-6 Auto Submit job, highest/average/last) This is similar to the previous tests, however autosubmit should be checked. Complete steps 1-4 in the previous tests In Step 5 do NOT submit, just save. After the due date, run the auto submit job as admin. Check all of the scores as in the previous test. It should be correct (20 for highest, 10 for average 0 for last) (Test 7-9 Timed assessment, highest/average/last) Similar to the autosubmit, but this is a timed assessment Set a timer of 5 minutes in addition to the other settings Wait for 5 minutes After the time is up check the grading (There might be some delay?) These tests are essentially verifying any second (and subsequent submissions) automatically done or done manually provide the correct scores into the gradebook.

      Description

      There's a grading issue where zeroes can overwrite good scores even for highest score. In my research autosubmit will only always submit the last (current) score to the gradebook. There is some logic to have it not submit a score to the gradebook in the highest score case, but no consideration for average score. There are a few ways to replicate this. All involve multiple submissions with auto-submit running at the end. Either on the end of the initial run or any time an instructor modifies the dates and gives students more time.
       
      See test plan for full steps to test this.

        Gliffy Diagrams

          Attachments

            Issue Links

              Activity

                People

                • Assignee:
                  jonespm Matthew Jones
                  Reporter:
                  ottenhoff Sam Ottenhoff
                • Votes:
                  1 Vote for this issue
                  Watchers:
                  13 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Git Source Code