Uploaded image for project: 'Sakai'
  1. Sakai
  2. SAK-43676

Samigo: Instructor option to let students start another attempt with last attempt's answers included.

    XMLWordPrintable

    Details

    • Test Plan:
      Hide

      Note: Additional regression testing will be needed. This is just a first try at some testing steps:

      Testing for option at assessment level

      1. In a site with at least two students, create a quiz with several questions. Include at least one of each auto-graded question type, and one manually graded question (e.g., short answer/essay or file upload).
      2. In Settings, enable the following:
        • A relatively short time limit, e.g., 10 min.
        • Feedback on submission with the following feedback options (this is a test for instructors who want students to be able to see what they got wrong after the first take):
          • Student Response
          • Student's Question and Part Scores
      3. Publish the quiz.
      4. As Student 1, start the quiz, save some answers (not all) and don't submit. Let the timer submit.
      5. As Student 2, answer all the questions and submit it manually, getting some answers correct and some incorrect.
      6. As instructor select Settings for the quiz.
      7. Enable a time exception for each student, e.g. decrease the time to 5 min.
      8. Change the number of submissions allowed to 3.
      9. Enable the option If multiple submissions or a retake are allowed, students will start each new submission with their responses from their last attempt already entered.
      10. Save the settings.
      11. Log in as Student 1 and go to Tests & Quizzes.
      12. Start the second submission and confirm the following:
        • You get the appropriate (new) time limit.
        • All your previous answers are pre-populated.
      13. Finish answering the rest of the questions and submit the quiz.
      14. Confirm you can take it a third time, now with all the answers from your most recent take included and the appropriate time limit.
      15. As Student 2, log in and check the Feedback to see all your answers and figure out which questions you got wrong.
      16. Take the quiz again, confirming that you have the appropriate time limit, all your answers are included, and you can change the answers to try to get them all right, then submit.
      17. Take the quiz a third time, confirming that the answers from the most recent attempt are included.

      Verification of submissions/scores

      1. As instructor go to Scores for each quiz and confirm that the student's recorded grade on Total Scores for each quiz is appropriate based on the scoring settings in the exam (typical default is highest submission).
      2. From the View menu, select All Submissions and confirm you can access the students' original attempts (for Student 1, the partial attempt should be present).
      3. Go back to Tests & Quizzes, select Settings for the quiz where Student 2 got a lower score on second attempt.
      4. In Grading and Feedback, change the recorded score to be last or average.
      5. Go back to Scores and check that recorded score is still correct.
      Show
      Note: Additional regression testing will be needed. This is just a first try at some testing steps: Testing for option at assessment level In a site with at least two students, create a quiz with several questions. Include at least one of each auto-graded question type, and one manually graded question (e.g., short answer/essay or file upload). In Settings , enable the following: A relatively short time limit, e.g., 10 min . Feedback on submission with the following feedback options (this is a test for instructors who want students to be able to see what they got wrong after the first take): Student Response Student's Question and Part Scores Publish the quiz. As Student 1, start the quiz, save some answers (not all) and don't submit. Let the timer submit. As Student 2, answer all the questions and submit it manually, getting some answers correct and some incorrect. As instructor select Settings for the quiz. Enable a time exception for each student, e.g. decrease the time to 5 min . Change the number of submissions allowed to 3 . Enable the option If multiple submissions or a retake are allowed, students will start each new submission with their responses from their last attempt already entered. Save the settings. Log in as Student 1 and go to Tests & Quizzes . Start the second submission and confirm the following: You get the appropriate (new) time limit. All your previous answers are pre-populated. Finish answering the rest of the questions and submit the quiz. Confirm you can take it a third time, now with all the answers from your most recent take included and the appropriate time limit. As Student 2, log in and check the Feedback to see all your answers and figure out which questions you got wrong. Take the quiz again, confirming that you have the appropriate time limit, all your answers are included, and you can change the answers to try to get them all right, then submit. Take the quiz a third time, confirming that the answers from the most recent attempt are included. Verification of submissions/scores As instructor go to Scores for each quiz and confirm that the student's recorded grade on Total Scores for each quiz is appropriate based on the scoring settings in the exam (typical default is highest submission ). From the View menu, select All Submissions and confirm you can access the students' original attempts (for Student 1, the partial attempt should be present). Go back to Tests & Quizzes , select Settings for the quiz where Student 2 got a lower score on second attempt. In Grading and Feedback , change the recorded score to be last or average . Go back to Scores and check that recorded score is still correct.

      Description

      Issue description with example use cases

      Allowing completion of a test for multiple students with technical issues

      An instructor creates a timed test, e.g., with a 2-hour time limit, that has some flaw in a question making it impossible for students to complete. A significant number of students start the test (e.g., 50 students) and they work on it for quite a while, e.g., 1 hour, then encounter the question with an issue. The students can't complete the test before it is automatically saved and submitted by the timer.

      The instructor can allow another submission, but then the students have to start over from scratch, with the full 2-hour time limit. In most cases like these, the instructor just wants to let the students finish what they started. In the example provided above, the instructor would want to:

      1. Set a date/time exception for the students to allot 1 hour for the "continued" test.
      2. Let the students have all their answers from the initial submission already included, so they can pick up where they left off, answering the remaining questions.

      Similarly, if an instructor creates some date/time exceptions in a test and makes a mistake in the dates/time limits, they might need to allow the affected students a bit more time to complete it.

      This issue has come up multiple times recently as many instructors and students are new to teaching online and using Tests & Quizzes.

      Allowing students to improve on subsequent attempts

      As per SAK-34754, an instructor wants to let students submit an assessment and see which questions they answered correctly/incorrectly, without revealing the correct answers (e.g., by showing student response and question point values as feedback). Then, allow the students to take it again and try to correct the answers to questions they got wrong to improve their score.

      Proposed fix

      In Settings, after enabling more than 1 submission, have a checkbox to allow students with multiple submissions the ability to see their answers submitted during the last take when they submit again, e.g.:

      Students will start each new submission with their responses from their last attempt already entered.

      Important: The wording and how the instructor selects these options must be easy to understand and accessible.

      Additional notes

      Samigo has an existing option Allow students to update their latest submission to present students with a new take prefilled with their previous answers (this is not a new submission - the option specifically backs their last submission out of being submitted!) The option is available if the instructor selects Edit > Regrade and Republish for an assessment, but for the use case described here, it's an extremely poor substitute and a clunky workaround.

      If you select the checkbox Allow students to update their latest submission when republishing a test, it removes all student submissions. Then all students in the class must resubmit the test in order for their submission to count.

      The other problem with the Allow students to update their latest submission option is that if there was a time limit on the original assessment, you cannot use the option in concert with any time limit at all. You must remove the time limit altogether before enabling the option. Otherwise, when a student tries to continue the test, it recognizes that the original timer thread already expired and immediately submits it without giving the student any opportunity to work on it.

        Gliffy Diagrams

          Zeplin

            Attachments

              Issue Links

                Activity

                  People

                  Assignee:
                  maintenanceteam Core Team
                  Reporter:
                  rainribbon Tiffany Stull
                  Votes:
                  0 Vote for this issue
                  Watchers:
                  3 Start watching this issue

                    Dates

                    Created:
                    Updated:

                      Git Integration