Uploaded image for project: 'Sakai'
  1. Sakai
  2. SAK-44349

Significant data loss in Tests & Quizzes when opening multiple browser tabs to Sakai

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: OPEN
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: 20.1, 21.0 [Tentative], 22.0 [Tentative]
    • Fix Version/s: None
    • Labels:
    • Test Plan:
      Hide
      1. In a site with several students, and at least one other instructor/TA, add Tests & Quizzes and Lessons.
      2. In Tests & Quizzes, create 4 quizzes with multiple questions, at least one short answer/essay question in each.
      3. In the settings for each quiz:
        • Enable a time limit (e.g., 10 min).
        • In Grading and Feedback, enable Feedback on Submission and at least a couple feedback options, e.g., Student Response and Correct Response.
        • In Layout and Appearance, set all questions on one page.
      4. Publish each quiz.
      5. In Lessons, add a link to Quiz 3 using Add Content > Link to test or quiz.
      6. In Lessons, add a link to Quiz 4 using Add Content > Add Text > link > Browse Server.
      7. Log in as a student, access Quiz 1 and Begin Assessment.
      8. Start answering some questions and save your answers. Take note of which answers you entered. Leave the browser tab open.
      9. Open a new browser tab and navigate to Tests & Quizzes. Access and start Quiz 2.
      10. Try to answer some questions in Quiz 2 (with different answers than Quiz 1), taking note of which answers you entered, and save. Desired behavior: Save is successful and has not overwritten answers in Quiz 1 with blank or different answers.
      11. Go back to the browser tab with Quiz 1. Desired behavior: When you navigate back to the browser tab with Quiz 1, the timer continues to show the correct time remaining from Quiz 1 (i.e., timer does NOT appear to "jump" up to the time remaining for Quiz 2 and then back down again to time remaining from Quiz 1). Add some more answers and take note of them. Save is successful and there is no interference with Quiz 2.
      12. Hopping between the tabs, submit Quiz 2.
      13. Leave both tabs open and let the timer submit Quiz 1.
      14. Review Feedback on the quizzes, each feedback page in its own tab. Confirm that you can view feedback successfully and the answers are the appropriate answers you last saved in each quiz.
      15. Close your extra tabs, then navigate to Lessons.
      16. Open Quiz 3 and start working on it. Save some answers, making note of what you saved.
      17. Open another browser tab and navigate to Tests & Quizzes, then access Feedback for either of the previous quizzes.
      18. Leaving the feedback tab open, go back to Quiz 3 in the other tab. Desired behavior: When you navigate back to the browser tab with Quiz 3, the timer continues to show the correct time remaining from Quiz 3 (i.e., timer does NOT appear to "jump" up to the full time allotted for the quiz you were reviewing feedback on and then back down again to true time remaining from Quiz 3). Add some more answers and take note of them. Save is successful and there is no data loss.

      More testing steps are needed to confirm that the many ways of causing errors and data loss by opening multiple tabs to Tests & Quizzes are fixed.

      Show
      In a site with several students, and at least one other instructor/TA, add Tests & Quizzes and Lessons . In Tests & Quizzes , create 4 quizzes with multiple questions, at least one short answer/essay question in each. In the settings for each quiz: Enable a time limit (e.g., 10 min). In Grading and Feedback , enable Feedback on Submission and at least a couple feedback options, e.g., Student Response and Correct Response . In Layout and Appearance , set all questions on one page . Publish each quiz. In Lessons , add a link to Quiz 3 using Add Content > Link to test or quiz . In Lessons , add a link to Quiz 4 using Add Content > Add Text > link > Browse Server . Log in as a student, access Quiz 1 and Begin Assessment . Start answering some questions and save your answers. Take note of which answers you entered. Leave the browser tab open. Open a new browser tab and navigate to Tests & Quizzes . Access and start Quiz 2. Try to answer some questions in Quiz 2 (with different answers than Quiz 1), taking note of which answers you entered, and save. Desired behavior: Save is successful and has not overwritten answers in Quiz 1 with blank or different answers. Go back to the browser tab with Quiz 1. Desired behavior: When you navigate back to the browser tab with Quiz 1, the timer continues to show the correct time remaining from Quiz 1 (i.e., timer does NOT appear to "jump" up to the time remaining for Quiz 2 and then back down again to time remaining from Quiz 1). Add some more answers and take note of them. Save is successful and there is no interference with Quiz 2. Hopping between the tabs, submit Quiz 2. Leave both tabs open and let the timer submit Quiz 1. Review Feedback on the quizzes, each feedback page in its own tab. Confirm that you can view feedback successfully and the answers are the appropriate answers you last saved in each quiz. Close your extra tabs, then navigate to Lessons . Open Quiz 3 and start working on it. Save some answers, making note of what you saved. Open another browser tab and navigate to Tests & Quizzes , then access Feedback for either of the previous quizzes. Leaving the feedback tab open, go back to Quiz 3 in the other tab. Desired behavior: When you navigate back to the browser tab with Quiz 3, the timer continues to show the correct time remaining from Quiz 3 (i.e., timer does NOT appear to "jump" up to the full time allotted for the quiz you were reviewing feedback on and then back down again to true time remaining from Quiz 3). Add some more answers and take note of them. Save is successful and there is no data loss. More testing steps are needed to confirm that the many ways of causing errors and data loss by opening multiple tabs to Tests & Quizzes are fixed.

      Description

      By far the worst usability problem in Sakai (and IMO, should've taken precedence over any skin changes to make the system "look more modern") is the fact that when you open multiple browser tabs or windows to the application, you have a very high risk of encountering errors and data loss.

      The problem is most egregious in Tests & Quizzes, where students are constantly losing their work by overwriting good answers with blank ones.

      There needs to be some attention given to changing the state-based behavior of tools to fix this. Users expect to be able to open multiple tabs successfully without losing data, as it's not a problem in the vast majority of systems.

        Gliffy Diagrams

          Zeplin

            Attachments

              Issue Links

                Activity

                  People

                  Assignee:
                  maintenanceteam Core Team
                  Reporter:
                  rainribbon Tiffany Stull
                  Votes:
                  2 Vote for this issue
                  Watchers:
                  6 Start watching this issue

                    Dates

                    Created:
                    Updated:

                      Git Integration