Uploaded image for project: 'Sakai'
  1. Sakai
  2. SAK-34373

Samigo answer is correct but score is 0

    XMLWordPrintable

    Details

    • 20 status:
      Resolved
    • 19 status:
      Resolved
    • Previous Issue Keys:
      SAM-3368
    • Test Plan:
      Hide

      Testing Steps:

      1. As an instructor create two auto-scored assessments
      2. In tab 1 as a student go to the samigo index page with the assessments
      3. In tab 2 as a student go to the samigo index page with the assessments
      4. In tab 1 start taking the first assessment, answer questions correctly, but don't save or submit.
      5. In tab 2 click the second assessment. (do nothing else)
      6. In tab 1 from last page click "Submit for Grading"
        • PASS: "Data Discrepancy" error is displayed
        • CONTINUE: The session may actually get corrupted in this action, so it's not a fail... yet.
      7. In tab 1 from the confirmation page click "Submit for Grading"
        • PASS: "Data Discrepancy" error is displayed
          1. Restart and continue assessment, then submit
          2. As instructor observe the student's score
            • PASS: Correct score
        • FAIL: Assessment appears to submit
          1. As instructor observe the student's score
            • FAIL: score of 0
            • In the logs, "unable to retrive itemDataIfc" error will be seen during the submission
      Show
      Testing Steps: As an instructor create two auto-scored assessments In tab 1 as a student go to the samigo index page with the assessments In tab 2 as a student go to the samigo index page with the assessments In tab 1 start taking the first assessment, answer questions correctly, but don't save or submit. In tab 2 click the second assessment. (do nothing else) In tab 1 from last page click "Submit for Grading" PASS: "Data Discrepancy" error is displayed CONTINUE: The session may actually get corrupted in this action, so it's not a fail... yet. In tab 1 from the confirmation page click "Submit for Grading" PASS: "Data Discrepancy" error is displayed Restart and continue assessment, then submit As instructor observe the student's score PASS: Correct score FAIL: Assessment appears to submit As instructor observe the student's score FAIL: score of 0 In the logs, "unable to retrive itemDataIfc" error will be seen during the submission

      Description

      Unfortuantely, we don't have a way to reproduce this probem, but occasionally, when a student takes a Samigo test, they will answer a question correctly, but the UI shows a score of 0.

      So far, we have seen this with samigo question types:

      • Multiple Choice Single Correct
      • Matching

      but I haven't checked every instance of the issue, so there could be other types affected

      Also, we asked one of the students if they saw any errors or had problems while taking the test she said

      Yes i experienced in slow loading a couple of times when I took the quizes. I had to reload it a couple of times.

      Checking the database, the "autoscore" value for the answer is set to NULL (see the last row in this query:

      mysql> select SUBMITTEDDATE, PUBLISHEDANSWERID, RATIONALE, ANSWERTEXT, AUTOSCORE, OVERRIDESCORE, comments from sam_itemgrading_t where assessmentgradingid = '2364664' order by submitteddate;
      +---------------------+-------------------+-----------+------------+-----------+---------------+----------+
      | SUBMITTEDDATE       | PUBLISHEDANSWERID | RATIONALE | ANSWERTEXT | AUTOSCORE | OVERRIDESCORE | comments |
      +---------------------+-------------------+-----------+------------+-----------+---------------+----------+
      | 2018-01-12 08:55:16 |          12318602 | NULL      | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 08:58:01 |          12318625 |           | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 08:58:05 |          12318631 |           | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:00:22 |          12318576 |           | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:00:25 |          12318618 |           | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:00:35 |          12318585 | NULL      | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:01:00 |          12318590 | NULL      | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:01:25 |          12318634 | NULL      | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:01:45 |          12318627 | NULL      | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:02:17 |          12318641 | NULL      | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:02:41 |          12318614 | NULL      | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:03:27 |          12318637 | NULL      | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:05:33 |          12318594 | NULL      | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:06:28 |          12318612 |           | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:07:04 |          12318620 | NULL      | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:08:48 |          12318600 | NULL      | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:09:14 |          12318572 |           | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:09:50 |          12318580 | NULL      | NULL       |         1 |             0 | NULL     |
      | 2018-01-12 09:12:52 |          12318608 | NULL      | NULL       |         1 |          NULL | NULL     |
      | 2018-01-12 09:15:06 |          12318644 |           | NULL       |      NULL |          NULL | NULL     |
      +---------------------+-------------------+-----------+------------+-----------+---------------+----------+
      20 rows in set (0.01 sec)
      

      Checking for other instances of this issue, we found 34 since upgrading to Sakai 11.4 and none before (not since 2010 with an early version of Sakai 2.x, but that could be due to something else?):

      mysql> select count(*) from (select assessmentgradingid from sam_itemgrading_t where submitteddate > "2017-12-27 00:00:00" and autoscore is null group by assessmentgradingid) as t;
      +----------+
      | count(*) |
      +----------+
      |       34 |
      +----------+
      1 row in set (6 min 6.16 sec)
      

        Gliffy Diagrams

          Zeplin

            Attachments

              Issue Links

                Activity

                  People

                  Assignee:
                  dnhutchins David Hutchins
                  Reporter:
                  austinUH Austin
                  Votes:
                  6 Vote for this issue
                  Watchers:
                  22 Start watching this issue

                    Dates

                    Created:
                    Updated:
                    Resolved:

                      Git Integration