Uploaded image for project: 'Sakai'
  1. Sakai
  2. SAK-43173

Samigo Tests & Quizzes incorrect scores

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Awaiting Review
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Test Plan:
      Hide

      This issue is NOT easily reproducible. However...

      1. In a site with multiple users
      2. Create a Samigo test using several "fill in the blank" questions, where each question has multiple fill in the blanks
      3. make each question worth 1 point
      4. Take the test as a student
      5. Login as the instructor and view the individual question scores
      6. The scores may not add up correctly

      Or, taking into account comments from SAK-34373, when you take the test, have multiple browser tabs open to different questions in the test.

      Show
      This issue is NOT easily reproducible. However... In a site with multiple users Create a Samigo test using several "fill in the blank" questions, where each question has multiple fill in the blanks make each question worth 1 point Take the test as a student Login as the instructor and view the individual question scores The scores may not add up correctly Or, taking into account comments from SAK-34373 , when you take the test, have multiple browser tabs open to different questions in the test.

      Description

      We've recently experienced a problem in Sakai 12.7 with Samigo (Tests& Quizzes) where a Fill in the Blanks question is showing incorrect scores for some students.

      See also the Forum thread: https://groups.google.com/a/apereo.org/forum/#!searchin/sakai-dev/Samigo$20Tests$20$26$20Quizzes$20incorrect$20scores%7Csort:date/sakai-dev/mR7aujc4OpA/BgHbEnrIFgAJ

      Here's an earlier issue and forum thread that describes something similar:

      https://jira.sakaiproject.org/browse/SAK-34373

      https://groups.google.com/a/apereo.org/forum/#!searchin/sakai-dev/weird$20bugs$20in$20Tests$20$26$20Quizzes%7Csort:date/sakai-dev/5gDoCSmQ_0w/L-L2KNaZCwAJ

      but that one seemed to involve incorrect 0 point scores, while our issue is showing incorrect scores. (although maybe they are the same and multiple choice vs fill in the blank results in different symptoms?)

      Taking a look at some of the values in our database, students 1 and 2 below for each individual fill in the blank for the question was scored correctly, 0.14285714285714285. However, if you take a look at student 3's autoscore, the value for each fill in the blank part is lower than the others, 0.1020408163265306. The other weird thing is that if you add up the total score from student2 and student3, they are the same: 0.7142857143. It's almost as if student 3 was given the total score of student2, but then was divided by the number of fill in the blank parts to get a lower individual score for each fill in the blank part?

      mysql> select PUBLISHEDITEMID, SUBMITTEDDATE, PUBLISHEDANSWERID, RATIONALE,ANSWERTEXT,AUTOSCORE, OVERRIDESCORE,eid  from sam_itemgrading_t inner join sakai_user_id_map on agentid = user_id where publisheditemid = '9999814' and eid = 'student1' order by agentid, publishedanswerid;
      +-----------------+---------------------+-------------------+-----------+------------+---------------------+---------------+----------+
      | PUBLISHEDITEMID | SUBMITTEDDATE       | PUBLISHEDANSWERID | RATIONALE | ANSWERTEXT | AUTOSCORE           | OVERRIDESCORE | eid      |
      +-----------------+---------------------+-------------------+-----------+------------+---------------------+---------------+----------+
      |         9999814 | 2020-01-27 14:29:45 |          99998268 | NULL      | h          | 0.14285714285714285 |             0 | student1 |
      |         9999814 | 2020-01-27 14:29:45 |          99998269 | NULL      | f          | 0.14285714285714285 |             0 | student1 |
      |         9999814 | 2020-01-27 14:29:45 |          99998270 | NULL      | g          | 0.14285714285714285 |             0 | student1 |
      |         9999814 | 2020-01-27 14:29:45 |          99998271 | NULL      | a          | 0.14285714285714285 |             0 | student1 |
      |         9999814 | 2020-01-27 14:29:45 |          99998272 | NULL      | k          | 0.14285714285714285 |             0 | student1 |
      |         9999814 | 2020-01-27 14:29:45 |          99998273 | NULL      | b          | 0.14285714285714285 |             0 | student1 |
      |         9999814 | 2020-01-27 14:29:45 |          99998274 | NULL      | h          | 0.14285714285714285 |             0 | student1 |
      +-----------------+---------------------+-------------------+-----------+------------+---------------------+---------------+----------+
      7 rows in set (0.02 sec)
      
      mysql> select PUBLISHEDITEMID, SUBMITTEDDATE, PUBLISHEDANSWERID, RATIONALE,ANSWERTEXT,AUTOSCORE, OVERRIDESCORE,eid  from sam_itemgrading_t inner join sakai_user_id_map on agentid = user_id where publisheditemid = '9999814' and eid = 'student2' order by agentid, publishedanswerid;
      +-----------------+---------------------+-------------------+-----------+------------+---------------------+---------------+----------+
      | PUBLISHEDITEMID | SUBMITTEDDATE       | PUBLISHEDANSWERID | RATIONALE | ANSWERTEXT | AUTOSCORE           | OVERRIDESCORE | eid      |
      +-----------------+---------------------+-------------------+-----------+------------+---------------------+---------------+----------+
      |         9999814 | 2020-01-28 22:14:09 |          99998268 |           | i          |                   0 |             0 | student2 |
      |         9999814 | 2020-01-28 22:14:09 |          99998269 |           | f          | 0.14285714285714285 |             0 | student2 |
      |         9999814 | 2020-01-28 22:14:09 |          99998270 |           | g          | 0.14285714285714285 |             0 | student2 |
      |         9999814 | 2020-01-28 22:14:09 |          99998271 |           | a          | 0.14285714285714285 |             0 | student2 |
      |         9999814 | 2020-01-28 22:14:09 |          99998272 |           | k          | 0.14285714285714285 |             0 | student2 |
      |         9999814 | 2020-01-28 22:14:09 |          99998273 |           | b          | 0.14285714285714285 |             0 | student2 |
      |         9999814 | 2020-01-28 22:14:09 |          99998274 |           | i          |                   0 |             0 | student2 |
      +-----------------+---------------------+-------------------+-----------+------------+---------------------+---------------+----------+
      7 rows in set (0.03 sec)
      
      mysql> select PUBLISHEDITEMID, SUBMITTEDDATE, PUBLISHEDANSWERID, RATIONALE,ANSWERTEXT,AUTOSCORE, OVERRIDESCORE,eid  from sam_itemgrading_t inner join sakai_user_id_map on agentid = user_id where publisheditemid = '9999814' and eid = 'student3' order by agentid, publishedanswerid;
      +-----------------+---------------------+-------------------+-----------+------------+--------------------+---------------+----------+
      | PUBLISHEDITEMID | SUBMITTEDDATE       | PUBLISHEDANSWERID | RATIONALE | ANSWERTEXT | AUTOSCORE          | OVERRIDESCORE | eid      |
      +-----------------+---------------------+-------------------+-----------+------------+--------------------+---------------+----------+
      |         9999814 | 2020-01-28 22:08:44 |          99998268 |           | h          | 0.1020408163265306 |             0 | student3 |
      |         9999814 | 2020-01-28 22:08:44 |          99998269 |           | f          | 0.1020408163265306 |             0 | student3 |
      |         9999814 | 2020-01-28 22:08:44 |          99998270 |           | g          | 0.1020408163265306 |             0 | student3 |
      |         9999814 | 2020-01-28 22:08:44 |          99998271 |           | a          | 0.1020408163265306 |             0 | student3 |
      |         9999814 | 2020-01-28 22:08:44 |          99998272 |           | k          | 0.1020408163265306 |             0 | student3 |
      |         9999814 | 2020-01-28 22:08:44 |          99998273 |           | b          | 0.1020408163265306 |             0 | student3 |
      |         9999814 | 2020-01-28 22:08:44 |          99998274 |           | h          | 0.1020408163265306 |             0 | student3 |
      +-----------------+---------------------+-------------------+-----------+------------+--------------------+---------------+----------+
      7 rows in set (0.01 sec)
      

        Gliffy Diagrams

          Zeplin

            Attachments

              Issue Links

                Activity

                  People

                  Assignee:
                  Unassigned Unassigned
                  Reporter:
                  austinUH Austin
                  Votes:
                  0 Vote for this issue
                  Watchers:
                  7 Start watching this issue

                    Dates

                    Created:
                    Updated:

                      Git Integration