Uploaded image for project: 'Sakai'
  1. Sakai
  2. SAK-42179

samigo: Improve graphical display of test statistics.

    Details

    • Test Plan:
      Hide
      1. In a site with several students, import the attached quiz: manykindsofquestions-forstatstest.zip
      2. Make the following changes to the imported quiz:
        • Add two Hot Spot type questions.
        • Edit the Multiple Choice, Multiple Correct question that claims in its text to be "all or nothing", and set its scoring model to All or Nothing.
      3. Publish the quiz.
      4. Submit the quiz as several students, noting the following for your submissions:
        • Some question types are repeated (e.g., Short Answer/Essay) so that you can leave one with no responses and submit the other.
        • Make sure to enter different combinations of correct/incorrect answers or no responses for each question type. This is to test the accuracy of the stats that are produced.
      5. As instructor, go to the Scores for the test and enter scores for manually-graded questions. Include some 0 scores for blank answers/no submission.
      6. Go to the Statistics tab.
      7. Enable a screen reader, e.g., NVDA or JAWS.
      8. Confirm the following:
        • The top of the page shows a Grade Statistics table and Final Score Distribution graph.
        • When the screen reader encounters the graph, it tells you how many students earned scores that fall within each displayed range of grades, with a period to break up each interval, e.g.: "Two students earned scores starting at 0 and less than 8 points - dot - One student earned a score starting at 8 and less than 16 points."
          Note: Open/closed intervals (link to Wikipedia explaining these) in the Score Distribution graph should be identifiable when listening with the screen reader as well - closed interval says "X through Y points" instead of "starting at X and less than Y". Screen reader video example here.
        • You can read/understand individual question statistics with the screen reader.
        • Color contrast for all text/background colors is adequate. Contrast checker available on WebAIM site.
        • All questions accurately indicate the numbers/percentages of correct responses, incorrect responses, and no answer submissions.
        • A Correctness column, as well as green vs. blue colors on the progress bars for each question table accurately indicate the correct vs. incorrect answer options for auto-graded questions.
          • There might be an issue with Matching Questions that have None of the Above answers - this will need to be confirmed in testing.
      9. Print the Stats page and confirm printout looks good. Example: sampleprintview-quizstats.pdf
      10. Go back to the Total Scores screen and make some grade adjustments, taking note of which changes you made.
      11. Go to some auto-graded questions and edit grades, taking note of which changes you made.
      12. Go back to Statistics and confirm all stats updated as expected.
      13. Log in as a student and view Statistics feedback. Make sure the screen looks the same for you as it did for instructor.
      Show
      In a site with several students, import the attached quiz: manykindsofquestions-forstatstest.zip Make the following changes to the imported quiz: Add two Hot Spot type questions. Edit the Multiple Choice, Multiple Correct question that claims in its text to be "all or nothing", and set its scoring model to All or Nothing . Publish the quiz. Submit the quiz as several students, noting the following for your submissions: Some question types are repeated (e.g., Short Answer/Essay) so that you can leave one with no responses and submit the other. Make sure to enter different combinations of correct/incorrect answers or no responses for each question type. This is to test the accuracy of the stats that are produced. As instructor, go to the Scores for the test and enter scores for manually-graded questions. Include some 0 scores for blank answers/no submission. Go to the Statistics tab. Enable a screen reader, e.g., NVDA or JAWS. Confirm the following: The top of the page shows a Grade Statistics table and Final Score Distribution graph. When the screen reader encounters the graph, it tells you how many students earned scores that fall within each displayed range of grades, with a period to break up each interval, e.g.: "Two students earned scores starting at 0 and less than 8 points - dot - One student earned a score starting at 8 and less than 16 points." Note: Open/closed intervals (link to Wikipedia explaining these) in the Score Distribution graph should be identifiable when listening with the screen reader as well - closed interval says "X through Y points" instead of "starting at X and less than Y". Screen reader video example here . You can read/understand individual question statistics with the screen reader. Color contrast for all text/background colors is adequate. Contrast checker available on WebAIM site . All questions accurately indicate the numbers/percentages of correct responses, incorrect responses, and no answer submissions. A Correctness column, as well as green vs. blue colors on the progress bars for each question table accurately indicate the correct vs. incorrect answer options for auto-graded questions. There might be an issue with Matching Questions that have None of the Above answers - this will need to be confirmed in testing. Print the Stats page and confirm printout looks good. Example: sampleprintview-quizstats.pdf Go back to the Total Scores screen and make some grade adjustments, taking note of which changes you made. Go to some auto-graded questions and edit grades, taking note of which changes you made. Go back to Statistics and confirm all stats updated as expected. Log in as a student and view Statistics feedback. Make sure the screen looks the same for you as it did for instructor.

      Description

      The Samigo Statistics screen is unattractive and hard to read, for example:

      • There is too much white space between sections/bars to see the stats for a question easily.
      • The numbers on the bars that indicate the number of responses for each answer have poor contrast with the background colors.
      • Color only is used to indicate whether answers students selected are correct/incorrect.
      • Printing yields poor quality printout (hard to read due to issues mentioned above).

      This is a jira to improve the readability/accessibility of the Statistics screen.

      Mock-ups:

      Score Distribution graph (like the ones in Gradebook), to include text alternative for screen reader users:

      Questions with response numbers to the left of bars and Correctness indicator for each response:

        Gliffy Diagrams

          Attachments

          1. before1.png
            before1.png
            10 kB
          2. before2.png
            before2.png
            16 kB
          3. manykindsofquestions-forstatstest.zip
            12 kB
          4. questions-responsedistribution.png
            questions-responsedistribution.png
            65 kB
          5. sampleprintview-quizstats.pdf
            151 kB
          6. scoredistributiongraph.png
            scoredistributiongraph.png
            54 kB
          7. statsscreen-gradestats-scoredistgraph.png
            statsscreen-gradestats-scoredistgraph.png
            64 kB

            Activity

              People

              • Assignee:
                maintenanceteam Core Team
                Reporter:
                rainribbon Tiffany Stull
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Git Source Code