Uploaded image for project: 'Sakai'
  1. Sakai
  2. SAK-42179

samigo: Improve graphical display of test statistics.

    XMLWordPrintable

    Details

    • 20 status:
      Resolved
    • Test Plan:
      Hide
      1. In a site with several students, import the attached quiz: manykindsofquestions-forstatstest.zip
      2. Make the following changes to the imported quiz:
        • Add two Hot Spot type questions.
        • Edit the Multiple Choice, Multiple Correct question that claims in its text to be "all or nothing", and set its scoring model to All or Nothing.
      3. Publish the quiz.
      4. Submit the quiz as several students, noting the following for your submissions:
        • Some question types are repeated (e.g., Short Answer/Essay) so that you can leave one with no responses and submit the other.
        • Make sure to enter different combinations of correct/incorrect answers or no responses for each question type. This is to test the accuracy of the stats that are produced.
      5. As instructor, go to the Scores for the test and enter scores for manually-graded questions. Include some 0 scores for blank answers/no submission.
      6. Go to the Statistics tab.
      7. Enable a screen reader, e.g., NVDA or JAWS.
      8. Confirm the following:
        • The top of the page shows a Grade Statistics table and Final Score Distribution graph.
        • When the screen reader encounters the graph, it tells you how many students earned scores that fall within each displayed range of grades, with a period to break up each interval, e.g.: "Two students earned scores starting at 0 and less than 8 points - dot - One student earned a score starting at 8 and less than 16 points."
          Note: Open/closed intervals (link to Wikipedia explaining these) in the Score Distribution graph should be identifiable when listening with the screen reader as well - closed interval says "X through Y points" instead of "starting at X and less than Y". Screen reader video example here.
        • You can read/understand individual question statistics with the screen reader.
        • Color contrast for all text/background colors is adequate. Contrast checker available on WebAIM site.
        • All questions accurately indicate the numbers/percentages of correct responses, incorrect responses, and no answer submissions.
        • A Correctness column, as well as green vs. blue colors on the progress bars for each question table accurately indicate the correct vs. incorrect answer options for auto-graded questions.
          • There might be an issue with Matching Questions that have None of the Above answers - this will need to be confirmed in testing.
      9. Print the Stats page and confirm printout looks good. Example: samplequizstatsprintout.pdf
      10. Go back to the Total Scores screen and make some grade adjustments, taking note of which changes you made.
      11. Go to some auto-graded questions and edit grades, taking note of which changes you made.
      12. Go back to Statistics and confirm all stats updated as expected.
      13. Log in as a student and view Statistics feedback. Make sure the screen looks the same for you as it did for instructor.
      Show
      In a site with several students, import the attached quiz: manykindsofquestions-forstatstest.zip Make the following changes to the imported quiz: Add two Hot Spot type questions. Edit the Multiple Choice, Multiple Correct question that claims in its text to be "all or nothing", and set its scoring model to All or Nothing . Publish the quiz. Submit the quiz as several students, noting the following for your submissions: Some question types are repeated (e.g., Short Answer/Essay) so that you can leave one with no responses and submit the other. Make sure to enter different combinations of correct/incorrect answers or no responses for each question type. This is to test the accuracy of the stats that are produced. As instructor, go to the Scores for the test and enter scores for manually-graded questions. Include some 0 scores for blank answers/no submission. Go to the Statistics tab. Enable a screen reader, e.g., NVDA or JAWS. Confirm the following: The top of the page shows a Grade Statistics table and Final Score Distribution graph. When the screen reader encounters the graph, it tells you how many students earned scores that fall within each displayed range of grades, with a period to break up each interval, e.g.: "Two students earned scores starting at 0 and less than 8 points - dot - One student earned a score starting at 8 and less than 16 points." Note: Open/closed intervals (link to Wikipedia explaining these) in the Score Distribution graph should be identifiable when listening with the screen reader as well - closed interval says "X through Y points" instead of "starting at X and less than Y". Screen reader video example here . You can read/understand individual question statistics with the screen reader. Color contrast for all text/background colors is adequate. Contrast checker available on WebAIM site . All questions accurately indicate the numbers/percentages of correct responses, incorrect responses, and no answer submissions. A Correctness column, as well as green vs. blue colors on the progress bars for each question table accurately indicate the correct vs. incorrect answer options for auto-graded questions. There might be an issue with Matching Questions that have None of the Above answers - this will need to be confirmed in testing. Print the Stats page and confirm printout looks good. Example: samplequizstatsprintout.pdf Go back to the Total Scores screen and make some grade adjustments, taking note of which changes you made. Go to some auto-graded questions and edit grades, taking note of which changes you made. Go back to Statistics and confirm all stats updated as expected. Log in as a student and view Statistics feedback. Make sure the screen looks the same for you as it did for instructor.

      Description

      The Samigo Statistics screen is unattractive and hard to read, for example:

      • There is too much white space between sections/bars to see the stats for a question easily.
      • The numbers on the bars that indicate the number of responses for each answer have poor contrast with the background colors.
      • Color only is used to indicate whether answers students selected are correct/incorrect.
      • Printing yields poor quality printout (hard to read due to issues mentioned above).

      This is a jira to improve the readability/accessibility of the Statistics screen.

      Mock-ups:

      Score Distribution graph (like the ones in Gradebook), to include text alternative for screen reader users:

      Questions with response numbers to the left of bars and Correctness indicator for each response:

        Gliffy Diagrams

          Zeplin

            Attachments

            1. before1.png
              before1.png
              10 kB
            2. before2.png
              before2.png
              16 kB
            3. chart_examples.gif
              chart_examples.gif
              93 kB
            4. Exp_Stats_MC_MinimumPoints.gif
              Exp_Stats_MC_MinimumPoints.gif
              45 kB
            5. image-2020-02-11-16-41-06-934.png
              image-2020-02-11-16-41-06-934.png
              4 kB
            6. manykindsofquestions-forstatstest.zip
              12 kB
            7. questions-responsedistribution.png
              questions-responsedistribution.png
              65 kB
            8. samplequizstatsprintout.pdf
              154 kB
            9. scoredistributiongraph.png
              scoredistributiongraph.png
              54 kB
            10. statsscreen-gradestats-scoredistgraph.png
              statsscreen-gradestats-scoredistgraph.png
              64 kB

              Issue Links

                Activity

                  People

                  Assignee:
                  agschmidt Andrea Schmidt
                  Reporter:
                  rainribbon Tiffany Stull
                  Votes:
                  0 Vote for this issue
                  Watchers:
                  8 Start watching this issue

                    Dates

                    Created:
                    Updated:
                    Resolved:

                      Git Integration