Uploaded image for project: 'Sakai'
  1. Sakai
  2. SAK-40476 Tests & Quizzes - Parent jira for bug fixes to Minimum Point Value
  3. SAK-41231

Samigo - Tests & Quizzes - Allow Minimum Point Value to Equal Answer Point Value

    Details

    • Test Plan:
      Hide

      Note: To make the initial testing steps below easier for QA, I have attached quiztoedit-no-min-values-yet.zip that you can import into a site. As per SAK-40464 (another subtask of this jira's parent), you cannot directly import assessments with min values included from a zip/xml file.

      1. Ensure samigo.allowMinScore = true is set on the server where you are testing.
      2. Access the Tests & Quizzes tool in a site, and create or edit a quiz.
      3. Create or edit each of the following question types in which the minimum point value option appears:
        • Short Answer/Essay
        • Matching
        • Multiple Choice
        • True/False
        • Fill in the Blank
        • Numeric Response
      4. For each question:
        1. Enter a value into the Answer Point Value box.
        2. Try entering a negative number into the Minimum Point Value box, then either click out of the Min Value box or use the Tab key to navigate to the next box on the page, and confirm that the negative Min Value is not allowed.
        3. Try entering a number greater than the the Answer Point Value, then either click out of the Min Value box or use the Tab key to navigate to the next box on the page, and confirm that the Min Value greater than total points is not allowed.
        4. For True/False and Multiple Choice, also confirm that Min Value CANNOT be enabled at the same time as either of the following:
          • Negative marking/points deducted for incorrect answer
          • Partial Credit (on multiple choice, single selection)
        5. Enter the same value as Answer Point Value into the Minimum Point Value box.
        6. Either click out of the Min Value box or use the Tab key to navigate to the next box on the page, and confirm the Min Value EQUAL to total points remains.
        7. Save the question.
      5. Go to the Settings for the quiz, and edit as follows:
        • Make it Unlimited Submissions
        • Grading and Feedback > Feedback on Submission > include:
          • Student Response
          • Correct Response
          • Assessment Scores
          • Question and Part Scores
      6. Log in as student and submit the quiz several times, and check feedback to confirm the points are correct, as follows:
        1. Submit blank (should get 0 points)
        2. Answer all questions incorrectly (should get full credit because min value is full points)
        3. Answer all questions that would normally give partial credit for a partially-correct answer such that you would normally get less than full credit - for example, answer the matching question with one correct and one incorrect match (should get full credit because min value is full points).
        4. Answer all questions correctly (should get full credit)
      7. Log in as instructor and check the Published Copies > Scores.
      8. View > All Submissions.
      9. Go to Questions and access each question page. Make sure the points for the submissions are accurate per above.
      10. Additional Steps for QA: Do some general testing of the scoring for other combinations of min/total points - i.e., confirm the following for ALL question types:
        1. If there are no min points entered, questions are scored correctly/normally, based on correct and incorrect answers (make sure you do multiple submissions to test different combinations of correct/incorrect answers - e.g., multiple blanks on FITB, multiple choice partial credit, multiple choice with multiple correct multiple selection, and matching with different combinations of correct, incorrect, and partially blank answer selections)
        2. If there are min points less than total points, but you can score more than the min points without getting full credit, you get the appropriate scores (see the matching example in this Help article for how to test.)
        3. Correct functionality of negative marking a.k.a. points deducted for correct answer for true false and multiple choice, single correct.
        4. Correct functionality of scoring for random draw test (both with and without points deducted for incorrect answer), i.e.:
          1. Add several questions in a pool.  These questions should have several different total point values (e.g., 5 for some questions, 10 for others)  Some of the questions should also have minimum point values specified, at least one with min points = total points, and at least one with min points < total points.  At least one question should have negative marking.
          2. Generate a random draw quiz from the pool, with the point value different from all point values existing in the pool (e.g., 1), and no negative marking settings.
          3. In the quiz settings, specify Unlimited Submissions, Feedback on Submission and display correct response, student response, question and part scores, assessment score.
          4. Publish the quiz.
          5. Edit the published quiz and make sure that the point values correspond to the random draw specifications (e.g., 1 point for each question and not 5 or 10, and editing each question reveals no min value or negative marking).
          6. Republish the quiz.
          7. Log in as student and submit the quiz several times, with different combinations of correct, incorrect, and blank answers.
          8. Check Feedback for each submission and ensure the scores are correct.
          9. Log in as instructor, go to Published Copies > Scores > View All Submissions > check each submission and make sure the scores are all correct.
          10. Repeat steps 2-9, with the following differences:
            • At step 2, DO include negative marking at step 2.
            • At step 5, ensure each type of question that allows for negative marking (true false and multiple choice) includes the correct value.
      Show
      Note: To make the initial testing steps below easier for QA, I have attached quiztoedit-no-min-values-yet.zip that you can import into a site. As per SAK-40464 (another subtask of this jira's parent), you cannot directly import assessments with min values included from a zip/xml file. Ensure  samigo.allowMinScore = true is set on the server where you are testing. Access the Tests & Quizzes tool in a site, and create or edit a quiz. Create or edit each of the following question types in which the minimum point value option appears: Short Answer/Essay Matching Multiple Choice True/False Fill in the Blank Numeric Response For each question: Enter a value into the Answer Point Value box. Try entering a negative number into the Minimum Point Value box, then either click out of the Min Value box or use the Tab key to navigate to the next box on the page, and confirm that the negative Min Value is not allowed. Try entering a number greater than the the Answer Point Value, then either click out of the Min Value box or use the Tab key to navigate to the next box on the page, and confirm that the Min Value greater than total points is not allowed. For True/False and Multiple Choice, also confirm that Min Value CANNOT be enabled at the same time as either of the following: Negative marking/points deducted for incorrect answer Partial Credit (on multiple choice, single selection) Enter the same value as Answer Point Value into the Minimum Point Value box. Either click out of the Min Value box or use the Tab key to navigate to the next box on the page, and confirm the Min Value EQUAL to total points remains. Save the question. Go to the Settings for the quiz, and edit as follows: Make it Unlimited Submissions Grading and Feedback > Feedback on Submission > include: Student Response Correct Response Assessment Scores Question and Part Scores Log in as student and submit the quiz several times, and check feedback to confirm the points are correct, as follows: Submit blank (should get 0 points) Answer all questions incorrectly (should get full credit because min value is full points) Answer all questions that would normally give partial credit for a partially-correct answer such that you would normally get less than full credit - for example, answer the matching question with one correct and one incorrect match (should get full credit because min value is full points). Answer all questions correctly (should get full credit) Log in as instructor and check the Published Copies > Scores . View > All Submissions . Go to Questions and access each question page. Make sure the points for the submissions are accurate per above. Additional Steps for QA: Do some general testing of the scoring for other combinations of min/total points - i.e., confirm the following for ALL question types: If there are no min points entered, questions are scored correctly/normally, based on correct and incorrect answers (make sure you do multiple submissions to test different combinations of correct/incorrect answers - e.g., multiple blanks on FITB, multiple choice partial credit, multiple choice with multiple correct multiple selection, and matching with different combinations of correct, incorrect, and partially blank answer selections) If there are min points less than total points, but you can score more than the min points without getting full credit, you get the appropriate scores (see the matching example in this Help article for how to test.) Correct functionality of negative marking a.k.a. points deducted for correct answer for true false and multiple choice, single correct . Correct functionality of scoring for random draw test (both with and without points deducted for incorrect answer ), i.e.: Add several questions in a pool.  These questions should have several different total point values (e.g., 5 for some questions, 10 for others)  Some of the questions should also have minimum point values specified, at least one with min points = total points, and at least one with min points < total points.  At least one question should have negative marking. Generate a random draw quiz from the pool, with the point value different from all point values existing in the pool (e.g., 1), and no negative marking settings. In the quiz settings, specify Unlimited Submissions , Feedback on Submission and display correct response, student response, question and part scores, assessment score. Publish the quiz. Edit the published quiz and make sure that the point values correspond to the random draw specifications (e.g., 1 point for each question and not 5 or 10, and editing each question reveals no min value or negative marking). Republish the quiz. Log in as student and submit the quiz several times, with different combinations of correct, incorrect, and blank answers. Check Feedback for each submission and ensure the scores are correct. Log in as instructor, go to Published Copies > Scores > View All Submissions > check each submission and make sure the scores are all correct. Repeat steps 2-9, with the following differences: At step 2, DO include negative marking at step 2. At step 5, ensure each type of question that allows for negative marking (true false and multiple choice) includes the correct value.
    • 19 status:
      Verified

      Description

      PURPOSE

      The Minimum Point Value can offer multiple benefits for instructors. It can be helpful for low-stakes comprehension activities to encourage participation (and not penalize students too much). It can also be an effective way to gather participation data in larger classes (and save considerable grading effort on instructors). However, the latter is only true is the Minimum Point Value can be set up to the total Answer Point Value.

      ITEM TO CHANGE

      Currently, the Minimum Point Value has a validation item that tests for the Minimum Point Value to be (a) greater than or equal to zero and (b) less than the Answer Point Value. The latter test should be set to less than or equal to the Answer Point Value.

      BENEFITS OF THE CHANGE

      For the use-case of a participation item (for attendance, reflection, and/or content reinforcement), this change will help instructors of large classes.  By offering full credit for any submission on a short answer/essay question, for example, instructors can enjoy auto-grading of quizzes during a class.  Later, they can review submissions and manually reduce any scores that don't meet their requirements. This is a huge time-saver; this way, they simply adjust the scores of the few students that don't meet the standard rather than grading all students individually in this type of use-case.

        Gliffy Diagrams

          Zeplin

            Attachments

              Issue Links

                Activity

                  People

                  Assignee:
                  rainribbon Tiffany Stull
                  Reporter:
                  alanregan Alan Regan
                  Votes:
                  0 Vote for this issue
                  Watchers:
                  9 Start watching this issue

                    Dates

                    Created:
                    Updated:
                    Resolved:

                      Git Integration