Contrib: Gradebook2
  1. Contrib: Gradebook2
  2. GRBK-407

Improper handling of re-import of Scantron grades.

    Details

    • Type: Bug Bug
    • Status: Closed Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 1.1.3-b1, 1.3.0-b8, 1.5.0
    • Fix Version/s: 1.5.0-a1, 1.5.0
    • Component/s: Services
    • Labels:
      None
    • Environment:
    • Target Version:
    • QA Status:
      PASS
    • Previous Issue Keys:

      Description

      From Steve Faith:

      "... regarding the re-import of Scantron grades.

      Seems that the issue is when they do re-scoring. This means that a subset of Scantrons get re-evaluated by the machine and a new .xls file is produced.

      When they use Import and give the GB item name as the same name of the existing GB item, the import fails with a message indicating that a GB item with that name already exists. It turns out that re-scoring is a more common practice than we may have initially thought. I think that we need to come up with an easy way to make sure that additional imports can be easily appended/merged with an existing GB item."

      QA SUMMARY:

      On all three sites tested, Importing the original site specific Scantron was completely successful. When attempting to re-import a Scantron file with a subset of changed scores, the following message was generated:

      "The scantron assignment entered has previously been imported. We have changed the assignment name so that it will be imported uniquely. If you wanted to replace the old data, then please change it back."

      This implies that the original Scantron data can indeed be updated, however, upon changing the Scantron file name back to the original, the following message is generated:

      "There is already an existing item called "{specific Scantron file name}" in this category. Please enter a different name for the grade item."

      The request fails and the only remaining option is to cancel (see GRBK-403).

      Is the initial error message in error when it advises that changing the file name back to the original will allow replacing/updating of the original Scantron data?

        Issue Links

          Activity

          Hide
          Thomas Amsler added a comment -
          QA can you please verify this issue
          Show
          Thomas Amsler added a comment - QA can you please verify this issue
          Hide
          David L. Woods added a comment -
          QA VERIFICATION on:
           smartsite-test26.ucdavis.edu

          QA ENVIRONMENT:
           Win XP with Firefox 3.6.6

          QA TASK:
          GB2 import function: check if scantron rescore file (the column with scores is titled 'test') allowed to override previously loaded scores (regular scantron file with scores in column titled 'score'.)

          QA RESULTS:
          in a Categories Points gradebook (no weights):

          initial scantron .xls file loaded into new item in GB -- okay
          scantron rescore .xls file load attempted into same item in GB -- not allowed.

          next checked production with the same files and found the behavior is the same. I.E. you can't overlay a column of scores using a scantron format file.

          tried using a pre-existing empty item (no scores previously entered in gb column for any student) and attempting to load initial scantron file scores into it. -- this is not allowed in test26 or production.

          QA SUMMARY:

          import from Scantron file format (either initial or rescore scantron processing results) into gradebook cannot use pre-existing item in gradebook structure to receive the scores in either production or test.

          QA FAIL


          Note:
          Workaround for the rescore file processing problem is to delete the old score column before importing the rescore file.

          Another possible use case is that there are multiple sections giving the same test, and the section TAs run their scantron decks through the machine individually and then try to load the scores into a common item in the gradebook for the test. They would end up creating multiple columns -- one for each section -- for the grades that should be one item in the gradebook.

          Workaround is to create a new column during each scantron import, export the whole gradebook, combine the columns in excel, import the modified excel file back into gradebook (overlaying the existing grades), and delete the extra/redundant item columns.


           
          Show
          David L. Woods added a comment - QA VERIFICATION on:  smartsite-test26.ucdavis.edu QA ENVIRONMENT:  Win XP with Firefox 3.6.6 QA TASK: GB2 import function: check if scantron rescore file (the column with scores is titled 'test') allowed to override previously loaded scores (regular scantron file with scores in column titled 'score'.) QA RESULTS: in a Categories Points gradebook (no weights): initial scantron .xls file loaded into new item in GB -- okay scantron rescore .xls file load attempted into same item in GB -- not allowed. next checked production with the same files and found the behavior is the same. I.E. you can't overlay a column of scores using a scantron format file. tried using a pre-existing empty item (no scores previously entered in gb column for any student) and attempting to load initial scantron file scores into it. -- this is not allowed in test26 or production. QA SUMMARY: import from Scantron file format (either initial or rescore scantron processing results) into gradebook cannot use pre-existing item in gradebook structure to receive the scores in either production or test. QA FAIL Note: Workaround for the rescore file processing problem is to delete the old score column before importing the rescore file. Another possible use case is that there are multiple sections giving the same test, and the section TAs run their scantron decks through the machine individually and then try to load the scores into a common item in the gradebook for the test. They would end up creating multiple columns -- one for each section -- for the grades that should be one item in the gradebook. Workaround is to create a new column during each scantron import, export the whole gradebook, combine the columns in excel, import the modified excel file back into gradebook (overlaying the existing grades), and delete the extra/redundant item columns.  
          Hide
          Jon Gorrono added a comment -
          To clarify the use case, the error is only displayed if an existing category, other than 'Unassigned' is chosen for the assignment. If the Unassigned cat is left as the target then no error and a new assignment with same name is created there regardless of the existence of another with the same name *anywhere* in the gradebook... if a user then (after import) moves this new assignment to a category that has an assignment with the same name, an error is shown and it is not allowed.

          We had a short session with Kirk about this one... the result being:

          From Kirk's perspective this works pretty much just as it should be working and gave two options
           1) if we leave it as it is, we can add more description such as '...(error).... if you want to replace the assignment in that category, you will have to delete if first... you can do this after the import process is complete' or whatever
             - we can also add a date/timestamp to the new assignment name to discriminate among all the possible same named assignments in Unassigned category
           2) ask the user if they really want to override X yes/no and thereby allow it.

          And, while we will initially shoot for #2, if it is a mess to implement, we'll fall back to #1 and leave #2 as a possible future fix.

          Show
          Jon Gorrono added a comment - To clarify the use case, the error is only displayed if an existing category, other than 'Unassigned' is chosen for the assignment. If the Unassigned cat is left as the target then no error and a new assignment with same name is created there regardless of the existence of another with the same name *anywhere* in the gradebook... if a user then (after import) moves this new assignment to a category that has an assignment with the same name, an error is shown and it is not allowed. We had a short session with Kirk about this one... the result being: From Kirk's perspective this works pretty much just as it should be working and gave two options  1) if we leave it as it is, we can add more description such as '...(error).... if you want to replace the assignment in that category, you will have to delete if first... you can do this after the import process is complete' or whatever    - we can also add a date/timestamp to the new assignment name to discriminate among all the possible same named assignments in Unassigned category  2) ask the user if they really want to override X yes/no and thereby allow it. And, while we will initially shoot for #2, if it is a mess to implement, we'll fall back to #1 and leave #2 as a possible future fix.
          Hide
          Sandra Stewart added a comment -
          We need to review the documentation associated with this feature. Make sure the documentation is accurate for what this feature is doing.
          Show
          Sandra Stewart added a comment - We need to review the documentation associated with this feature. Make sure the documentation is accurate for what this feature is doing.
          Hide
          Jon Gorrono added a comment -
          Added a warning dialog when imported assignment will overwrite an existing assignment in a category other than Unassigned
          Show
          Jon Gorrono added a comment - Added a warning dialog when imported assignment will overwrite an existing assignment in a category other than Unassigned
          Hide
          David L. Woods added a comment - - edited
          QA VERIFICATION on:
           smartsite-test26.ucdavis.edu

          QA ENVIRONMENT:
           Win XP with Firefox 3.6.6

          QA TASK:
          GB2 import function: check if scantron rescore file (the column with scores is titled 'test') allowed to override previously loaded scores (regular scantron file with scores in column titled 'score'.)

          QA RESULTS:
          in a Categories Points gradebook (no weights):

          initial scantron .xls file loaded into new item in GB (not unassigned cat) -- okay
          scantron rescore .xls file load attempted into same item in GB (not unassigned cat) -- not allowed -- rejected with a message about wrong format.
                                                -- note: the score column is titled 'test' in a rescore file from the scantron system
          reload of initial scantron .xls file (score column is titled 'score') into the same item in the GB - after selecting 'override assignment' button -- okay


          QA SUMMARY:

          import from Scantron score file format into gradebook can use pre-existing item in gradebook structure to receive the scores - warning dialogue and allow update button work. QA Pass

          import from Scantron re-score file format into gradebook is rejected with message about incorrect file format before the import preview frame opens. QA Fail

          QA FAIL


          Note:
          Workaround for the rescore file processing problem is to re-title the score column (in Excel) to 'score' from 'test' before importing the rescore file.

            
          Show
          David L. Woods added a comment - - edited QA VERIFICATION on:  smartsite-test26.ucdavis.edu QA ENVIRONMENT:  Win XP with Firefox 3.6.6 QA TASK: GB2 import function: check if scantron rescore file (the column with scores is titled 'test') allowed to override previously loaded scores (regular scantron file with scores in column titled 'score'.) QA RESULTS: in a Categories Points gradebook (no weights): initial scantron .xls file loaded into new item in GB (not unassigned cat) -- okay scantron rescore .xls file load attempted into same item in GB (not unassigned cat) -- not allowed -- rejected with a message about wrong format.                                       -- note: the score column is titled 'test' in a rescore file from the scantron system reload of initial scantron .xls file (score column is titled 'score') into the same item in the GB - after selecting 'override assignment' button -- okay QA SUMMARY: import from Scantron score file format into gradebook can use pre-existing item in gradebook structure to receive the scores - warning dialogue and allow update button work. QA Pass import from Scantron re-score file format into gradebook is rejected with message about incorrect file format before the import preview frame opens. QA Fail QA FAIL Note: Workaround for the rescore file processing problem is to re-title the score column (in Excel) to 'score' from 'test' before importing the rescore file.   
          Hide
          David L. Woods added a comment -
          another noticed behaviour:
          when the score from a scantron file is over 100 points, the preview pane initially defaults the item definition max points to 100 and flags the scores over that amount in red.
          The item definition max points can be overridden in the preview pane with the true max (e.g. 500) and the scores will be imported, but the red highlighting of the scores in the preview and finish panels doesn't go away when the max points is changed in the preview pane.

          I don't believe this is a real problem, but it might need a footnote in the documentation.
          Show
          David L. Woods added a comment - another noticed behaviour: when the score from a scantron file is over 100 points, the preview pane initially defaults the item definition max points to 100 and flags the scores over that amount in red. The item definition max points can be overridden in the preview pane with the true max (e.g. 500) and the scores will be imported, but the red highlighting of the scores in the preview and finish panels doesn't go away when the max points is changed in the preview pane. I don't believe this is a real problem, but it might need a footnote in the documentation.
          Hide
          Vernon O'Connor added a comment -
          QA VERIFICATION ON smartsite-dev.rsmart.com TEST SERVER

          Using PC Windows Vista Enterprise SP2, Firefox 3.6.8 on:

          SmartSite@UCDavis - 2.6.4.0 - Sakai 2.6.2 - Server "ucddev1"
          GB2 version 1.3.0-b8


          RST 010A 001-003 / RST 010 001 FQ 2010

          Import of Scantron xls file with score header for grades column successful.

          However, RST_010A_Scantron_rescore.xls has "test" instead of "score" header for grades column.

          Although a successful Import of the rescore Scantron xls file was expected, the result was that the Import failed, with Warning: "The file loaded does not contain the required header information to load."

          Workaround: manually changing the grades column header from "test" to "score" allowed the Import to proceed successfully.
          Show
          Vernon O'Connor added a comment - QA VERIFICATION ON smartsite-dev.rsmart.com TEST SERVER Using PC Windows Vista Enterprise SP2, Firefox 3.6.8 on: SmartSite@UCDavis - 2.6.4.0 - Sakai 2.6.2 - Server "ucddev1" GB2 version 1.3.0-b8 RST 010A 001-003 / RST 010 001 FQ 2010 Import of Scantron xls file with score header for grades column successful. However, RST_010A_Scantron_rescore.xls has "test" instead of "score" header for grades column. Although a successful Import of the rescore Scantron xls file was expected, the result was that the Import failed, with Warning: "The file loaded does not contain the required header information to load." Workaround: manually changing the grades column header from "test" to "score" allowed the Import to proceed successfully.
          Hide
          Thomas Amsler added a comment -
          Changed Target Version to 1.4
          Show
          Thomas Amsler added a comment - Changed Target Version to 1.4
          Hide
          Jon Gorrono added a comment -
          set the fix version to 1.4.1 like the other critical bugs
          Show
          Jon Gorrono added a comment - set the fix version to 1.4.1 like the other critical bugs
          Hide
          Joyce Johnstone added a comment - - edited
          Need Wizard functionality to ask questions for importing a scantron. This is related to GRBK-752 (linked). Steve will draft a flowchart for import options, what are the defining characteristics for each import type. Wizard should verify that what is being imported is the same structure as when. was exported or allow user to completely replace what's in place in gradebook (blow away current) with warnings so the user is well aware of the action to be taken.
          Show
          Joyce Johnstone added a comment - - edited Need Wizard functionality to ask questions for importing a scantron. This is related to GRBK-752 (linked). Steve will draft a flowchart for import options, what are the defining characteristics for each import type. Wizard should verify that what is being imported is the same structure as when. was exported or allow user to completely replace what's in place in gradebook (blow away current) with warnings so the user is well aware of the action to be taken.
          Hide
          Jon Gorrono added a comment - - edited
          The core issue in this jira was fixed in july 2010... the qa failers should have created a new issue...

          The new issue is that there seems to be a difference between initial and regrade scantron file formats.

          The comments in this jira point to that difference being in the header name (being 'test' instead) ... other header labels are also different

          Steve Faith submitted a question to Center for Excellence in Teaching & Learning and the response included the attached xls file (with the student id's redacted).

          If so then the wizard is not needed since all the ui changes were implemented last year... if we want to change the interaction, we should make a new jira.
          Show
          Jon Gorrono added a comment - - edited The core issue in this jira was fixed in july 2010... the qa failers should have created a new issue... The new issue is that there seems to be a difference between initial and regrade scantron file formats. The comments in this jira point to that difference being in the header name (being 'test' instead) ... other header labels are also different Steve Faith submitted a question to Center for Excellence in Teaching & Learning and the response included the attached xls file (with the student id's redacted). If so then the wizard is not needed since all the ui changes were implemented last year... if we want to change the interaction, we should make a new jira.
          Hide
          Jon Gorrono added a comment -
               -- made header keys and ignored header values injectable
               -- added check for re-score header after failed check for normal scantron header
          Show
          Jon Gorrono added a comment -      -- made header keys and ignored header values injectable      -- added check for re-score header after failed check for normal scantron header
          Hide
          David L. Woods added a comment -
          QA Summary

          import a scantron file. change the target item name, max points, and target category on the first import page. finish the import.
          then re-import the same scantron file with some scores changed. change the target item name, max points, and target category to match that of the first import.
          Warning pop-up appears -- "Are you sure you want to overwrite existing assignment(s)? " -- hit the 'overwrite' button and the incoming values overwrite the existing grades.

          QA PASS

          NOTE that the overwritten item drops to the bottom of the category, rather than staying in the original location and the display checkbox is turned off. This was unexpected behavior.

          NOTE GRBK-905 was created to cover the case where the Scantron rescore file has a different column name for the column containing the new scores.

          Show
          David L. Woods added a comment - QA Summary import a scantron file. change the target item name, max points, and target category on the first import page. finish the import. then re-import the same scantron file with some scores changed. change the target item name, max points, and target category to match that of the first import. Warning pop-up appears -- "Are you sure you want to overwrite existing assignment(s)? " -- hit the 'overwrite' button and the incoming values overwrite the existing grades. QA PASS NOTE that the overwritten item drops to the bottom of the category, rather than staying in the original location and the display checkbox is turned off. This was unexpected behavior. NOTE GRBK-905 was created to cover the case where the Scantron rescore file has a different column name for the column containing the new scores.
          Hide
          David L. Woods added a comment - - edited
          QA VERIFICATION on:
           smartsite-dev.ucdavis.edu

          QA ENVIRONMENT:
           Win XP with Firefox 3.6.6

          QA TASK:
          GB2 import function: check if scantron rescore file (the column with scores is titled 'test') allowed to override previously loaded scores (regular scantron file with scores in column titled 'score'.)

          QA RESULTS:
          in a Categories Points gradebook (no weights):

          initial scantron .xls file loaded into new item in GB -- okay -- was able to name the item, set the max points, set the category -- and give a % of category, even though this was not a weighted cats points gradebook. the cat weight is apparently ignored.

          scantron rescore .xls file load attempted into same item in GB -- allowed all the same edits as indicated above. Received a dialogue box asking whether to overlay grades in an existing item. said yes. the new grades were entered in the existing item, overlaying the previous grades.


          History shows the creation of the item on initial import, and import of scores, followed by modification of the item, and import of new scores to replace previously entered ones.

          QA SUMMARY:

          import from Scantron file format (either initial or rescore scantron processing results) into gradebook can use either new or pre-existing item in gradebook structure to receive the scores in smartsite-dev.

          QA PASS

          Note this nullifies the GRBK-905 I created the first time I attempted to test this and failed the item re-use capability.
          Show
          David L. Woods added a comment - - edited QA VERIFICATION on:  smartsite-dev.ucdavis.edu QA ENVIRONMENT:  Win XP with Firefox 3.6.6 QA TASK: GB2 import function: check if scantron rescore file (the column with scores is titled 'test') allowed to override previously loaded scores (regular scantron file with scores in column titled 'score'.) QA RESULTS: in a Categories Points gradebook (no weights): initial scantron .xls file loaded into new item in GB -- okay -- was able to name the item, set the max points, set the category -- and give a % of category, even though this was not a weighted cats points gradebook. the cat weight is apparently ignored. scantron rescore .xls file load attempted into same item in GB -- allowed all the same edits as indicated above. Received a dialogue box asking whether to overlay grades in an existing item. said yes. the new grades were entered in the existing item, overlaying the previous grades. History shows the creation of the item on initial import, and import of scores, followed by modification of the item, and import of new scores to replace previously entered ones. QA SUMMARY: import from Scantron file format (either initial or rescore scantron processing results) into gradebook can use either new or pre-existing item in gradebook structure to receive the scores in smartsite-dev. QA PASS Note this nullifies the GRBK-905 I created the first time I attempted to test this and failed the item re-use capability.
          Hide
          Joyce Johnstone added a comment -
          Dave, can this be closed?

          Joyce
          Show
          Joyce Johnstone added a comment - Dave, can this be closed? Joyce

            People

            • Assignee:
              Unassigned
              Reporter:
              Vernon O'Connor
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: