Uploaded image for project: 'Contrib: Evaluation System'
  1. Contrib: Evaluation System
  2. EVALSYS-1031

Need an easy and routine way to update users assigned to an eval

    XMLWordPrintable

    Details

    • Test Plan:
      Hide

      1) Set server to debug-mode logging for the evaluation project and the umiac group provider.
      2) Complete individual tests for each method of scheduling a sync (on server startup, on eval state change, on eval-group creation, on eval-group update, by time and state, and by quick sync). In each of these tests, do the following:

      2a) import evals and eval-groups as needed for the test
      2b) change information in the external data source so at least one student is removed and one student is added to the group
      2c) either wait for the scheduled sync to occur or cause it to occur (as appropriate)
      2d) view the log file to confirm that the update to group memberships has occurred
      2e)if possible, view the eval in the UI using "become user" to confirm that the membership changes are effective

      In addition, each of these tests should be reversed so that particular sync is no longer scheduled, and then the logs should be checked again after the the event or time has occurred to verify that the schedule update is effective.

      Show
      1) Set server to debug-mode logging for the evaluation project and the umiac group provider. 2) Complete individual tests for each method of scheduling a sync (on server startup, on eval state change, on eval-group creation, on eval-group update, by time and state, and by quick sync). In each of these tests, do the following: 2a) import evals and eval-groups as needed for the test 2b) change information in the external data source so at least one student is removed and one student is added to the group 2c) either wait for the scheduled sync to occur or cause it to occur (as appropriate) 2d) view the log file to confirm that the update to group memberships has occurred 2e)if possible, view the eval in the UI using "become user" to confirm that the membership changes are effective In addition, each of these tests should be reversed so that particular sync is no longer scheduled, and then the logs should be checked again after the the event or time has occurred to verify that the schedule update is effective.

      Description

      In 1.3.x and trunk, the groups provider behaves as follows:

      In short, the provider is consulted when the evaluation is created (or, more accurately, when the assignments are adjusted). First, the provider will determine which groups are viable to be selected. Then the provider answers the questions about who is allowed to take the eval and who is being evaluated in those groups. Both of these types of data are mapped into the tables for the evaluation. The groups data was always mapped into the tables since version 0.1 (maybe 5 years ago). The memberships change is fairly recent by comparison (as in, it happened about 2 years ago).

      Providers don't do anything with tables. They only are able to answer questions and do not really know anything about the internals of the system (nor should they). It is not timed. It is action driven. There is no syncing unless the assignments are changed.

      My memory on the precise reasoning behind these changes is somewhat fuzzy at this point since it has been quite awhile since the changes were made but I do recall it was related to performance and relevance of the data. I think UCT was at least partially involved so Marquard might have some comments.

      At Michigan, Rutgers and some other adopting institutions, the difficulty of updating the rosters through the group provider will present a problem. There needs to be a way to trigger updates periodically.

        Gliffy Diagrams

          Zeplin

            Attachments

            1. evalsys-1031.patch
              420 kB
            2. sync-cron-triggers-add_edit.png
              sync-cron-triggers-add_edit.png
              101 kB
            3. sync-cron-triggers-list.png
              sync-cron-triggers-list.png
              57 kB
            4. sync-event-triggers.png
              sync-event-triggers.png
              77 kB
            5. sync-quick.png
              sync-quick.png
              62 kB

              Issue Links

                Activity

                  People

                  Assignee:
                  jimeng Jim Eng (Inactive)
                  Reporter:
                  jimeng Jim Eng (Inactive)
                  Votes:
                  1 Vote for this issue
                  Watchers:
                  15 Start watching this issue

                    Dates

                    Created:
                    Updated:
                    Resolved:

                      Git Integration