It seems if students do not have the viewgroup permission, they should not be able to see group memberships for anyone in the site.
1. Log in as a student when that role that does not have the roster.viewgroup permission
2. Go to the Roster tool in a site with groups defined
3. Click the Group Membership Link
5. The student is able to see the group listings in the last column of the table