I go to admin UI, Groups and delete all categories apart from one called "General" (hope there is not problem that I also deleted the one with empty title there)
Then at the other two screens I can go to from under Groups menu in admin UI, that is Groups and Groups Membership, I can still see the deleted categories at the dropdown (plus I see a "General" one twice there, so it must have been keeping very old ones too)