Currently there is not a way to have him admin only the gallery. Though I don't remember exactly how much you can restrict through your admin permissions, you should be able to edit the permissions for that user and restrict him from being able to edit most of your
vB stuff.