I tried putting a new photo in the category and it didn't change what you could see, I also tried making a new category with strict permissions and still it could be seen. I also removed the contents of pp_cache table.
An example can be seen
gallery.backyardpoultry.com The category "Magazine" (and its sub-categories) should not be visible by anyone other than admin