When I do that, the category no longer appears in the category dropdown when uploading (upload.php).
I've attached two screenshots. Watch what happens to the Competitions category. The first one (before.jpg) is the dropdown when Act As Category is set to no. The second (after.jpg) is when Act As Category is set to yes.