Can be many things here. Did you install with vb3 integration?
In the config-inc.php file line $vblicense has to be set to the proper vbulletin license number for logins to work not customer number.
Did you enter the cookie prefix in when installing which is by default bb?
Any of these can mess with the authentication of vb3.