I think I see what happend.
My categories were not made as "Categories" but as private albums. I think this is because all my "Site" galleries had my username assigned to them (rather than leaving it blank).
Created my categories and now bulk moving my pictures. It'll get sorted out in a bit. Still nice having all the pictures in the db already.