I've been having a bit of trouble with transferring some of my retinue. My faction leader's about 64 now so I'm trying to salvage them, yet whenever I try and move them they don't go. The target only has one in his retinue. Is it because he's a faction leader or am I missing something else?

Also, what's the limit for retinue characters?