We've heard that can be an issue with this bread. They anecdotal evidence is that they tend to attach to one person of the opposite sex. Our lady Chihuahua definitely seems to prefer me, so we make her spend as much time with the wife and kids as possible. So far, so good. As long as she has a lap to sleep in, she seems to be fine.
It's been hard to house train her though. Didn't see that one coming, but that also seems to be common trait with the breed. We're making progress...