Spirits aren't animals to be kept as toys or pets. They were once living humans who have passed on and no longer have a physical body. Keeping him is just rude.
Remove Alex from the "spirit vessel" and see what he chooses to do. Since he likes you and your mom, you may find that he stays with you.