Interaction and face to face time are what make any relationship thrive. When one spouse chooses to spend time away from the other, they are choosing to distance themselves and widen the gap that forms between them. When one partner is unwilling to spend any personal time with their spouse, there is a problem. If you don’t spend any time together you can’t have intimacy.