Anyone else deal with this? My husband leaves for work at 4 in the morning. I have come to dread this time. My 2mo baby MUCH prefers my husband.