The couple enjoys new happiness and a new home together