The house was at the center of an acrimonious fight for its preservation that pitted different sides of Calloway's family against one another.