Whenever Lila broke off the relationships, “it required a long time to conquer Brian,” Donna acknowledges