There was also the line where Holtz said that Justine was Connor/Stephen's mother; the way Justine looked at him was very vibey. I agree that Holtz most likely used those feelings to his advantage, but it's possible he cared about her to a degree. How he shows this affection is what worries me. He claimed to love Connor, but he also tied him to a tree and manipulated him into killing or punish his father, which would have left him fatherless, but you know people show love in different ways.