So, I've just reread the scene in PT when Harry first sees Ivy after a long time. I was wrong. He explicitly wonders where Kinkaid is and he tries to catch Ivy's gaze, but with no luck (he says that she did not see him or ignored him, I bet is the latter). So, all makes more sense. Harry is normal, and oblivious of all the pain he brought Ivy and Kinkaid. Ivy is probably avoiding him, probably because she is angry.