I don't think he leaves the group. Maybe some of the things he would otherwise say are lost, maybe he is more likely to pick a fight with an evil member of the group. I hear there's a Keldorn Aerie romance though, maybe his wife getting sent away does this. I too thought from the choices that Keldorn was going to kill the paramour and become a fallen paladin if we went to the bar.

Do Keldorn or Anomen disappear for good if they kill their respective problems off?!

I went the "do the right thing" route for both.