"I was very harsh on him at the reunion, but he also laid a bomb on me, so it was well deserved," Kaylor tells PEOPLE of ...