Loial fled the two rivers with Lan? Didn't Loial first go to the Two Rivers with Perrin to investigate White Cloaks and later found Trollocs. Regardless Loial is ten feet tall in the books and the show decided to make him a little bit shorter. Likely for ease of filming as they would need perspective tricks, stilts, or something.