Reaction times are a thing and the walkers have never been shown to be particularly nimble or quick. If someone the size of Arya ran past someone the size of that walker fast enough to cause his hair to move, then look in that direction, by the time he actually sees her she's out of range and he isn't fast enough to grab her or catch her in the process.