I can see that. But at the same time as an outsider, I can't trust either side to tell the complete truth. I can't trust your memory to be 100% correct with his face or name. It's the same with the one who did it to you. I can't trust him either. But with no details and no real information I can't take an accusation seriously either.
You might not be one of them, but there are people who will mix it up and mistake these things.