I think your lack of confidence probably puts off a lot more women than your looks. Just a guess though. I'm saying that because I also was diagnosted with autism from an early age, and I tended to be afraid of rejection and didn't know how to talk to strangers or women. I didn't get much attention from women back then, but now that I've grown over it I do get plenty of attention. Heck, on more than one occasion women have made the first move on me.
I realize that not many people can grow out of autism, but there was an interesting article a while back that came to the conclusion that some people actually can, as long as you have a minor version of it and a will to change. And I believe that article because I'm probably one of them.