Not that I subscribe to the idea that without religion there wouldn't still be conflicts, but that also means without religion there'll still be good. You can't both have the cake & eat it. Either religion is responsible for both evil & good, or it probably doesn't matter that much.
And you see, that's exactly what scares me. That there are people out there, who's reason for doing good is because their religious beliefs tells them so. I find that very scary and immoral.