That's a straw man argument.
I have no doubt that you and your wife love each other, in the SAME WAY that you love your children, etc.
But you ended up where you did because you both found (and possibly still find) each other physically and emotionally attractive. You ended up getting married and starting a family because of it. You can call it whatever you want, but I think it's pretty twisted to give the same name to the emotions that put you in your wife in bed together, as what makes you hug your son or daughter whenever they skin their knee.
So pick one, call it love, but the other isn't the same thing.