You are not understanding the topic. No one is saying that one race is dumber than another. Race, culture, gender among others influence everything and that includes tests. I could easily make a test and center it around my personal experiences, even if the subject is something totally different, making it very hard for someone who shares none of my experiences.
Unless you are talking straight up math, these things matter.