I don't believe he mentioned any of his colleagues directly when he wrote-up the memo. Also, If I recall correctly, he mentioned the biological difference between men and women.
Oh, and I kind of find it amusing that nobody has mentioned anything about what was said to start off the memo.
From the memo author
"I value diversity and inclusion, am not denying that sexism exists, and don’t endorse using stereotypes. When addressing the gap in representation in the population, we need to look at population level differences in distributions. If we can’t have an honest discussion about this, then we can never truly solve the problem.