Musk doesn't actually believe in free speech though. He only believes in the freedom to express his own speech. Remember how he reacted to criticism and satire when he became in charge of Twitter?
And part of free speech is being allowed to call people on their bullshit and misinformation, a concept that doesn't exactly exist on Twitter anymore.