Freedom of speech doesn't mean speech without consequences. See: slander. How is that different? If the first amendment is absolute, then we should let people lie and destroy other's reputation at will.
"There is nothing new under the sun, but there are lots of old things we don't know yet." -Ambrose Bierce