You are right sis. Freedom of speech does not mean that our tongues should turn to guns that shoot bullets recklessly at others.
If what is said is the truth, then it should be investigated and facts be brought forward to quell the speaker but if it is false, then such speaker should be dismissed.
There are certain laws that guide citizens on this. We all need to be careful all the same.