I agree with you completely. If I bust my thumb with a hammer, I can almost guarantee that a profane word will escape my lips! I have also been known to use a profane word or two in moments of extreme frustration.
It has been my experience that people who use profanity consistently in conversation not only appear less intelligent, but they are usually socially akward, as well.