in my opinion, i believe that that is the only thing one should pay for when it comes to developing a web site. something the site doesn't say is the inconvenience of switching your site to another web host.
often times, you are really only getting a folder on their website. say your website is called deafness.com, but you host it on a free server. the server puts 'deafness' in a folder on the server which becomes 'deafness.whatever.com,' which is not really your site. this is just some place holder on the server to store whatever you want. this is something that geocities used to do. it isn't really giving you a web site address, but it gives you a simple folder on their server (web site). if you are lucky enough to find the same web address you started out with (in this case 'deafness.com') not having the technological knowhow to create a url redirect to point your old page to the one you get in real life can cause you to look and seem unprofessional.
the lack of support is a huge problem. often times this includes basic functionality such as setting up emails, but it's integral when you want to create a website like alldeaf.com which uses the open source vbulletin. getting support for open source programs on a website is integral to the development of a site. it can be done cheaply if you know where to go.
i recommend tigertech.net, because of their attention to the needs of the non-technically minded. they offer full support for most open source applicatons, give a great hosting package, have something like 50 email addresses and it's only about 75$ a year, or 7/bucks a month.
and no i don't work for them. but i have used them for 10 years with 12 websites.