I recommend that anyone who wants to set up a podcast consider using WordPress as your podcast publishing tool. It has built in podcasting support and is really easy to use. It’s also free. Just install WordPress and enable the Podpress plugin and you will have full podcast support for your podcast. You enter your title, show notes, and provide the address of your podcast files. Hit the publish button and WordPress will post your podcast and automatically set up your podcast RSS feed.
If you set up your hosting at Dreamhost(aff) then you can use their one click install to get your WordPress set up fast and easy. Here’s a video of setting up WordPress using the one click install process and how to change the look of the site.
And here’s a video of how to set up your WordPress to support podcasts. Note: you don’t have to upload the Podpress plugin as it was included in your one click install.