Is my host the problem?

I addition to the methods you have mentioned, the biggest way to speed up your loading time is with a caching plugin.

There are many in the WordPress Plugin Directory, but my favorite is Quick Cache.