Yes.
Cloudfront is just a caching proxy to your content not different from any other cache on the internet. AFAICT If you set up your cache headers properly it will cache automatically your content.
The difficult part in caching is to know what not to cache and to invalidate the cache when there was a change. You can look at how the caching plugins (super-cache and w3tc) work and try to use similar settings for cloud front.