Try this:
1.- Review all your plugins. Try deactivating and activating plugins until you find the one (or ones) which are slowing down the loading time.
2.- Install and configure a properly cache plugin. W3 Total Cache works pretty fine, with multiple caching types as page cache, minify cache (also minifying HTML, CSS and JS so nicely), browser cache and database cache.
Hope it helps… GL!