Access denied on Published Pages but not on WordPress /wp-admin/

After talking to my hosting provider, many a times, the issue finally got resolved.

Solution: Fixing directory and file permissions.

I was told that:
All directories should have the permission 755. And, all files should have the permission 644.

Once, the hosting provider reset permissions of all the directories and files present in the folder to which the website is pointing to, the issue is resolved.