Removing Custom Permalink Structure for Custom Post Type

Setting with_front to false solved the issue.