After some online searching I found a key to add in my arguments array of custom post type, map_meta_cap => true this brings the View, Edit, Quick Edit, Trash and that resolved my post delete issue also. I would like to recommend the following documentation who ever get stuck in such situation 🙂
https://codex.wordpress.org/Function_Reference/register_post_type