Disable “Quick edit” for roles in WP dashboard

I hope you need to disable “Edit” and “Quick Edit” for non-admin roles. So you can modify your code as follows

function remove_quick_edit( $actions ) {
    unset($actions['edit']);
    unset($actions['inline hide-if-no-js']);
    return $actions;
} 
if ( ! current_user_can('manage_options') ) {
    add_filter('post_row_actions','remove_quick_edit',10,1);
}