Modify the array of selected images in media modal

I’m able to do the following in media modal:

          var selection = wp.media.frame.state().get('selection'); // get selected collection
          attachment = wp.media.attachment(id);  // get attachment with id
          attachment.fetch();
          selection.add(attachment);  // add attachment to selection collection

There should be .remove() method or something similar.