If a Script has been enqueued but not registered can I still removed it?

Yep, it’s possible, but you want to use wp_dequeue_script.

Try this:

<?php
function admin_hc_deregister_conflicts()
{
    wp_dequeue_script('script_name');
}