Yes, the redirects will no longer exist if you deactivate the plugin.
I’ve just manually checked in the plugin’s files. Your redirects get saved to a option named 301_redirects, the plugin then hooks into init with its redirect() function, which does what it is named after.
This means once you deactivate the plugin, this option won’t be checked anymore and more importantly, no redirects will be issued.