Can inactive WordPress plugins still load scripts?

Many hypotheses could be made, but the most probable ones are that the theme or a third plugin loads the script if a specific option saved in the database has a certain value. If the plugin is installed but not active that hypothetical option still exists in the database, on the contrary, when you delete the plugin, it will delete that option.

Another hypothesis is that you think the plugin is deactivated, but a third plugin filters the option “active_plugins” in a mu-plugin, and on the frontend that plugin is active, even if in the page of plugins you see it disabled.

Another hypothesis is the script is loaded by a caching plugin, and it was a coincidence that when you deleted the plugin the cache was also deleted.

You can do also other suppositions, but without having more details you can only guess.