WordPress plugin compatibility explaination when wordpress releases its new version (theoretical)

The compatibility shows just the latest version the plugin was tested on. If WordPress didn’t change the API the plugin will continue working and you don’t have to worry.

Test it. There is no other way to be sure.