So after doing some investigating myself a couple of weeks ago, I found out that it’s mainly due to Enfold. There was a conflict between Enfold and the WPUAM plugin. After disabling the checkbox through Enfold the issue disappeared.
It seems like Enfold adds the checkbox to ANY login screen.