The comment login form is visible to me but not to the user
You have commenting turned off for logged-out users. To change this setting, visit the Settings > Discussion page in your WordPress admin and uncheck the Users must be registered and logged in to comment box. Remember to update the setting by clicking the Save Changes button.