How to disable edit link button bottom of the page for all users except Administrator

You should not make users editors if you do not want them to be able to edit any content. IIRC an author role is enough to be able to upload images, and that should probably solve your issue. Otherwise if you need something additional to what authors can do, use a plugin that lets you manipulate user and role permissions (or ask a more specific and detailed question 😉 )