First, it would be very helpful to know what Theme you’re using, so that we can give specific instructions/advice.
Without knowing what Theme you’re using, we have no way of knowing what template file(s) to tell you to edit; however, those links are likely coming from these two tags:
previous_post_link() (Codex reference)
and
next_post_link() (Codex reference)