I found this to finally work.
python3 -m pip install --upgrade https://storage.googleapis.com/tensorflow/mac/cpu/tensorflow-1.12.0-py3-none-any.whl
Edit 1: This was tested on Windows (8, 8.1, 10), Mac and Linux. Change
python according to your configuration. Change
py2 in the url if you are using Python 2.x.
Edit 2: A list of different versions if someone needs: https://storage.googleapis.com/tensorflow
Edit 3: A list of urls for the available wheel packages is available here: https://www.tensorflow.org/install/pip#package-location