Hi Mark Kaplun and toscho, thank you for replying.
I’ve figured out the culprit, it was caused by W3 Total Cache Plugin setting.
Under Browser Cache, I have to untick this:
Prevent caching of objects after settings change
The weird string before every links is then removed.