After days of tweaking and trying out a new thing, I found a WordPress plugin, which auto redirected all my links to the ones similar to the value set in Dashboard > Settings > Permalinks.
The second solution is to connect your website to Jetpack, and it also solves this problem. If you do not want to go with Jetpack, since it takes many resources, I would suggest going with the first option.