Multiple Address In WP-Option Value

After testing for hours, finally get it done.

Here the solution:
In database wp_options change the value for siteurl and home from your wordpress url to /path/to/wordpress

WordPress URL

Path To WordPress

Then add these code in the bottom of wp-config.php

define('WP_HOME', 'http://' .$_SERVER['HTTP_HOST']."https://wordpress.stackexchange.com/");
define('WP_SITEURL', 'http://' . $_SERVER['HTTP_HOST'] . "https://wordpress.stackexchange.com/" );

Now you can use Domain and IP together to access your wordpress. Of course you need to setup your webserver to listen to both

*It is not my VPN limitation though, just because I can and I think this is more cool.