Since my post meta data was holding this data even upon refresh, all I had to do was delete this metakey once all the shortcodes on my post content were processed.
For that, I made another shortcode and invoked that with do_shortcode() on single.php
since that only processes once at the end. Now once I refresh the post, I update the post metadata with new information everytime.
This might not be the best solution. But if someone was looking for one, there you go.