Add pagination to a template loaded by query variable

After a bit of digging over the weekend, I found the solution and indeed, it is a rewrite rule with the paged variable added

add_rewrite_rule('collection/men/page/([^/]+)/?$','index.php?post_type=collection&men=yes&paged=$matches[1]','top');

Pagination now works in the custom template loaded by query variable. i.e. localhost/sample-site/collection/men/page/2 loads the next page instead of a 404 error