Problem with custom loop navigation inside the blog page

As always, at the very moment you give up, the solution comes before your eyes…

I was using a static page as the posts page, set up in Settings->reading->page for posts. Removing this has solved the problem. Now I have setup a page-blog.php template, which I have selected as a template for the Blog page and everything works as expected.