posts_per_page not working in block

The problem was that there were ‘pinned’ posts, which were overriding everything. Un-pinning these posts seemed to do the trick.

Also, thanks to Sally CJ for the nopaging tip – I wasn’t aware that it causes posts_per_page to be ignored also.