Plugins & backup not working correctly on new Digital Ocean server

It appears this was actually a firewall issue, not a permissions issue. Opening up a certain range of IP addresses on UFW via the Wordfence support article fixed the issue.

The backupwordpress plugin seemed to work correctly once the DNS was resolved fully as well.